Mushoku Tensei Protagonist

I'm currently watching Season 2, Episode 2, and the protagonist is being quite frustrating, both in the final episode of Season 1 and the beginning of Season 2.
Even though I understand he's struggling psychologically because the feeling of being abandoned is overlapping with his memories of his previous life, I can't help but feel frustrated and annoyed.... He's a character I've had mixed feelings about since before.
Anyway, since it's a Japanese anime I haven't watched in a while, I'll keep watching, but if the protagonist continues to be this inconsistent, it's going to be hard to keep up..