Was Go Ji-yong's family wealth somewhat exaggerated by rumors?

Wasn't it widely accepted online before that Go Ji-yong's family was almost at the level of a semi-chaebol?
I feel like there were even rumors about him inheriting a steel business.
People used to say that the reason he had absolutely nothing to lose by declining a Sechskies comeback
was because of that.
Is it that his family's wealth isn't actually at that level, but more like a well-off middle class?
Or is there some other circumstance we don't know about?
Like, did they cut off his financial support because he kept failing so much?