That's the point, genius. The MC's father was supposed to give the impression of being a dickhead. Not every single manga will have every character as happy. A lot of them will be stupid, some will be assholes, and some won't even make sense.
Maybe Harem King is his mother, who transforms into different women all the time to handle situations and always says she's there by someone else's orders. People think that the person who gives her the instructions has a lot of women, therefore earning herself the name of Harem King. Boom, ∞ IQ play