Don't forget that Woo Jinchul also regains his memory when Jinwoo met him again in the side stories. That is why he instantly becomes the chairman of the hunter's association when the gates starts appearing again