Kiryu and Haruka

I'm playing yakuza 6 for the first time and I arrived at the point where the child services bastard is trying to take haruto saying kiryu has no right to claim guardianship over him but I thought kiryu legally adopted haruka at the end of the first yakuza which would mean kiryu is legally haruto's grandfather hiw come he can't claim guardianship over haruto?