Issue with the FaceID

My younger brother unlocks the face ID on my phone without my permission and sometimes uses it without my knowledge. I tried to update the faceID, with my glasses on and without glasses, but still my brother gets access. My personal data is not secure. I need a solution to this problem.