Synced contacts with other phone

My brother passed down his old iPhone because he got a new one and just now he has been getting the contacts which I add to my phone over and over again which he has to delete by hand. I have checked iCloud but it says I have nothing synced and I have checked everything else but I can't find anything that says I am synced with another phone.