Family share someones debit card stuck on my phone

My apple pay was set up to my own debit card and has been working for months, however last night a family member decided to do a family share and later on when i went to pay for something with apple pay it had defaulted to his debit card which of course failed as i dont have his information, he removed the family share so did i but his card is still default when you double click, it wont let me delete it and wont let me overide with my own debit card, how can i remove a debit card added from family shre and get my card set as default again, the family shre is gone but not his debit card and as i said select debit card to remove wont do anything????