You can leave Family Sharing turned on but turn off purchase sharing which will also stop any billing from passing onto you.
From: How to share apps and purchases with your family - Apple Support
"Which payment method is charged for purchases that family members make?
When Purchase Sharing is turned on, everyone's purchases bill to the family organizer's payment method.* If there's an issue with the payment method, the family organizer can update their payment method or add a new one.
If you're the family organizer and you don't want to share a payment method with your family, turn off purchase sharing. When purchase sharing is turned off, you can continue to share subscriptions like Apple TV+ and Apple Arcade. When Purchase Sharing is turned off, everyone must use their own payment method.
* Learn how purchases are billed if a family member has Apple Account balance. [ How apps, content, and subscriptions from Apple are billed - Apple Support ]"
This document basically says that if anybody in the family has personal Apple Account balance, that gets charged first before the Organizer's payment method.