Hey there topsecretbb,
Thanks for reaching out to the Apple Support Communities.
To help narrow down the issue further, do you also have Handoff enabled on both your iPad and Mac mini? For help with checking this setting, take a look at this link here: Use Handoff to continue tasks on your other devices - Apple Support
• Mac with macOS Ventura or later: Choose Apple menu > System Settings, click General in the sidebar, then click AirDrop & Handoff on the right. Turn on “Allow Handoff between this Mac and your iCloud devices.”
• Mac with earlier versions of macOS: Choose Apple menu > System Preferences, click General, then select “Allow Handoff between this Mac and your iCloud devices.”
• iPhone or iPad: Go to Settings > General > AirPlay & Handoff, then turn on Handoff.
Also, if using an iPad with a cellular connection, have you ensured that the cellular connection is not being shared, and that your Mac mini is not sharing its internet connection?
If still having issues after the steps above, we'd also recommend creating a new admin user account to test the issue further. This can help to determine if the issue is isolated to just your account, or if the issue is system-wide. If you need any help with creating a new user account, check out this link here: Set up users, guests, and groups on Mac - Apple Support
After testing the issue, you can go ahead and remove the test account. Let us know what you find, and we'll continue from there.
Have a great day!