Not sure what you mean by " used like hardware in isolation as part of a permanent installation".
Are you saying you will never again have access to the Mac mini? Ever? If anything happens and it fails or has to be restarted or updating or anything that requires access to it, it cannot be done?
You don't need to change its location if that's what you mean, but as with any computer, updates and other issues may arise that require access to the device at some point to fix or complete, so completely isolating the Mac can lead to being unable to resolve any issues that may arise and cause issues with whatever its running as part of the installation and well make it so it can't do what it was set to do.
Computers can crash, they can halt, then could even restart lose power, get hung up and need some kind of human intervention to return them to a functional state. Macs and even Mac Mini's are not immune to this.
This is true and has been true for every model of Mac, including Mac minis of the past. So, nothing really has changed in how Mac Mini's work in that regard.
If what you want to is t set it up once and forget about it for the next 20 years until you replace it, then probably not. There's no guarantee something won't happen to cause it to stop doing whatever it was set to be doing.
Otherwise, please be very clear what it is you expect the Mac to do. And someone may be able to advise.