If you are waiting for someone to tell you it’s okay to update you’ll never do it. Ten people may tell you it’s okay but if even one says they have issues you will hesitate. That thinking is your problem to deal with.
Remember, these forums are like a hospital. Only the sick come here while the rest of us are happily healthy using our Macs running Sequoia 15.4.1. If you went into a town’s hospital and saw only sick people would you conclude the entire town is unhealthy and choose not the live there? Think about that.
Finally, macOS Sequoia is nearing the end of its life cycle at 15.4.1 and the next version of macOS will likely be announced at WWDC this June. All major, show stopping issues have long been dealt with and future updates will likely concentrate on security flaws and newly discovered exploits. For this reason alone you should definitely update. Sequoia 15.4.1 fixed two security flaws that Apple thinks were being exploited in the real world. Sequoia 15.4 fixed over fifty.
And by the way, your profile says you are running 15.3. Are you satisfied? Is it performing well for you? Well, the version you are using was declared to be the worst ever update Apple has ever released by some users here. Every release of an update by Apple is declared to be faulty and show stopping by some. What does that tell you about listening to users here in the hospital?