I'd been thinking for a long time how to fix the problem. Make the button harder to push somehow by altering it inside the unit? Disconnect the switch and mod the unit, adding a 'regular' push button one on one of the sides? Intimidating it with a forceful, angry looking stare? (just kidding with that last one
Now I feel a bit stupid. In all the time I've been racking my brain I'd never thought of this...
The really crazy part is that I always adjust those settings as a part of my initial setup after a clean install of Windows, and with having a dozen mini PCs and doing a clean install with every one of them as a matter of course, both after initial setup and every time a new version of Windows 11 is released, you know I've done it quite a bit. I always set the power button to shut the unit down when pressed. Why I didn't remember this setting I can't say. Just one of those "Duh!" moments. Seriously! I've been thinking about how to fix this problem for months!
So, for anyone else with one of these that is having a similar problem, that's how to resolve it.