I am also on the release branch of MSFS 24, so I should be using SU3. I just loaded up the TBM again and confirm that I don't have the issue. I popped out every panel I could find in the aircraft, and none of them exhibited the issue.
Normally, my flow when getting into the aircraft is to pop the GNS panel out onto my RSG unit before I start it, so I started the aircraft quickly and then started playing with panels. None of them even blipped the power, no matter if I moused over them, or dragged them, or anything.
Initially my GNS panel wouldn't pop out, but the issue was I didn't have my RSG unit connected. MSFS apparently remembers where they are even if the monitor in question isn't connected, so as soon as I connected it it was waiting for me on the unit.
I don't have any solutions other than it's not a universal problem.