The “unplugme” is a classic sign that the psu's tripping one of it's overvolt/crowbar protection circuits. In the "old" days an overvolt/crowbar protector consisted of a silicon controlled rectifier (SCR) with it's cathode and anode wired across the particular direct current (D.C.) output's plus and minus, with a voltage sense circuit tied to the SCR's gate designed to turn the SCR on when an over voltage occurs. This protects against crowbars too, as a crowbar is simply a fast short duration overvoltage, in other words, a spike or series of spikes.
An SCR is an alternating current (A.C.) device, typically of a high current fast acting nature. It is turned on by the appropriate signal level voltage/current on its gate, and conducts across its cathode/anode until its gate is turned off AND its cathode voltage drops to (very close to) or crosses 0 volts. So, once the overvolt detector fires the SCR, the SCR turns on, shunting (dropping) the particular D.C. output by short circuiting it, and since the power supplies output is D.C, instead of A.C., the SCR stays on until the supply is turned off by unplugging, blowing a fuse, etc. etc. The typical SCRs fast response can clamp down an errant supply within a few hundredths of a volt, saving expensive hardware from catastrophic melt down.
Today’s protection circuits utilize integrated power management circuits that incorporate many additional features such as undervolt protection in place of just a simple overvolt/crowbar sense circuit, but the high current fast acting SCR is still an integral part, no other device will do it.
Although It may sound like the standby 5volt would be the culprit, it could actually be any one of the outputs, depending on the psu’s design, as the typical management chips are not limited to a one per one arrangement as were the circuits of the past, they tend to clamp down the entire supply when one critical output fails. This avoids damage that would occur if say the 3.3 volt supply section failed and all others remained on.
In reality, it may not be the supply, as several have mentioned, you could have a peripheral that has a failing device, for instance a power transistor (motor or solenoid driver etc.) that is slowly dropping impedance and is spiking the 5 volts with 12 volts, there are a myriad of possibilities.
Steve