Tantalum caps tent to instantly short out when power is reversed.
Aluminum electrolytics can withstand very short voltage reversals, but will still blow fairly quickly. Usually they open instead of short.
All semiconductors can be damaged by power reversal, if they exceed internal protection currents. In general diodes are not damaged, if their reverse voltage spec is higher than the voltage applied. Transistors can be damaged depending on the circuit design. Some circuits make it difficult to exceed the reverse voltage limits of the parts, while others have no protection from it.
Most chips have protection diodes on inputs to limit voltages going out of range, but those have current limits and will be damaged at higher currents. Most chips do not have reverse voltage protection on their power pins, or at least not with enough current protection to withstand a powerful power supply connected backwards. So chips are often the first to blow.
... Maybe a good idea seeing as module manufactureres can't agree on the correct way to orient a boxed header.
Can you name one product that has a boxed header oriented the wrong way? All the ones I've seen have been oriented the same way. With pin 1 at -12v. The problem comes from people using ribbon cables that were not made correctly for use with boxed headers. Many manufacturers made (make) their ribbons with no care about the female connectors being oriented correctly because traditionally Doepfer and early manufacturers never used box headers, so the orientation wasn't important.
Now that boxed headers are becoming more popular it is important for manufacturers to start paying attention to how they make their ribbons. But even more importantly, the users have to pay attention to the ribbons they own if they have bus boards with boxed headers. They shouldn't just plug the ribbons in blindly. They should check that they were made correctly for use with boxed headers. And if not, replace the ribbon (or remake them).