An interesting article on why sometimes, low ESR capacitors can be a bad thing - especially in the context of power supplies as low input impedances can cause high inrush currents and voltage spikes.
A good read for one of the reasons Tantalum, Aluminum, and Electrolytic caps are used on the input side of many power supplies.