Chosen Solution
I plugged in my speaker to charge via the usb port. When I did that, the airport express started blinking amber. When I unplugged it, it was fine. What happened?
The USB port on the AirPort is designed to support a data connection not power for recharging.