Chosen Solution

Device only works when plugged in, Can I still purchase a new battery for it?

@kat54 sure you can. Here is the guide for the replacement. The battery is available at places like this as well as many more.