Looks like I'd have to install a read only version of the OS. Apparently Raspberry Pi doesn't like the power being cut. Can wipe the SD card. That happens in the location where this will be installed.
Overview | Read-Only Raspberry Pi | Adafruit Learning System
Overview | Read-Only Raspberry Pi | Adafruit Learning System