Just tried and I got something new:
A second and third press of the button, fixed it. I haven't seen that before.
I currently have a valid image in flash.
Things are currently working for me, but I am doing the flash writing from my SoC not the firmware.