That's actually a pretty interesting idea. I wonder if we could make a lite version of Caddy bundled with your website embedded...no need to mess with file systems or permissions or devices and folders to run a static site. Might need some massaging to become a truly pleasant workflow though.
The go std library offers the embed package. You can just embed your files and use the std lib's webserver and generate a single file binary.
No need for Caddy.