My impression is that if it shows up by running the command Jupyter kernelspec list then it will work in zed out of the box. Does it show up on this list?
I don't think so, if that jupyter command just runs against your local servers. We register the moonglow remote servers with VSCode through the extension, and my guess is we'd need to do something similar with Zed.