On: CryptGPT: A Simple Approach to Privacy-Preserving ...

[diwank]

It is possible to reconstruct the text from an embedding but also more importantly, I believe that by embedding, the OP means sending the computed embedding matrix instead of the input. Which is a simple matrix inversion problem.

Computing output embeddings is different.