I can confirm that it takes a bit of elbowing around, but you can get matrix-client.el to work with pantalaimon in its current state. extending the client to "know" it needs to talk to localhost rather than the server half is most of the stuff I had to hack on to make it work.