Just to say thank you for your efforts! It is kinda very sad that MS hid the Orca, I wanted to test it from the start on. Now I found out that guanaco 30b has the spatial comprehension to some limited extent though this is the best 30b model so far. Can you add this model for the list of your training? And it would be very nice as well if someone would sponsor the MPT-7b (better then LLaMA-13b in most of the cases) and RWKV (I would really love to see how it will perform after such tuning). The RWKV should be the cheapest to tune, isn't it?
