I doubt it would be hard for Microsoft to rebuild, Microsoft Research has made many excellent contributions to transformers for many years now, DeepSpeed is a notable example.
I don’t think they’ve had the will/need to have done this but they most likely already have the talent.
Not sure if its obvious that people would leave OpenAI in troves to join Microsoft just to be with Sam.