You'll never get good performance without using assembly. GMP probably walks all over this. Even my own bignum library probably walks all over it for addition and subtraction.
It's not a bignum library. It's just 64b integer fixed-point with a scale of 10^-7. So, perf-wise it's not going to have any issues, but it's also pretty easy to exceed the representable bounds.