Not OP here (but building in the same space).
The reason you instrument LLM data is usually to improve quality/speed of your applications. The tools to extract the insights to enable that, and the integration with your LLM experimentation workflow is the differentiator between a general observability solution and LLM specific one.