great tool and as someone mentioned there are quite a few AI products/libraries that accomplish this.
The main challenge for production settings
1) soon becomes optimizing the latency for each step and
2) dealing with complex queries at a reasonable cost (GPT-4 is bit expensive at scale)
We evaluated multiple options and settled on GPT-3Turbo in the short term. However we are not happy with the latency, especially if you create an agentic solution.
The main challenge for production settings
1) soon becomes optimizing the latency for each step and 2) dealing with complex queries at a reasonable cost (GPT-4 is bit expensive at scale)
We evaluated multiple options and settled on GPT-3Turbo in the short term. However we are not happy with the latency, especially if you create an agentic solution.