I'll give you a good example. We recently migrated away from Plesk with Apache to a server running NGINX. I wanted to get Active Collab running on the new server, so I fed the documentation for installing Active Collab into it, which included the URL rewrite lines for the NGINX configuration.
What it presented to me on every attempt, and I tried this for days, was complete gibberish that hallucinated all kinds of things that didn't exist, and it didn't even run as an NGINX configuration.
All that time wasted versus just writing an NGINX configuration. Who is seriously going to trust this to do anything high-level if it can't even write a basic NGINX config? If you don't know the framework then your Dunning-Kruger is in full-effect, you don't even know what you don't know, and blindly trust the output because it resembles something similar to what you might expect.
I'm thoroughly unimpressed. The boilerplate tooling of twenty years ago didn't even use AI and was vastly superior.
Another example: asking it what a product is, e.g., the tfpro P38EXMK2. It calls it a microphone preamplifier instead of a compressor, despite there being no preamps in it, it also hallucinates controls that don't exist, and misses the entire point of the product.
I also asked for step-by-step instructions on exporting data from one program to another, and it invoked all kinds of menu options that don't exist, and didn't take into consideration file incompatibilities in terms of imports.
Due to the immense hype, I have spent a lot of time trying to get something rational and sensible out of it that's actually a good use of time, but alas I have found nothing. IMO, it's the next crypto. All hype and very little actual utility for serious users. It's a cool toy for people who don't know what they're doing, but I'm sure that with a little experience, they would understand the sentiment.
A: "The TFPRO P38EXMK2 is a high-end, stereo compressor and limiter designed for professional audio applications. It is manufactured by TFPRO, a British company founded by Ted Fletcher, an audio engineer with extensive experience in designing audio equipment.
The P38EXMK2 is an updated version of the original P38 compressor, offering improved audio quality and additional features. This unit is typically used in recording studios, mastering studios, and live sound applications for its ability to provide smooth and transparent dynamic control over audio signals. It can be used on a variety of sources, such as vocals, drums, guitars, and full mixes, to help achieve a polished and professional sound."
GPT-3.5 did call it a microphone. Maybe you're using GPT-3.5?
I spent quite a bit of time correcting its description of the compressor unit (probably half an hour); would those corrections be reflected in you now asking it now that it's been "trained"?
I'll give you a good example. We recently migrated away from Plesk with Apache to a server running NGINX. I wanted to get Active Collab running on the new server, so I fed the documentation for installing Active Collab into it, which included the URL rewrite lines for the NGINX configuration.
What it presented to me on every attempt, and I tried this for days, was complete gibberish that hallucinated all kinds of things that didn't exist, and it didn't even run as an NGINX configuration.
All that time wasted versus just writing an NGINX configuration. Who is seriously going to trust this to do anything high-level if it can't even write a basic NGINX config? If you don't know the framework then your Dunning-Kruger is in full-effect, you don't even know what you don't know, and blindly trust the output because it resembles something similar to what you might expect.
I'm thoroughly unimpressed. The boilerplate tooling of twenty years ago didn't even use AI and was vastly superior.
Another example: asking it what a product is, e.g., the tfpro P38EXMK2. It calls it a microphone preamplifier instead of a compressor, despite there being no preamps in it, it also hallucinates controls that don't exist, and misses the entire point of the product.
I also asked for step-by-step instructions on exporting data from one program to another, and it invoked all kinds of menu options that don't exist, and didn't take into consideration file incompatibilities in terms of imports.
Due to the immense hype, I have spent a lot of time trying to get something rational and sensible out of it that's actually a good use of time, but alas I have found nothing. IMO, it's the next crypto. All hype and very little actual utility for serious users. It's a cool toy for people who don't know what they're doing, but I'm sure that with a little experience, they would understand the sentiment.