Hacker News new | past | comments | ask | show | jobs | submit login

Truly original content still >>> conventional mass-produced content.

Maybe one day LLMs and diffusion models will generate truly original content. But despite the hype and what some people are claiming, right now they really don't. The latest models are maybe 90% of the way there, but as GPT-4 shows, it will take more than scaling to go the remaining 10%.

When I look at AI-generated content 90% of it is the most "typical" response to the prompt, and 10% shows slight originality, but nothing truly unexpected. The most interesting pieces of AI art and writing all come from interesting, engineered prompts which are designed by a human. I don't doubt that AI will take over stock photos and generic writing, but my favorite artists and writers and presenters are still humans, the most popular songs and articles and movies are still written and directed by humans, and unless you've resorted to watching AI-generated Seinfeld and https://www.reddit.com/r/SubredditSimulator/, I'm sure you feel the same way




> but as GPT-4 shows, it will take more than scaling to go the remaining 10%.

That is happening though; many scientists are working on making gpts that can learn like Alpha Go Zero where it can learn from scratch with far less information to become better (more ‘intelligent’) quality. Didn’t see anything coming out yet; it is at least one thing that I think could be an AI winter if not achieved before, say 2027. We cannot keep scaling and thinking the results will improve, and, also, indeed we lack training data already, so something must change to need as much; it needs to learn smarter.




Join us for AI Startup School this June 16-17 in San Francisco!

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: