Hacker News new | past | comments | ask | show | jobs | submit login
Introducing deep research (openai.com)
364 points by mfiguiere 8 hours ago | hide | past | favorite | 275 comments





For “deep research” I’m also reading “getting the answers right”.

Most people I talk to are at the point now where getting completely incorrect answers 10% of the time — either obviously wrong from common sense, or because the answers are self contradictory — undermines a lot of trust in any kind of interaction. Other than double checking something you already know, language models aren’t large enough to actually know everything. They can only sound like they do.

What I’m looking for is therefore not just the correct answer, but the correct answer in an amount of time that’s faster than it would take me to research the answer myself, and also faster than it takes me to verify the answer given by the machine.

It’s one thing to ask a pupil to answer an exam paper to which you know the answers. It’s a whole next level to have it answer questions to which you don’t know the answers, and on whose answers you are relying to be correct.


Gemini has had this for a month or two, also named "Deep Research" https://blog.google/products/gemini/google-gemini-deep-resea...

Meta question: what's with all of the naming overlap in the AI world? Triton (Nvidia, OpenAI) and Gro{k,q} (X.ai, groq, OpenAI) all come to mind


From the creator of Triton (OpenAI)-

"PS: The name Triton was coined in mid-2019 when I released my PhD paper on the subject. I chose not to rename the project when the "TensorRT Inference Server" was rebranded as "Triton Inference Server" a year later since it's the only thing that ties my helpful PhD advisors to the project."


>Meta question

I think you have to prefix the query with "@Meta AI", hope this helps


John Stewart had something to say about this: https://youtu.be/Byg8VZdKK88?si=pX1WbtRwZCBGpwHS&t=141

Without the tracking bits: https://youtu.be/Byg8VZdKK88#t=141

I've always thought the Triton situation was intentional since the name isn't generic and because the companies are stepping on each others toes here (Nvidia's Triton simplifying owning your inference; OpenAI's Triton eroding the need for familiarity with CUDA). I couldn't figure out who publicly used the name first though.

It's a sort of unofficial trade association where they coalesce on specific redefinitions of terms to meet their sales and PR efforts. First they came for "intelligence," then "open source," then "reason," and it will continue. Any word which the PR wants but they can't achieve gets redefined -- "grok" is a perfect example, since in the original sci-fi book it meant "total understanding." The mythological Triton ruled the deeps, so the "deep learning" sales copy immediately co-opted it.

Also "accuracy" as a measure of model's performance used to mean something objective in the traditional ML world.

Now with LLMs it is what human evaluators feel about the LLM output?


Traditional ML is no stranger to measuring accuracy in terms of agreement with human evaluators.

A customer churn model or revenue forecast did have hard objective data (ground truth) to compare against - isn't it?

Not sure if people picked up on it, but this is being powered by the unreleased o3 model. Which might explain why it leaps ahead in benchmarks considerably and aligns with the claims o3 is too expensive to release publicly. Seems to be quite an impressive model and the leading out of Google, DeepSeek and Perplexity.

> Which might explain why it leaps ahead in benchmarks considerably and aligns with the claims o3 is too expensive to release publicly

It's the only tool/system (I won't call it an LLM) in their released benchmarks that has access to tools and the web. So, I'd wager the performance gains are strictly due to that.

If an LLM (o3) is too expensive to be released to the public, why would you use it in a tool that has to make hundreds of inference calls to it to answer a single question? You'd use a much cheaper model. Most likely o3-mini or o1-mini combined with o4-mini for some tasks.


It was expensive as they wanted to charge more for it but deepseek has forced their hand

They’ve only released o3-mini, which is a powerful model but not the full o3 that is being claimed as too expensive to release. That being said, DeepSeek for sure forced their hand to release o3-mini to the public.

o3 mini was previewed in December. Deepseek maybe made them release it a few weeks early but it was already on its way

I guess the question is, did DeepSeek force them to rethink pricing? It's crazy how much cheaper it (v3 and R1) is, but considering they (Deepseek) can't keep up with demand, the price is kind of moot right now. I really do hope they get the hardware to support the API again. The v3 and R1 models that are hosted by others are still cheap compared to the incumbents, but nothing can compete with DeepSeek on price and performance.

no they didn't, this was literally all announced in December with a release date for January

Rightfully so, some models are getting super efficient.

> but this is being powered by the unreleased o3 model

What makes you believe that?


they explicitly stated it in the launch

The linked article says,

> Powered by a version of the upcoming OpenAI o3 model that’s optimized for web browsing and data analysis, it leverages reasoning to search, interpret, and analyze massive amounts of text, images, and PDFs on the internet, pivoting as needed in reaction to information it encounters.

If that's what you're referring to, then it doesn't seem that "explicit" to me. For example, how do we know that it doesn't use less thinking than o3-mini? Google's version of deep research uses their "not cutting edge version" 1.5 model, after all. Are you referring to something else?


o3-mini is not really "a version of the o3 model", it is a different model (less parameters). So their language strongly suggests, imo, that Deep Research is powered by a model with the same number of parameters as o3.

Has anyone here tried it out yet?

Pro user. No access like everyone else.

OpenAI is very much in an existential crisis and their poor execution is not helping their cause. Operator or “deep research” should be able to assume the role of a Pro user, run a quick test, and reliably report on whether this is working before the press release right?


Per the below, seems it's not available to many yet.

https://news.ycombinator.com/item?id=42913575


I'm sure o3 will be a generation ahead of whatever deepseek, google and meta are doing today when it launches in 10 months, super impressive stuff.

I’m not sure if you’re implying this subtly in your comment or not, as it’s early here, but it does of course need to be a generation ahead of what 10 months of their competitors moving forward have done too. Nobody is standing still

I read a fair amount of sarcasm in the parent comment ;)

Interesting, thanks for highlighting! Did not pick up on that. Re:"leading", tho:

Effectiveness in this task environment is well beyond the specific model involved, no? Plus they'd be fools (IMHO) to only use one size of model for each step in a research task -- sure, o3 might be an advantage when synthesizing a final answer or choosing between conflicting sources, but there are many, many steps required to get to that point.


I don't believe we have any indication that the big offerings (claude.ai, Gemini, operator, tasks, canvas, chatgpt) use multiple models in one call (other than for different modalities like having Gemini create an image). It seems to actually be very difficult technically and I'm curious as to why.

I wonder how much of an impact our being still so early in the productization phase of this all is. Like it takes a ton of work and training and coordination to get multiple models synced up into an offering and I think the companies are still optimizing for getting new ideas out there rather truly optimizing them.


...or its all a farce, for now.

This is terrifying. Even though they acknowledge the issues with hallucinations/errors, that is going to be completely overlooked by everyone using this, and then injecting the outputs into their own powerpoints.

Management Consulting was bad enough before the ability to mass produce these graphs and stats on a whim. At least there was some understanding behind the scenes of where the numbers came from, and sources would/could be provided.

The more powerful these tools become, the more prevelant this effect of seepage will become.


Either you care about being correct or you don't. If you don't care then it doesn't matter whether you made it up or the AI did. If you care then you'll fact check before publishing. I don't see why this changes.

When things are easy, you’re going to take the easy path even if it means quality goes down. It’s about trade offs. If you had to do it yourself, perhaps quality would have been higher because you had no other choice.

Lots of kids don’t want to do homework. That said, previously many would because there wasn’t another choice. But now they can just ask ChatGPT for the answers they’ll write that down verbatim with zero learning taking place.

Caring isn’t a binary thing or works in isolation.


"Lots of kids don’t want to do homework"

Sure, but if you're a professional you have to care about your reputation. Presenting hallucinated cases from ChatGPT didn't go very well for that lawyer: https://www.nytimes.com/2023/05/27/nyregion/avianca-airline-...


That's a lawyer in an adverserial situation. Business consultants tell their clients what they want to believe, the facts be dammed.

it sounds like ai doesn't really change that situation

But the point is it does if you count making it worse changing the situation.

what about tests?

Because maybe you want to, but you have a boss breathing down your neck and KPIs to meet and you haven't slept properly in days and just need a win, so you get the AI to put together some impressive looking graphs and stats that will look impressive in that client showcase thats due in a few hours.

Things aren't quite so black and white in reality.


I mean those same conditions already just lead the human to cutting corners and making stuff up themselves. You're describing the problem where bad incentives/conditions lead to sloppy work, that happens with or without AI

Catching errors/validating work is obviously a different process when they're coming from an AI vs a human, but I don't see how it's fundamentally that different here. If the outputs are heavily cited then that might go someway into being able to more easily catch and correct slip-ups


Making it easier and cheaper to cut corners and make stuff up will result in more cut corners and more made up stuff. That's not good.

Same problem I have with code models, honestly. We already have way too much boilerplate and bad code; machines to generate more boilerplate and bad code aren't going to help.


The technology also makes it easier and cheaper to make good things, so the direction of the outcome isn't guaranteed.

Yep, I agree with this to some extent, but I think the difference in the future is all that stress will be bypassed and people will reach for the AI from the start.

Previously there was alot of stress/pressure which might or might not have led to sloppy work (some consultants are of a high quality). With this, there will be no stress which will (always?) lead to sloppy work. Perhaps there's an argument for the high quality consultants using the tools to produce accurate and high quality work. There will obviously be a sliding scale here. Time will tell.

I'd wager the end result will be sloppy work, at scale :-)


I think a lot about how differentiating facts and quality content is like differentiating signal from noise in electronics. The signal to noise ratio on many online platforms was already quite low. Tools like this will absolutely add more noise, and arguably the nature of the tools themselves make it harder to separate the noise.

I think this is a real problem for these AI tools. If you can’t separate the signal from the noise, it doesn’t provide any real value, like an out of range FM radio station.


Not only that: by publishing noise, you’re lowering the signal/noise ratio.

It's a bit like saying "my kids are going to hit themselves anyway, so it doesn't matter if I give them foam rods or metal rods".

People are much less scrupulous using LLM output than making up stuff themselves, because then they can blame the LLM.

It's possible that you care, but the person next to you doesn't, and external pressures force you to keep up with the person who's willing to shovel AI slop. Most of us don't have a complete luxury of the moral high ground at our jobs.

It looks like the moral high just came more in demand.

> If you care then you'll fact check before publishing.

Doing a proper fact check is as much work as doing the entire research by hand, and therefore, this system is useless to anyone who cares about the result being correct.

> I don't see why this changes.

And because of the above this system should not exist.


How hard it is to produce credible-looking bullshit makes a really big difference in these scenarios.

Consultants aren't the ones doing the fact-checking, that falls to the client, who ironically tend to assume the consultants did it.


Then the hallucinated research is published in an article which is then cited by other AI research, continuing the push the false information until it’s hard to know where the lie started.

let's be real for a sec, i've done consulting and have a lot of friends who still do. three times in four, your mckinsey report isn't super well-founded in reality and involves a lot of guesstimation.

Think of it like a vaccine.

The majority of human written consultant reports are already complete rubbish. Low accuracy, low signal-to-noise, generic platitudes in a quantity-over-quality format.

LLMs are innoculating people to this kind of low information value content.

People who produce LLM quality output, are now being accused of using LLMs, and can no longer pretend to be adding value.

The result of this is going to be higher quality expectations from consultants and a shaking out of people who produce word vommit rather than accurate, insightful, contextually relevent information.


Exactly what will happen with art. The tolerance for low quality output will decrease.

This has been downvoted, but I think there’s actually a chance it might become true (until AGI comes along at least).

I think that ship has sailed many years ago since Facebook allowed false information to spread freely on their site (if not earlier).

> At least there was some understanding behind the scenes of where the numbers came from, and sources would/could be provided.

Oh Sweet summer child.


It is actually interesting for people working in academia. I would like to test it but no way I can afford $200/m right now.

Can someone test it with this prompt.

"As a research assistant with comprehensive knowledge of particle physics, please provide a detailed analysis of next-generation particle collider projects currently under consideration by the international physics community.

The analysis should encompass the major proposed projects, including the Future Circular Collider (FCC) at CERN, International Linear Collider (ILC), Compact Linear Collider (CLIC), various Muon Collider proposals, and any other significant projects as of 2024.

For each proposal, examine the planned energy ranges and collision types, estimated timeline for construction and operation, technical advantages and challenges, approximate costs, and key physics goals. Include information about current technical design reports, feasibility studies, and the level of international support and collaboration.

Present a thorough comparative analysis that addresses technical feasibility, cost-benefit considerations, scientific potential for new physics discoveries, timeline to first data collection, infrastructure requirements, and environmental impact. The projects should be compared in terms of their relative strengths, weaknesses, and potential contributions to advancing our understanding of fundamental physics.

Please format the response as a structured technical summary suitable for presentation at a topical meeting of particle physicists. Where appropriate, incorporate relevant figures and tables to facilitate clear comparisons between proposals. Base your analysis on information from peer-reviewed sources and official design reports, focusing on the most current available data and design specifications.

Consider the long-term implications of each proposal, including potential upgrade paths, flexibility for future modifications, and integration with existing research infrastructure."


I’ll do it. AFL right now.

Is this ability really a prerequisite to AGI and ASI?

Reasoning, problem solving, research validation - at the fundamental outset it is all refinement thinking.

Research is one of those areas where I remain skeptical it is that important because the only valid proof is in the execution outcome, not the compiled answer.

For instance you can research all you want about the best vacuum on the internet but until you try it out yourself you are going to be caught in between marketing, fake reviews, influencers, etc. maybe the science fields are shielded from this (by being boring) but imagine medical pharmas realizing that they can get whatever paper to say whatever by flooding the internet with their curated blog articles containing advanced medical “research findings”. At some point you cannot trust the internet at all and I imagine that might be soon.

I worry especially with the rapidly changing landscape of the amount of generated text in the internet that research will lose a lot of value due to massive amounts of information garbage.

It will be a thing we used to do when the internet was still “real”.


> For instance you can research all you want about the best vacuum on the internet but until you try it out yourself you are going to be caught in between marketing, fake reviews, influencers, etc.

So you wouldn't use this tool for those types of use cases.

But still, a valid point. I recall I once wanted to compare Hydroflask, Klean Kanteen and Thermos to see how they perform for hot/cold drinks. I was looking specifically for articles/posts where people had performed actual measurements. But those were very hard to find, with almost all Google hits being generic comparisons with no hard data. That didn't stop them from ranking ("Hydroflask is better for warm drinks!")

Would I be able to get this to ignore all of those and use only ones where actual experiments were performed. And moreover, filter out duplicates (e.g. one guy does an experiment, and several other bloggers link to his post and repeat his findings in their own posts - it's one experiment but with many search results).


> Is this ability really a prerequisite to AGI and ASI?

That depends entirely on how you choose to define "AGI".


It's a direction in a vast landscape, not a feature of itself - being better at different tasks, like search generally, and research in conjunction with reasoning, gets the model closer to AGI. An AGI will be able to do these tasks - so the point of the research is to have more Venn diagrams of capabilities like these to help narrow down the view on things that might actually be fundamental mechanisms involved in AGI.

Moravec detailed the idea of a landscape of human capabilities slowly being submerged by AI capabilities, and the point at which AI can do anything a human can, in practice or in principle, we'll know for certain we've reached truly general AI. This idea includes things like feeling pain and pleasure, planning, complex social, oral, and ethical dynamics, and anything else you can possibly think of as relevant to human intelligence. Deep Research is just another island being slowly submerged by the relentless and relentlessly accelerating flood.


> hings like feeling pain and pleasure

can machine feel? without that there is no AGI according to definition above.

and the second question: are animals "GI"? they don't have language and don't solve math problems, never heard of np-complete.


Are we not machines anyway ? Ofc a machine can feel, just need to have priorities that are aligned to itself, and use strong feedback when that self is either in danger or on the right path to preservation...

Feelings are nothing very special you know...


If I understood the graphs correctly, it only achieves 20% pass rate on their internal tests. So I have to wait 30min and pay a lot of money just to sift through walls of most likely incorrect text? Unless the possibility of hallucinations is negligible, this is just way too much content to review at once. The process probably needs to be a lot more iterative.

Here's an example of the type of question it is acheiving 20% on;

The set of natural transformations between two functors F,G ⁣:C→DF,G:C→D can be expressed as the end Nat(F,G)≅∫AHomD(F(A),G(A)). Nat(F,G)≅∫A HomD (F(A),G(A)).

Define set of natural cotransformations from FF to GG to be the coend CoNat(F,G)≅∫AHomD(F(A),G(A)). CoNat(F,G)≅∫AHomD (F(A),G(A)).

Let: - F=B∙(Σ4)∗/F=B∙ (Σ4 )∗/ be the under ∞∞-category of the nerve of the delooping of the symmetric group Σ4Σ4 on 4 letters under the unique 00-simplex ∗∗ of B∙Σ4B∙ Σ4 . - G=B∙(Σ7)∗/G=B∙ (Σ7 )∗/ be the under ∞∞-category nerve of the delooping of the symmetric group Σ7Σ7 on 7 letters under the unique 00-simplex ∗∗ of B∙Σ7B∙ Σ7 .

How many natural cotransformations are there between FF and GG?


As someone who doesn't understand anything beyond the word 'set' in that question, can anyone give an indication of how hard of a problem that actually is (within that domain)?

Also I'm curious as to what percentage of the questions in this benchmark are of this type / difficulty, vs the seemingly much easier example of "In Greek mythology, who was Jason's maternal great-grandfather?".

I'd imagine the latter is much easier for an LLM, and almost trivial for any LLM with access to external sources (such as deep research).


That's easy Dave: 42.

btw isn't this question at least really badly worded (and maybe incorrect?) the definitions they give for F and G are categories not functors... (and both categories are in fact one object with contractible space of morphisms...)

It's very interesting to think about what kind of "mental model" might it have, if it's capable of "understanding" all this (to me) gibberish, but is then unable to actually work the problem.

26.6% on humanity's last exam is actually impressive.

pass rate really only matters in context of the difficulty of the tasks


Only if you are asking questions at the level of a cutting edge benchmark

This is one of the actual questions:

> In Greek mythology, who was Jason's maternal great-grandfather?

https://www.google.com/search?q=In+Greek+mythology%2C+who+wa...


Did you intentionally flip through all the questions to find the one that seemed the easiest? If so, why? That's question #7, and all other 7 questions in the sample set seem ridiculously difficult to me.

In Greek mythology, Jason's maternal great-grandfather was Einstein.

No it is not an actual question on this exam. From the paper: “To ensure question quality and integrity, we enforce strict submission criteria. Questions should be precise, unambiguous, solvable, and non-searchable, ensuring models cannot rely on memorization or simple retrieval methods. All submissions must be original work or non-trivial syntheses of published information, though contributions from unpublished research are acceptable. Questions typically require graduate-level expertise or test knowledge of highly specific topics (e.g., precise historical details, trivia, local customs) and have specific, unambiguous answers…”. (Emphasis mine)

It's example #7 on https://lastexam.ai/

This is a hard question for language models since it targets one of their known weaknesses.

Greek mythology? But seriously please elaborate for my less educated self.

it tests syllogistic reasoning: Jason's mother was Tyro, whose father was Poesidon, whose father was Kronos. it also tests whether it "eagerly" rather than comprehensively considers something: a maternal great-grandfather could be the father of either one's maternal grandmother or maternal grandfather. so the answer could also be king Aeolus of the Etruscans.

ideally a model would be able to answer this accurately and completely.


I think there are more possible answers? Jason's mother differs depending on the author...

For example, Jason's mother was Philonis, daughter of Mestra, daughter of Daedalion, son of Hesporos. So Jason's maternal great-grandfather was Hesporos.


LLMs often don't do well on tasks that require composition into smaller subtasks. In this case there is a chain of relations that depend on the previous result.

Users don’t care about how hard something is for LLMs if they receive incorrect output.

It's categorically more than a weakness.

Maybe. Not enough data to say. Say it does a days worth of work in a query. It is sensible to use if it takes less than a day to review ~5 days worth of work. I don't know if we're near that threshold yet but conceptually this would work well for actual research where the amount of preparation is large compared to the amount of output written.

And eyeballing the benchmarks, it'll probably reach a >50% rate per query by the end of the year. Seems to double every model or two.


On questions even specialists in that field can’t answer correctly.

I mean you want it to grill your steak and eat it for you too?

I mean I too can complain that my iPhone doesn’t automatically screen out spammers and send my mom flowers on Mother’s Day.


Why doesn't the iPhone screen spammers yet? Pixel has had this feature for a decade.

Pixel hasn’t even been around for a decade.

Setting aside how well it works, I think this is a pretty nice demonstration of how to do UX for an agentic RAG app. I like that the intermediate steps have been pushed out to a sidebar, with updates that both provide some transparency about the process and make the high latency more palatable.

There are some people in the blogosphere who are known experts in their niche or even niche-famous because they write popular useful stuff. And there are a ton more people who write useful stuff because they want that 'exposure.' At least, they do in the very broadest sense of writing it for another human to read it. I wonder if these people will keep writing when their readership is all bots. Dead internet here we come.

I'm all for writing just for the bots, if I can figure it out. A lot of academic papers aren't really read anyways, just briefly glanced at so they can be cited together, large publications like journal pubs or dissertations even less so. But the ability to add to a world of knowledge that is very easy to access by people who want to use it...that is very appealing to me as an author. No more trudging through a bunch of papers with titles that might be relevant to what I want to know about...and no more trudging through my papers, I'm OK with that.

Of course they will. Loads of people go around taking hundreds of photos with the biggest camera they can afford even though no-one else will ever willingly look at them.

Feels like only a matter of time before these crawlers are blocked from large swathes of the internet. I understand that they’re already prohibited from Reddit and YouTube. If that spreads, this approach might be in trouble.

While people might attempt that, it's going to be an arms race, just like ads vs adblocks. There's already multiple crawlers that present fake user-agent when their original one is blocked. Temptation of more data is just to irresistible to them

I doubt those crawler rules will be honoured for long.

I wouldn’t even be surprised if a law is passed requiring sites to provide equal access to humans whether accessed directly or via these models.

It’s too important an innovation to stall, especially considering the US’s competitors (China) won’t respect robots.txt either.


This is trivially bypassed by OpenAI asking the user to take control of their computer (or a sandboxed browser within it,) then for all intents and purposes it’s the user themselves accessing your site (with some productivity/accessibility aid from OAI.)

Anyone selling anything would want to remain crawlable if people use this to research something that could lead to a purchase.

Not necessarily. Southwest airlines doesnt allow itself on price comparison sites or Google Flights.

Amazon listings are blocked from google shopping and other price comparison sites.



Your point is completely valid, but... Southwest now has an arrangement with Google Flights to allow their listings there.

I suppose there is an equilibrium, where sites that penalize these types of crawlers will also get less traffic from people reading ai citations, so for many sites the upsides of allowing it will be greater than the downsides.

TBF OpenAI in particular bought access to Reddit. Otherwise yeah this is my main confusion with all of these products, Perplexity being the biggest -- how do you get around the status-quo of refusing access to bots? Just to start off with, there is no Google Search API, and they work hard to make sure headless browsers can't access the normal service.

They do say "Currently, deep research can access the open web...", so maybe "open" there implies something significant. Like, "websites that have agreements with OpenAI and/or do not enforce norobot policies".


Client-side browsers that crawl for users (and prompt for logins or captcha as needed) won't be as easily blockable

Big Tech Podcast listener?

Does anyone actually have access to this? It says available for pro users on the website today - I have pro via my employer but see no "deep research" option in the message composer.

I have pro, in US, not seeing yet

what about a full refresh of the page or perhaps jump into the dev tools and check "disable cache"

could also be aggressive caching from cloudflare. could be they're just trying to announce more stuff to maintain cachet and can't yet support all users forking over 200/month.


I relogged, disabled cache and reloaded the page with Ctrl+Shift+R but it doesn't show up.

same here. pro in the US and still no access. i even logged in using my phone and a different browser

Pro user. No access like everyone else.

OpenAI is very much in an existential crisis and their poor execution is not helping their cause. Operator or “deep research” should be able to assume the role of a Pro user, run a quick test, and reliably report on whether this is working before the press release right?


How many times are you going to post this exact same comment here? Are you a Chinese bot or something?

Two different people I know with pro subscriptions report not having access yet.

Have pro, can’t see it yet

same here

also US based, have pro and still no access.

same same

I think deep research as a service could be a really strong use case for enterprises, as long as they have access to non-public data. I assume that most of this guarded data is high quality, and seeing progress in these areas might end up being even more impressive than it is now.

The flow reminds me a bit of undermind.ai.

The descriptions of the product sounded substantially more impressive than the actual samples tbh.

Still I think there is a big market for this sort of „go away for 30 mins and figure this out“ style agent


This is 5-10 years out. What OpenAI is displaying here I've been able to do with relatively little code, a bit of scraping and far less capable models for a year. I really don't see what is novel or useful here.

"Deep research" is now somehow synonymous to searching online for stats and pulling stuff from Statista? And when I want to make changes to that report, do I have to tweak my prompt and get an entirely different document?

Not sure if I'm too tired and can't see it but the lack of images/examples of the resulting report in this announcement doesn't inspire a lot of confidence just yet.


I had no idea there was a market for "Compile a research report on how the retail industry has changed in the last 3 years. Use bullets and tables where necessary for clarity." I imagine reading such a result is pure torture.

Can anyone confirm if this is available in Canada and other countries? This site says "We are still working on bringing access to users in the United Kingdom, Switzerland, and the European Economic Area." But I'm not sure about other countries. I don't have Pro currently, only Plus.

I don't even see it in the US right now.

Can it compile and run (non-Python) code as part of its tool use? Compile-run steps always seemed like they would be a huge value add during reasoning loops - it feels very silly to get output from ChatGPT, try to run it in terminal, get an error and paste the error to have ChatGPT immediately fix it. Surely it should be able to run code during the reasoning loop itself?

It sounds like it can run Python, which means it has access to Code Interpreter, which means it can run various other languages as well if you can convince it to do so.

I've used Code Interpreter to compile and run C code - https://simonwillison.net/2024/Mar/23/building-c-extensions-... - and I've managed to get it to run JavaScript (by uploading a Deno binary) and even Lua and PHP in the past as well: https://til.simonwillison.net/llms/code-interpreter-expansio...


OpenAI has a deep bench. I bet they pushed this out to change the narrative about deepseek

Also named specifically to muddle the SEO for the term "deep." Nothing that OpenAI does is unintentional.

It's more likely this is a response to Gemini Deep Research released in December

https://blog.google/products/gemini/google-gemini-deep-resea...


That Google product isnt that good, it can't really replace research done by a person.

Just one tool in the toolbox. It helps to see if some sources have been missed.

It absolutely can replace the research done by one person, for my use case at least. It’s also available on their $20/month subscription, unlike OpenAI’s $200/month.

Nobody was going to hire a researcher for a quick question.

Two birds with one stone: timing for Deepseek and feature for Gemini

Google publicly announced a model named "Deep Research" on December 11th: https://blog.google/products/gemini/google-gemini-deep-resea...

Does the naming scheme they've used for models so far suggest that they care about SEO?

Oh God, this is such an astute observation. I think it worked so well on me that I didn't even think about the "deep" portion initially. Goes to show how effective these things are psychologically.

I have never believed a conspiracy theory more instantly. Deep Search vs. DeepSeek is way more than enough to confuse the average layman! Especially when you're googling something you heard about at work a few hours ago, or on Bloomberg TV

You might as well say that DeepSeek wanted to cause confusion with DeepMind. Deep isn't such a distinguishing name, deep learning has been a buzzword since 2012.

Deepmind is not a consumer product. Gemini is part of it but nobody calls it deepmind.

The point is, "deep" is an extremely generic word in the AI space.

I remember about 10-15 years ago that Ray Kurzweil (who still works at Google) or someone at Google had this idea for what Google should be able to do: About doing deep research by itself with a simple search query. I can't find the source. Obviously it didn't pan out without transformers.

I’m a researcher and honestly not worried. 1. Developing the right question has always been the largest barrier to great research. Not sure OpenAI can develop the right question without the Human experience. The second biggest part of my role is influencing people that my questions are the right questions. Which is made easier when you have a thorough understanding of the first. That being said, I’m sure there will be many people here that will tell me that algorithms already influence people, and ai can think through much of any issues there are.

I do use these systems from time to time, but it just never renders any specific information that would make it great research.


100% agree.

These systems serve best at augmenting information discovery. When I'm tackling a new area or looking for the right terminology, these models provide a quick shortcut because they have good probabilistic "understanding" of my naive, jargon-free description. This allows me to pull in all of the jargon for the area of research I'm interested in, and move on to actually useful resources, whether that be journal articles, textbooks, or - rarely - online posts/blogs/videos.

the current "meta" is probably something like Elicit + notebookLM + Claude for accelerating understanding of complex topics and extracting useful parts. But, again, each step requires that I am closely involved, from selecting the "correct" papers, to carefully aggregating and grooming the information pulled in from notebookLM, to judging the the usefulness of Claude's attempts to extract what I have asked for


> Developing the right question has always been the largest barrier to great research.

I thought funding was the biggest barrier to great research


Feels more and more like openAI doesn't have "that next big thing".

To be clear I'm constantly impressed with what they have and what I get as a customer, but the delivery since 4 hasn't exactly been in line with Altman's Musk-tier vapoware promises...


> In Nature journal's Scientific Reports conference proceedings from 2012, in the article that did not mention plasmons or plasmonics, what nano-compound is studied?

Aren't there more than one articles that did not mention plasmons or plasmonics in Scientific Reports in 2012?

Also, did they pay for access to all journal contents? that would be useful


Maybe that is the only one with open access

Overall impressive.

Though, the jump for Gaia relative to SOTA is relatively not that high. Especially given that this is o3


The accuracy of this tool does not matter. This is exclusively designed for box ticking "reports" that nobody reads and a produced for the sake of itself.

The new term for this is "AI Loopidity", highlighting the unintelligent ouroboros nature of one side using AI to generate content and then another side to consume content.

Similar to “Bullshit jobs”

All the AI commercials are designed to appeal to people that don’t produce any actual value but haven’t been detected by the system yet.

Need to send email to boss? Press magic button! Job well done, idiot.

Someone send you big scary email? Press magic button! Good job dummy!

Someone wants to go eat some Italian with you, push magic button for totally not-ad result. Enjoy your Olive Garden, moron.


i think the apple ads are the poster child here. hopefully we can see more inventive ones than just serving lazy people.

99% of corpo upper management slide deck work. ai only makes more of this useless pencil-neck board of directors slop.

“Pencil-neck” is a strange insult to use here. How are software developers, or hardware design engineers, or finance workers any less “pencil-neck” than “board of directors”?

McKinsey mode

don't be hyperbolic. deep research would need to help cause an opioid crisis for to get to that level.

More like high school intern mode.

Heh

I think this looks cool. Apparently unlike everyone else on this website?

HN is full of people who want to feel smart by complaining.

If it has access to play by play data for all sports this could be an absolute playground for amateur sports statisticians. The possibilities…

Each release from openAI gives me less hope for them and this whole AI boom. They should be leading the charge of highlighting how the current generation of LLMs fail, not churning out half-baked overhyped products.

Yes, they can do some cool tricks, and tool calling is fun. No one should trust the output of these models, though. The hallucinations are bad, and my experience with the "reasoning" models is that as soon as they fuck up (they always do) they go off the rails worse than the base LLMs.


isn't this just perplexity?

Actually sounds pretty cool, but the graph on expert level tasks is confusing my expectations. Saying it has a pass rate of less than 20% sounds a lot like saying this thing is wrong most of the time.

Granted, these strike me as difficult tasks and I’d likely ask it to do far simpler things, but I’m not really sure what to expect from looking at these graphs.

Ah, but the fact that it bothers to cite its sources is a huge plus. Between that and its search abilities it sounds valuable to me


I think that's mostly because of the access to information it has. Much of the highly useful information is not on the public internet or shows up on search engines, only domain experts know about them. Also, the websites may be paywalled or gated by login. So a better comparison would be if the models had the same level of access as an expert.

The demo on global e-commerce trends seems less useful than a Google search, where the AI answer will at least give you links to the claimed information.

"will find, analyze, and synthesize hundreds of online sources"

Synthesize? Seems like the wrong word -- I think they would want to say something like, "analyze, and synthesize useful outputs from hundreds of online sources"..


From New Oxford dictionary:

  > combine (a number of things) into a coherent whole: pupils should synthesize the data they have gathered | Darwinian theory has been synthesized with modern genetics.

On the other hand, accurate if it is prone for hallucination…

You can synthesize the parts to get the whole. Both uses are correct AFAIK

"synthesize large amounts of online information" does it heavily depend on the search engine performance and relevance of the search results? I don't see any mention of Google or Bing. Is this using their internal search engine then?

Surprised more comments aren't mentioning deepseek has this feature (for free) already. Assuming this is why OpenAI scrambled to release it.

The examples they have on the page work well on chat.deepseek.com with r1 and search options both enabled.

Do I blindly trust the accuracy of either though? Absolutely not. I'm pretty concerned about these models falling into gaming SEO and finding inaccurate facts and presenting them as fact. (How easy is it to fool / prompt inject these models?)

But has utility if held right.


Not really accurate. The "Search" functionality you're describing in DeepSeek is comparable to OpenAI's existing "Search GPT." OpenAI's recent announcement refers to a more advanced capability, similar to Gemini's existing "deep research" feature. DeepSeek's current offerings are significantly more limited in scope.

Doesn't seem like access is available to try "deep research" yet on OpenAI, so I can only speak to what I tried, which was their examples on the blog post (using DeepSeek w/ R1 + Search) and results were pretty similar.

AFAIK OpenAI's current offering uses 4o, and it does a web search and then pipes it into 4o. I'm guessing adding CoT + other R1/o3 like stuff is one of the key effective differences. But time will tell how different it is. Maybe it's a dramatic improvement.


SearchGPT is bad because its underlying model is not a reasoning one. Deepseek one mentioned above is closer to deep research than searchgpt.

Are you unaware that there is a "Deepthink (R1)" button right next to the "Search" button on DeepSeek's Chat app. Its been there for some time, even before all the hype regarding R1.

I'm well aware of that. That is not what openai calls "deep research".

I wish Kagi would work with similar performance. Their lenses feature is perfect for this and they already filter out most of the SEO spam based on trackers and other typical red flags.

To anyone who's tried it: how does it handle captchas? I can't imagine that OpenAI's IP addresses are anyone's favorites for unfettered access to web properties these days.

And is it smart enough to use archive.today for paywalled articles. ;)

Curious about the use cases here. Building AI Agents? But which one?

From the demo: “Use bullets and tables where necessary for clarity.” It’s weird that it would be necessary to specify that. I suppose they want to showcase that you can influence the output style, but it’s strange that you’d have to explicitly specify the use of something that is “necessary for clarity”. It comes across as either a flaw in the default execution, or as a merely performative incantation.

Is there a benchmark we can compare this against You.com's research mode? It looks like R1 forced them to release o3 prematurely and give it Internet access. And they didn't want to say they released o3 so they called it 'Deep Research'.

Still not seeing access on my account.

they're not giving it to us lowly $20/month users yet :( gotta take out a second mortgage and throw them 200/month if you want it now

I think we're all reaching AI fatigue. Fewer and fewer people care anymore

Sure if you're viewing this as some kind of spectator thing, or entertainment, maybe it's less interesting. But it doesn't really matter whether "people care". What matters is whether it's useful and has impact. It's enough if the small number of people use it for whom it is useful. It doesn't matter if the average Joe on the street is excited by it.

Few people care or even know about various advances in various specialized fields. It's enough if AI simply seeps into various applications in boring and non-flashy ways for it to have significant effects that will affect a wider range of people, whether they get hyped by the news announcements or not. Jobs etc.

An analogy: the Internet as such is not very exciting nowadays, certainly not in the way it was exciting in the 90s with all the news segments about surfing the information superhighway or whatever. There was a lot of buzz around the web, but then it got normalized. It didn't disappear, it just got taken for granted. No average person got excited around HTML5 or IPv6. It just chugs along in the background. AI will similarly simply build into the fabric of how things get done. Sometimes visibly to the average person, sometimes just behind the scenes.


Not sure if it's just me, but it looks like all SOTA companies are doubling down to chase the new benchmark, which beyond hype, doesn't seem to translate into real world uses. Why don't these companies just plug it into a popular git repo and say, hey our AI fixed these 100 issues! Or something real? The only people who seem to be doing something real is DeepMind.

Incorrect. We are not all reaching AI fatigue.

Especially this is not a breakthrough justifying a 340B USD valuation, but rather the work that junior developers can do; implement a loop of Bing Searches connected to an LLM.

Peak HN comment

Doesn't make it untrue.

Agents that can search the internet exist for a while now and have been essentially solved and happily used in platforms like Perplexity.

It's really "meh", very far from revolutionary.

Keep in mind this company is trying to convince everybody they need 500B USD now (through the Stargate project).


I haven’t tried the OpenAI version yet, as I’m on their peasant-level $20 plan, but the Google equivalent is way superior to Perplexity (I use both extensively). The web search Perplexity carries out is superficial compared to the Google product; it misses a large percentage of what Gemini Deep Research finds, and for a particular task in my business this makes a huge difference.

To go from partially automated to fully automated is thousands of non trivial edge cases and unforeseen decision points that must be tamed.

To say this is trivial is like saying the one shot ai prompted twitter clone is the same thing as twitter.

Peak HN indeed.


Let us know when your Bing-bot scores over 20% on the HLE benchmark.

This smells like when Google released Gemini to have a product in the space.

I agree that OpenAI is trying to stay relevant by announcing a lot of have baked products with little to no availability.

> when Google released Gemini to have a product in the space.

Bard preceded Gemini.


Eh, not really. Google failed to launch first out of internal political dysfunction and then made a crash effort to launch something to counter the first ChatGPT release.

I highly doubt that the concerns of internal political commissars were holding up this particular openai release.


I don't know. OpenAI is so bad in naming... the average person on the street will confuse Deepseek with Deep Research. Also not to forget o1, o3 ... 4o

> the average person on the street will confuse Deepseek with Deep Research.

That’s probably a feature not a bug (from OpenAI’s perspective…).


You're not wrong but it feels like bikeshedding at this point.

Yes.

"Deep research was trained using end-to-end reinforcement learning"

Does this mean they skipped supervised fine tuning like DeepSeek did with R1?


No, it just suggests that RL was used over a base SFT model, and moreover that RL here was tuned to this research task. Personally I don't think that RL is strictly necessary for this task at all, but perhaps it helps.

I'm not sure if this is worth a subscription. DSPy and DeepseekR1 can already move this direction, if I understand right.

What is the current state of DSPy optimizers? When I originally checked it out it appeared to just be optimizing the set of examples used for n-shot prompting.

You understand wrong.

Can't even get Sunday nights off trying to keep up fml.

Is this "deep research" tool exploiting open knowledge creators, using their work without compensation?

How is using public information "exploitation"? A human researcher with Google would do the same.

So its fine for OpenAI to effectively sell your CC BY-NC content to others?

Are you exploiting open knowledge creators, using their work without compensation?

The creators are aware that a human is using this, can we say the same for AI, does it have their consent?

Then consent is granted by transitive property because these AI are yielded by humans.

Yea but guy paying closedai to get "insights" that basically copy-pasted content from my blog is definitely violating my blogs copyright, and in the end no coin comes to me either. What about that?

Could you provide an example where OpenAI outputting verbatim quotes actually constitutes the copyright violation? Because mechanically retrieving relevant quotes seems analogous to grep/search - the copyright status would depend on how downstream users transform and use that content. Like how quoting your blog in a technical analysis or critique is fair use, but wholesale republishing isn't. This suggests the violation occurs at usage time, not retrieval time.

You exploited my eyes by making me read this comment. Wheres my compensation.

I see many are offended, but I am genuinely asking a question.

I want to understand does this mean it's ethical for anyone to create a research AI tool that will go through arXiv and related GitHub repo and use it to solve problems, implement ideas like cursor.


It is also an agent, so it is using you without compensation for your work.

Of course. It's a child's play for SamA et al.

would it be open knowledge if it required payment to access ?

So much cynicism and hate in these comments, especially as we are likely witnessing AGI come to life. Its still early, but it might be coming. Where is the excitement? This is an interesting time to be alive.

HN has a huge cultural problem that makes this website almost irrelevant. All the interesting takes have moved to X/twitter


AGI aside, sometimes HN critics/cynicism indeed points out the exact reason why something wouldn't work and is vindicated after the fact, e.g. Apple Vision Pro. I guess it's just hard to predict the future and for me, it's interesting to listen to even pure contrarians.

We're looking at trends that may well obliterate the economic value of a well trained human mind sitting behind a keyboard all day. That is a bit of a threat to most people on HN if the trending continues at the current rate and direction.

“May you live in interesting times” is usually taken as a curse. ;)

More seriously, it’s unclear why one should be excited by the prospect of AGI, especially when instrumentalized by corporations and authoritarian governments.


Never underestimate HN's capacity to be cynical about literally everything

HN is and has always been quite negative/pessimistic/cynical in general. That Dropbox comment was quite a long time ago already.

> especially as we are likely witnessing AGI come to life

Man, I've got a great deal on some oceanfront property in Wyoming for you.


> "So much cynicism and hate in these comments, especially as we are likely witnessing AGI come to life. Its still early, but it might be coming. Where is the excitement? This is an interesting time to be alive."

Maybe you can define what "AGI" really means and what the end-game and the economic implications are when 'AGI" is some-what achieved? OpenAI somehow believes that they haven't achieved "AGI" yet, which they continue to do this on purpose for obvious reasons.

The first hint I will give you is that it certainly won't be a utopia.


I would be more excited if it wasn't $200 a month to try.

I don't feel like OpenAI does a good job of getting me excited either.

Find the perfect snowboard? How can that idea get pitched and make the final cut for a $200 a month service? The NFL kicker example is also completely ridiculous.

The business and UX example seems interesting. Would love to see more.


I feel that a lot of this can already be achieved via aider (not affiliated), and any of the top models.

Do you have any benchmarks to back up your 'feelings'?

I really don't like the snarky tone of the parent comment.

Nonetheless, I don't think this is even something that can easily be benchmarked. I'd recommend you take a look at aider [1], and consider how I drew similarities between it and what's presented here.

Has ClosedAI presented any benchmarks / evaluation protocols?

[1] https://aider.chat/


Yes, they show benchmarks in the article linked here. Did you not read it?

Eating popcorn while the scaling doubters scramble to move the goalposts for the nth time.

Its number for one of the benchmark has:

**with browsing + python tools

Maybe we have different definitions of scaling?


I would consider unsupervised tool usage an achievement

But it’s not simply scaling. Who is moving the goalposts exactly?

Trying to parse this. What are you saying?

Say whatever you want about openAI, they are shipping more than any other company on the planet.

How do you even compare different companies? I'd say the massive farms ship every year more than OpenAI ever did.

What does that even mean? Treating each iterative model as a new product is not any different than Google changing its search or youtube recommendation algorithm.

Different pre-cooked prompts and filters don’t really amount to new products either, despite them being marketed as such. It’s like adobe treating each tool in photoshop as its own product.


Have you even watched the video? This is a new capability and not a trivial one.

Name one single open source model released by OpenAI since 2020

It appears that OpenAI is in panic mode after the release of DeepSeek. Before they were confident in competing against Google on any AI model they release.

Now they are scrambling against open-source after their disastrous operator demonstration and using this deep research demo as cover. Nothing that Google or Perplexity could not already do themselves.

By the end of them month, this feature is going be added by a bunch of other open-source projects and this feature won't be as interesting very quickly.


I see lots of warranted skepticism about the capabilities of this tool, but the reality is that this is an incremental step toward full automation of white collar labor. No, it will not make all analysts jobless overnight. But it may reduce hiring of said people by 5 or 10 percent. And as people get better at using the tool and the tool itself gets better, those numbers will grow. Remember that it took decades for the giant pool of typing secretaries in Mad Men to disappear, but they did disappear. Gone forever. Interestingly, anger about the diminishment of secretarial male white collar work in Germany due to the spread of the typewriter a few decades earlier was one of the drivers of the Nazi Party’s popularity (see Evans, the Rise of the Third Reich).

AI’s triumph in the white collar workplace will be gradual, not instantaneous. And it will be grimly quiet, because no one likes white collar workers the way they like blue collar workers, for some odd reason, and there’s no tradition of solidarity among white collar workers. Everyone will just look up one day and find that the local Big Corp headquarters is…empty.


Look, who's copying who now. They added _the_ button!

I’m not sure I understand what you mean by “the button”. If you’re comparing this to DeepSeek’s copying, it’s not really the same thing right? DeepSeek essentially stole intellectual property by violating OpenAI’s terms of service. As I understand it, this is a copy of Google’s Deep Research

I chuckle every time I see this. Poor OpenAI.

Meanwhile, their entire training corpus was the result of scraping the intellectual property and copyrighted materials of THE ENTIRE PUBLIC INTERNET.

Woe is them to be sure.


OpenAI’s scraping will likely be ruled as fair use.

Deepseek proved that there is no moat. Thus no path to profitability for openai, anthropic & co.

Stealing from thieves is fine by me. Sama was the one claiming that all information could be used to train LLMs, without permisdion of the copyright holders.

Now the same is being done to openai. Well, too bad.


> Stealing from thieves is fine by me. Sama was the one claiming that all information could be used to train LLMs, without permisdion of the copyright holders.

OpenAI and other LLMs scraping the internet is probably covered under fair use. DeepSeek’s violation of OpenAI’s terms is pretty clearly a violation of their terms and not legal.


>DeepSeek’s violation of OpenAI’s terms is pretty clearly a violation of their terms and not legal.

Here is a new thing you learn today, ToS are not laws, you can ignore any ToS and at worst the company might close your account.


Care to explain how something that cannot be copyrighted and was not generated by a human is “intellectual property“? Or are you just parroting a narrative?

Trade secrets are protected by the law. It doesn’t require copyright.

Didn't OpenAI steal everyone's data they could consume from the internet? Actively being sued by the NY Times and others for this...

Yes those cases will be interesting. By default a lot of copyrighted content may be legal to use for training (in the US but also many other places) under what’s called fair use. The cases you’re referring to will likely reinforce this, but it isn’t known yet. Note that it’s not just OpenAI on that side of the argument but also other (non tech) organizations that believe protecting fair use here is current law and essential.

I'm sorry but what the fuck is this product pitch?

Anyone who's done any kind of substantial document research knows that it's a NIGHTMARE of chasing loose ends & citogenesis.

Trusting an LLM to critically evaluate every source and to be deeply suspect of any unproven claim is a ridiculous thing to do. These are not hard reasoning systems, they are probabilistic language models.


> they are probabilistic language models

This is like arguing an Airbus cannot possibly fly because it is 165 tonnes of aluminum, steel and plastic.

The proof is in the fact that it flies, not what it is constructed from.


> The proof is in the fact that it flies, not what it is constructed from.

And LLMs do not.

> "But it looks like reasoning to me"

My condolences. You should go see a doctor about your inability to count the number of 'R's in a word.


"Even though that Airbus looks like it's flying it's really not because my personal definition of 'flying' requires feathers and flapping wings."

OK, what's your next move, now that letter-counting has been solved by the current generation of frontier models?

CoT reasoning is reasoning, whether you like it or not. If you don't understand that, it means the models are already smarter than you.


this is so precise. I guess we’ll need a global version of https://datacolada.org/ quite soon to not get hit by a bus in every scientific field

o1 and o3 are definitely not your run of the mill LLM. I've had o1 correct my logic, and it had correct math to back up why I was wrong. I'm very skeptical, but I do think at some point AI is going to be able to do this sort of thing.

Why is HN not creating policy against moral prigotry? There is no useful discussion here anymore.

Seriously begging the mods to take a closer look, or at least PG to not abandon his curated internet space.


priggery or bigotry? And what are you referring to?

Pro user. No access like everyone else.

OpenAI is very much in an existential crisis and their poor execution is not helping their cause. Operator or “deep research” should be able to assume the role of a Pro user, run a quick test, and reliably report on whether this is working before the press release right?


That's the third time in this thread you've stated "OpenAI is in an existential crisis". It looks very suspicious.

man you work for high flyer or something? i know that's not really a fair question but oai still seems to lead the pack. i know it's a hype-y area but responding to one (1) model that's comparable to o4 but cheaper with "guys it's so over for openai" is excessive.



Consider applying for YC's Spring batch! Applications are open till Feb 11.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: