I strongly suspect this effect is correlated with a weakness in short-term or working memory. Independent of general intelligence is the necessity for those with a weak short-term or working memory to compensate by relying on long-term, in depth understanding in order to JIT the necessary short-term structures into being on the spot, (often repeatedly as these images decay rapidly) in order to solve a problem. Whereas those with a short-term memory advantage can simply rely on memorized sets of arbitrary relationships to address the problem.
In other words if you have a weak short-term or working memory you have to, by necessity, deeply think through everything - whether simple or complex. This may allow spotting the rare inconsistency or opportunity others may not, but as it comes at a performance and time penalty which, under circumstances commonly encountered in one's educational career (timed examinations) it more typically results in filtering such people out of fields where excursive, highly lateral modes of thinking would be beneficial.
To survive this filter one must either acquire (or be gifted with) the talent of exceptionally swift traversal of a large and heterogeneous general knowledge graph, as one cannot rely on a handful of tightly knit but relatively isolated silos of memorized specialization.
I've always felt like I have awful short term memory. I use tiling WMs so I can see information side-by-side. If I need to type something exactly, I forget the exact details almost immediately.
I need to derive things to understand them, ie music theory. I'm jealous of people who can memorize and take at face value but if I'm looking at a chord, I need to know the components that create that chord, which gets frustrating because music has a lot of rules that seem to be based on vibe and closeness. Two things can be identical but distinct based on their context.
It used to take me 2-3x as long to do homeworks or labs compared to other classmates. Same with work assignments. It often triggers an imposter syndrome type feeling.
Yet I have proof that I'm capable of solving complex problems, I understand certain things almost immediately compared to others, other things I need to study for a long time.
I tend to rarely know an answer on the spot, but I know how to determine many things, by knowing how to find the information needed.
I don't pretend to be a genius, but I have proof via a degree, others opinions of me, and material results that basically say I'm intelligent to a point.
Once I get into a flow I can retain a fairly complex system in my head but before or after that state, it's a terrible blur where I can barely focus my eyes.
Learn to get into flow, and also figure out how to get your state back faster... Once you do, it is a super power.
Simple things like leaving your editor/IDE open, create the same situation you left. I personally use music + IEMs to help me block sound and focus. -30-35 DB off the IEMs, and +70DB off my music... yeah, I don't hear anything.
I learned the editor trick recently, though I'd probably done it un-intentionally for years. I stopped, and I was wondering what the inertia I was facing was. It is only 2-3m to get setup... that's 2-3m to lose my thoughts, etc.
The reason I love vim and i3/kitty so much as a combination is exactly this. I have 4 monitors in the exact state I left them when I get back, with the last TODO comments I added and what the problem was (that I thought about deeply overnight).
For me the best way to get into the flow is by directly getting back to where I left. If I take time to wake up, make breakfast or anything else I usually lost my ideas already and it takes me hours to get back to them.
I use emacs for everything I write for the same reason. Code, email, notes, plans, etc. I do all in emacs. The consistency in editing text helps me focus on what I am writing.
The only other software I usually have running on my work computer is a web browser.
This is underrated. And, specifically...writing it down, with a pen or pencil. Typing it doesn't seem to have the same effect, even with some ritual of typing it into a fresh/separate document.
I'll second this. And something I've discovered is that using a good pen makes so much difference in the experience of writing.
I used to use whatever cheap ballpoint was around, and I had terrible handwriting. But on a friend's recommendation I tried a fine point gel pen, the Uniball Signo DX 0.38mm. It's such a joy to write with and my handwriting is orders of magnitude more legible.
I've always told friends that I have a massive knowledge graph on disk, and very low RAM. Reaching every leaf takes traversing the hierarchy, but it allows me to make connections and remember better over the long term.
People are always blown away by my ability to recall a story perfectly or create 2 page white boarded proofs, but inability to remember my SSN or why I entered a room.
Piggybacking to share very similar circumstances and results, though memory improvement while noticeable was not quite as dramatic. What was dramatic? Immediately dropped ten pounds landing me at my ideal weight. Without trying.
I'll have a week where I have alcohol in stock, finish it, and not buy it again for a few weeks. So not super regular anymore. I've had drinkier periods but I can't tell if it actually effected anything.
I have never been more seen in my life. It's very frustrating, especially when other people tend to extrapolate the little they know and apply it to everything. It can be frustrating when others are right but for the wrong reasons, and not even know it.
I struggled in math in HS for this reason. Every time a concept was presented to me I felt like I needed to deeply understand it at the most universally root level and create a painstaking mental model of it, to a degree that I imposed on myself for some inexplicable reason. To answer "but WHY". Almost like a form of self-sabotage in hindsight because I think there are decreasing returns in "truly, deeply" grokking math if you're not going to be pursuing math as a career.
But I also abhor rote memorization. Not because I don't think it's valuable, I just hate extremely repetitive tasks. Close friends of mine with zero interest in the subject just took everything at face level and preferred to rote memorize everything and slap it down as needed. And they tested much better than I did. Neither I or they are more intelligent than one another and these days we all excel at our own areas we enjoy. But for that subject in particular, in a rushed classroom standardized testing situation, I think their approach was "better".
Just a hunch, but do you find that you perform substantially better if you are an environment where you can talk to yourself out loud as you work through a math or physics problem? If so, this is very much indicative of the phenomenon I'm describing, because what's happening is you're recruiting your audio memory as a compensatory short-term workspace, being able to loop some 2 or 3 additional elements of information in this extra area essentially acts as an extension of your working store. And guess what behavior students are typically prohibited or highly discouraged from doing during an exam?
I further suspect that this is also the mechanism responsible for some people's apparent tendency to do all the talking in a conversation, rather than allow a balanced share of time between conversants. The quick decay of short-term information requires constant refreshing, and talking is one means of augmenting this.
That's really interesting! Do you know any other techniques to hijack our brains for performance boosts?
I'm reminded of the classic Feynman story about discovering the different mental models that he/his coworkers used, and how those models affected thinking: https://youtu.be/Si6NbKqYEd8?t=105
I write. It’s like having an internal monologue slowly repeating you whatever you’re thinking so it let’s the brain re-structure knowledge. It’s super helpful to force myself to pay attention. I rarely read what I wrote but because I did, there’s a higher chance I remembered.
Actually for me I perform best when I can hear my inner monologue. If I'm in a social setting learning math it's not ideal at all, because I can't "listen" to myself think: I think through things entirely in my head when I can reason through and almost dictate to myself. But not verbally! It's almost like the moment I try to verbalize anything it gets muddied by whatever weird social/colloquial construct I've made to communicate with others.
Yeah, I basically have no choice but to deeply, truly understand something. If I don't "completely get it", I will struggle endlessly to employ the "knowledge" I have. It's been a lifelong challenge (indeed I barely finished high school because I was actually failing classes because it was impossible to keep up -- yet I am a senior software engineer today), while some people forge ahead seemingly effortlessly, I am still solidifying the fundamentals. To be fair though, my deep understanding of stuff results in pretty comprehensive/effective solutions that consider edge-cases/gotchas/etc. and I think that's pretty valuable. Once I have those "fundamentals", I have mastered that shizzle and it's completely solid in my repertoire basically forever. The decay is VERY slow once I learn something, and I can remember deep details about things for years.
The discussions on this post have been the first time I've really hard people describe this phenomenon in such clarity. It's really nice to know there are other people who are similar to me in this way, as I very very often feel like the "odd one out" in this regard...
In my twenties I decided not to get a motorcycle for this very reason. I realized I would have disappeared for six months, learning every aspect of every part. And there were other things in my life that needed doing.
I had a very similar experience studying physics and I still have some form of that in my current job as software engineer working on a quite large code base:
I really can't operate on things for which I don't have a deep intuition. If I really have to treat something as a blackbox, I need to explicitly spell out the assumptions and "compress them enough" (which is actually probably also just about building an intuition on those assumptions).
I envy people a lot that can just "copy & paste" some knowledge in their thinking.
I think I now got to the point where I accepted that to be a part of me and made it "my brand" and I see that I can add value with being different in this aspect.
I often wonder how it must feel like to be able to "copy paste" knowledge. If you painstakingly have to sweat through all kinds of things that others can just "copy&paste", it can feel like others are "cheating" - but in the end it's just me being jealous.
I elaborated as a reply to a sibling comment, but repeat after me: You need to memorize things in math, especially if you want full understanding. It is a necessary tool.
I realized this when I saw one of the higher math geniuses in university, one who really understood most things better than most of us, learn equations and lemmas from flashcards one day.
That memorization may become superfluous after you worked with something for a while, but until then, it is not just tremendously useful, but downright necessary, to make an equation, or set of axioms, theorem, or whatever, just "pop up" in your head while you're thinking something through.
You say:
> I needed to deeply understand it at the most universally root level and create a painstaking mental model of it
That is my modus operandi in math. I want to fully understand it, down to every little detail. But in my experience, memorization is one step for that model to really build itself up, and actually stick.
Reading through the pages of a math book and going "oh, yeah, I totally understood that, neat" is useless if you later encounter a problem and go "huh, so, what was the exact equation of the Fourier transform again"?
And not just because you now have to look it up to apply it, but also because an equation for example is not just a jumble of symbols that you write down and fill in. It has structure, it has meaning. If you can recite it in your sleep, then you also immediately see properties of it when they are relevant, and are able to make further connections.
As Andrew Wiles said: "Math is not a spectator sport."
It's hard to fully bring across what memorization does for math, but since I started just using a flashcard app (Anki) several years ago, I literally sometimes lie in bed at night, eyes closed and no notepad, and work through math in my head, trying to further understand some aspects. And because I can "look" at what I memorized in my head, it works really well.
I agree with this, and the rationalization that I eventually worked out and learned to live with is that as you get into more advanced areas of math, much of what you are learning are building blocks for assembling more complex tools - but those are tools you have no use for yet, and therefore can't hook constituent elements into any existing framework of understanding.
There is no way to pass through these obstacles (without spending the multiple lifetimes it took to forge them from first principles) except to memorize them and gradually extend understanding backwards from that memorization into the broader context of dependencies that converge into its formalization.
But having this predicament explained to me up front, ideally somewhere around the age one learns about something as basic as fractions, would have been enormously helpful.
> except to memorize them and gradually extend understanding backwards
That is not the only reason, but also a big part of it, yes. Some of the things (but not all) that I memorize I admittedly don't fully understand. I try to avoid that, but it happens. Usually though, the sudden realization comes at a later point, when I understood more of something else.
Literally happened last week to me. I had been memorizing a "stupid" theorem for a while[1], not realizing why it's useful, until something I read was about discontinuities in the n-th derivation of a function, and what that means for the terms of the function's Taylor series, and it all lit up in me, tying it all together.
No!
Instead of rushing ahead into meaningless abstraction, you should spend more learning in the world of concrete examples and applications, to provide meat for those abstract skeletons.
We don't need a mathematician is who is a poor imitation of a computer or a reference book.
In my experience, it helps to approach from both sides, and that's also part of the point I'm trying to make. If you come only from the "concrete examples and applications" side, you might not actually fully understand, despite thinking you do, and miss some finer subtleties. Those are often the "gotchas" that get pointed out in textbooks (but even then are easily forgotten).
I am definitely a "hands on" math person. Almost every piece of math I learn has application ultimately, personally I would not really be motivated otherwise. I learn math because I want to use it. I then also find joy in the abstract beauty, but I would not uncover that beauty without something I could use it for in the first place in mind. For me specifically, a large application of the math I'm learning is signal processing (both digital and analog), and analog circuits (e.g. "EE stuff").
And in that, some of the learning of "meaningless abstractions" first, and later entangling it with actual application, definitely, positively helped in getting a good understanding of the underlying math, which I can in turn integrate with what I'm doing in the "real world".
The OP article is in part about how people whom memorize things perform worse because their memory is incorrect, while people who understand things will spend more time making sense of a problem of solution instead of more quickly guessing part-blind.
Not-memorizing forces you to practice more and develop deeper intuition which helps you reconstruct info. Memorization is a side-effect or learning, not a cause.
Our brains are connection machines, not encyclopedias.
I think that I truly, positively understand both the Fourier transforms I deal with (FS, FT, DFT, DTFT, as well as their subtle but very important differences), and the Laplace transform and the z-transform. I can recite them just by "concept", that means by knowing what they do, how they work, and why they work, I can piece together the equations in no time. Memorization is not necessary anymore.
But I got there by, at first, "blindly" memorizing FS, FT, DFT, DTFT, and Laplace and z transforms. This allowed me to not only apply them to problems while, at the time, not being fully comfortable with them yet, but also, and this is really the biggest part of the point I'm trying to make, to "look at them" while I was either solving problems or just furthering my understanding of the field when, say, lying in bed before falling asleep.
To an extent that would not have been possible if I had to "refer back" to their definitions on paper.
It was a tremendous tool (that is what memorization is, a tool) to just be able to recite, say, the DFT, or the DTFT, even while my intuition was still gradually building up. And to internally look at the differences between DFT and DTFT. The same is true for the countless other little factoids in my arsenal of flashcards. I literally built a lot of math understanding, both abstract and of actual engineering problems I was working on, when sitting in my car, on my 45 minutes commute to work or back home.
> Our brains are connection machines, not encyclopedias.
And memorization is a tool for making new connections.
I discovered the difference in these two types of students much later than I would have liked: last year of college. I like you, felt like I really needed to understand the material to do well, and I did, but there were so many students at discussion sections and office hours with much shallower understandings who would perform better on exams and assignments. These students often ask questions like, “is it always the case…” looking for a hammer they can apply to all similar problems rather than trying to understand nuances. Learning how to get an A in the course is very different than learning the course material.
I took your approach to math and it was vital to my scholastic success.
Once my engineering school load got too big for me to continue to use that approach in my math classes, I took an alternative strategy of just accepting theories without deeply understanding them and I had a much harder time applying those particular math concepts outside of those classes.
> I also abhor rote memorization. Not because I don't think it's valuable, I just hate extremely repetitive tasks.
Memorization leads to a different kind of knowledge, I think. You don't know the thing, you know the steps to reproduce.
It's like my grandmother who knows several songs by heart, but if you ask about the second line in the third verse she'll sing it from the start until she reaches the line in question. For a song this is sufficient, because it is analogous to the primary use cases.
My short term memory sucks too. I need many exposures to retain the information for a standardized test.
I wonder if intelligent people with poor short term memories are more impressed with LLMs than those with good short term memories because that was my immediate reaction and why it is basically unthinkable for me to unsubscribe from chatGPT4.
As a paired cybernetic system I gain enormously more from LLMs compared to myself with a good short term memory and paired.
I think the deep thinker/modeler's time has come. The non-deep thinker/modeler with great flash memory time has come and gone.
I dropped out of my masters in Statistics because after a point, I had questions and due to circumstances, couldn't find answers by myself and couldn't find help (this is before the days of youtube explosion).
Eventually through serendipitous circumstances, I enrolled in a computer course and realized that I no longer had this "why" problem anymore when it came to programming - I could get answers quickly AND it allowed me to express myself the way I wanted. Didn't turn back after that.
i imagine this is probably the healthier/much better approach to learning anything. unfortunately society mostly prioritizes extreme speed and shallow understanding of anything due to the upside of moving quickly and making numbers go up at the end of a quarter.
My pet theory is that this is closely related to the "two cultures" in mathematics with "problem solvers" vs "theory builders": is it easier for you to put more strain on your working memory to solve a problem, or would you rather put in more up-front conceptual effort to reduce that strain?
I'm not a mathematician, but I've seen a similar bifurcation in programming styles and preferences: something like "debuggers" vs "abstraction builders". Would you rather have less to learn up front at the expense of needing to track more details as you're working, or would you rather spend time learning or developing a conceptual foundation to reduce ongoing pressure on your working memory?
I figure this is why discussions about keeping programming "simple" are so unproductive: people end up talking past each other because one camp values reducing up-front complexity, the other reducing ongoing complexity, but everybody talks about it as if there's only one simple–complex dimension.
It's not that people disagree about which approach is more effective, it's about whether the person cares more about theory or practice (or in what balance, people are not binary). The theory hat doesn't like practice, and says "theory improves practice" as a fig leaf. The practice hat doesn't like theory, and says "practice improves theory" as a fig leaf.
Of course both are important at a global scale. But one person can focus on one side and make an contribution.
Agree with this; also, it feels like you are reading out the same theories I have somewhere in my brain and that's a weird sensation.
A related theory: being good at math, especially mental math, correlates with aphantasia (not being able to see pictures in your head). People who can see images in their head learn to do arithmetic early on with visual algorithms, which are fundamentally not good for understanding as well as rather error-prone (because the brain remembers gestalts, not finicky details like where a decimal is).
Aphantasiacs are forced to learn to do math differently, and use some different part of the brain as 'scratch space'. In my case it's the language brain: calculations which are set aside live in the same part of your brain that can repeat what was said a moment to you without understanding it. Turns out, though, that this verbal part is quite _accurate_ at remembering things, and this makes it easier to juggle multi-step calculations without paper.
> A related theory: being good at math, especially mental math, correlates with aphantasia (not being able to see pictures in your head)
This is the kind of condition I wonder if I have. Because on one hand, if I do a visualization exercise I would describe it as foggy at best. Then again, I struggle to understand how our brains could be wired that differently from person to person, that we could have or lack certain mental senses. I would suggest that everyone has some latent capability, whether they recognize it or not. After all the visual cortex is quite important.
In the context of your example, those good at mental math might see a chalkboard like image of the problem with all the detail. Those who struggle might be distracted visualizing the items that are being counted themselves, and all their detail.
For another riddle, consider the question of whether one recognizes their thoughts as an internal monologue or not, and how that relates to communication and action.
> those good at mental math might see a chalkboard like image of the problem with all the detail
Experiments with chess players and memorization shed some light on this.
DeGroot’s research showed the average person is quite poor at recalling chess positions from real games, while chess masters have almost perfect recall even after seeing the board for only a few seconds.
However, when the chess masters were given completely random arrangements of pieces on the board (as opposed to positions from real chess games), they were no better than the average person.
This and other experiments suggest it’s not a visual snapshot, but functional knowledge and chunking, such as knowing pawns typically protect one another in diagonal chains, etc.
I recall from talking with high rated chess players, they rarely visualize the board in the mind’s eye, but they just know things without thinking, like, a bishop on d3 attacks the square h7 and not h6. Not from rote memorization, but from playing and seeing that sacrificing a bishop on h7 is a thematic attacking pattern.
Incidentally, that's one of those anecdotes that sounds deep but is really perfectly obvious if you play chess at a moderate level, or, like, ask someone who does. It would be much more surprising if it didn't work that way (chunking the board into patterns).
I would emphasize that people who are good at mental math tend to not see a chalkboard, while those are less good at it tend to. Relying on visualization is, I have noticed from asking around, a weakness. Of course it's just anecdotal but the pattern seems pretty pronounced to me. (I polled a hundred people at one point and saw this pattern reflected in the responses)
I agree, though, that visualization is probably latent even in people who can't do it. I notice it when half asleep for instance.
> being good at math, especially mental math, correlates with aphantasia
as someone who used to do math competitions as a kid, everyone I knew who was "good" at mental math had a good number sense, a big bag of tricks for doing different things with numbers, and practiced with their bag of tricks.
I did math competitions also, but I'm not really talking about the specialized tricks like fast multiplication or square root algorithms. I'm just talking about basic stuff, like computing tips or taking percents. Most people simply cannot add or multiply numbers in their accurately, by any method.
We are definitely aware of the same phenomenon! Check out a reply I made elsewhere in this thread which addresses compensatory recruiting of ones verbal/ audio immediate recall as an extension of working memory store.
In my experience short term and long term memory recall speed and accuracy are strongly correlated. It's unlikely someone will be able to swiftly traverse a large long term memory graph, in a manner that would allow you to derive deep insights not just recalling a single piece of information, but have a poor short term memory.
However I do believe long term memory is more robust so if you're in a mentally compromised state, such as having a headache, it will be less affected. So if you have to work through a hard problem on a deadline but have a headache, you can rely on heuristics stored in long term memory rather than deriving everything in short term memory.
Correlated but at what level of the bell curve? I think they are correlated but vary a lot within similar bands, to the point where the broad correlation is actually not interesting and the within-band correlation is much more so.
Adding on, there's a definite weird trade off going on between memory and creativity that I think is very under-appreciated. I think memory acts as a bind on creativity, and it's really easy to make this intuitive with any number of examples whether it be youth or marijuana/psychedelics. When you reduce your ability to access memory you seem to gain an ability to explore new spaces. Likewise the more you learn and build structures in your brain around concepts, the harder it is to accept and process novelties. Feels like there's some similar trade offs going on as with this deep vs fast thinking.
That point is very early. Math finally really took off for me when I realized that, no, it's not enough to understand an equation, or a set of requirements, etc., when I'm introduced to it. I have to actually memorize it. Literally with a flashcard app that I open every day.
By rote memorization, it is available in my head immediately, and I can use it to reason through things, without having to derive anything. It helps tremendously.
Then, at some point, it will become so familiar and understood through working with it, that the rote memorization becomes superfluous. For example, I've worked with the Laplace Transforms and the various Fourier Transforms (FS, FT, DFT, DTFT) so intensely by now, that I can absolutely just recite them by concept and understanding of why they are what they are.
But until then, rote memorization is basically a necessary tool to work with math.
The moment that made me realize that was when I saw a math genius at university, one who clearly understood the topics extremely well, going through his flashcards.
About three weeks into my first undergraduate class on abstract algebra, it dawned on me that the instructor wasn't giving me math tests. He was giving me vocabulary tests. In that class, most of the answers to questions flow straight from the definitions. Once I broke out the flashcards and started memorizing definitions, that class became almost trivial.
I used flashcards in all my classes after that to memorize terms, definitions, and concepts. Math and engineering are, for me anyway, like a foreign language. To converse in that language fluently, one must be very comfortable with the vocabulary. It just makes sense.
Well put, and I like that analogy. You have to learn the vocabulary, and only then are you well equipped to discuss grammar and finer subtleties of the language. It goes hand in hand.
You have to remember things in math. You don’t have to memorize by rote. I’m very close to finishing a degree in pure and computational math and I’ve never sat down to consciously memorize anything. I don’t really study much for exams either. I just work on the assignments and then show up and do my best for the exams. My grades are pretty much average but they’re not a priority for me.
For me, memorizing math means just working on problems until the theorems and definitions are like muscle memory. I know other people get by on flash cards but I can’t stand them.
Heck, I just wrote a midterm in network flow theory today and they gave us a sheet with all the theorems and definitions in the course up to this point. Needless to say, memorizing that sheet wouldn’t help you at all on the proofs. You have to actually practice writing proofs to get good at it.
I strongly relate to your analysis, as I have often found myself overwhelmed due to a lack of working memory capacity, which has often resulted in failing a whiteboard interview, or being unable to provide a short answer to a question that I have never thought about before.
I am more comfortable with deep thinking, or reflection, which allows me to come up with more complex analysis, while this process translates quite well when I have homework challenges.
I used to test some of my mental capacity with pseudo-IQ tests and realized that the factor that would penalize me the most was lack of time.
Hmm. So, we don’t know if working and short term memory are even the same thing. We also cannot say for sure that the same type of processes would be handled by short term and long term memory, so it’s not clear that you can substitute one for the other or for the same stuff. Both memories could just be feeding working memory and other structures for processing but serve different things.
It also may well be that the opposite is true — STM is prioritized by people who haven’t learned to properly recruit for profound structures. Speed may well have been a survival advantage a million years ago, but it’s not clear that this hasn’t changed since.
We also don’t know if the computing model of the brain is even appropriate at all. Humans have always assumed that the latest state of technology can represent the brain: clay and waterworks, mechanics, computers, etc.
At the end of the day, we don’t know how much we actually know about how the brain works because we don’t know what we don’t know…
I have a childhood brain injury that affects my working memory and sequencing ability, among other things. I think in pictures with a verbal commentary, although words disappear soon after I think them. My brain stores information everywhere it can fit: in emotions, music, patterns, movement, etc. Interpreting reality is fraught with error. You describe the effect very well.
I am working on a personal knowledge system to compensate. What are your ideas on this subject?
Popular PKS systems expect the user to adapt to "the system," rather than adapting to the user's particular set of needs. I consider each user to be a unique combination of common components.
A lot of replies here talk about short term memory, needing to truly understand information on a deep level and have the "why?" question answered, using software to externalize information and a lot more that I can't really mention right now on a phone in the middle of the night browsing HN and coming across this gem.
A lot of this stuff seems highly related to ADHD. I exhibit them, and have done quite some amateur research myself on these behaviors and others seem to relate as well.
The way I’ve always thought about it is having a small working memory has forced me to approach problems algorithmically from an early age. For small to medium sized problems this puts me at a speed disadvantage, but when problems grow large enough to exhaust everyone’s working memory, the wholistic thinkers stumble while I am at home.
Everything I've read about IQ says that short-term memory correlates to long-term memory. Well, except for the fact short-term memory goes down from the age of 25 and long-term memory goes down only much later around 60.
To someone with ADHD (me) it does look like it. I seem to be one of the few people who want to discuss the correlation between ADHD and all of these traits, but unfortunately one of my replies didn't garner the attention I wanted.
Without giving too much away, this tracks with the 2023 study's results, in that people with higher intelligence scores are less likely to trust their System 1 gut reaction and more likely to involve their System 2 deliberate, logical processes.
Have you read Superforecasting? One conclusion they had was that very partisan thinkers, basically dogmatic, were the worst at predicting future events, and it didn't matter what that dogma was. Liberal or conservative or anti big business or whatever. All of the really good forecasters were relentlessly fact based and spent a huge amount of time diving deeply into facts, and microfacts that supported facts. It sounded exhausting and one of the author's takeaways was "the world is enormously complex" and that most of us don't know anything about anything (hello gelman amnesia).
> people with higher intelligence scores are less likely to trust their System 1 gut reaction and more likely to involve their System 2 deliberate, logical processes
Amusingly, I mistrust my attention and visual ~memory so much that I reasoned I would find the "easier" task just as hard unless it was literally like 1 vs 3 dots, or unless it stayed up so long that I could count (maybe harder, since I'd likely get more annoyed at myself for missing questions I believed to be easier). I ignored this option because I was fairly sure it'd just mostly waste 200 points.
I went back after completing to check out this option and don't feel like it made the task noticeably easier (to me).
Same. I tried the "easier" version early on in the challenge and it didn't help increase my confidence. I only chose it going forward when I had not even the slightest idea. It really helped once, but not the other times.
That was fun, I scored lower (2.1) dogmatism and higher on the test (840), which they claim supports their hypothesis.
In day to day life the major difference I notice in terms of speed and intelligence personally is that I'm often slow to respond to questions.
It didn't even occur to me to be self-conscious about this until eventually a friend pointed it out, but he kindly framed it as "you think before you speak" and this seems to have served me well.
I had 3.4 and similar number of points as you. The questions don't really work that well.
E.g. the healthcare one doesn't work for my country where universal healthcare is a law and thus State truly has duty to provide it and anyone who believes otherwise is objectively wrong.
I have also received more points for being "dogmatic" in that having strong opinion (that is different than mine of "neutral") on migration is a bad person.
Just because something is the current status quo in your country doesn't mean you can't have a different opinion. I think the question is perfectly valid no matter where you live.
The irony is, faulting the question because "that's just the way it is here" beautifully illustrates the exact premise of the experiment. I'd say that explains a 3.4 score (at least in this game).
It can just be a matter of separating government and society. If you do that, expecting government to follow the law isn't dogmatic at all.
It's also not necessarily dogmatic to believe that you are more informed about an issue than the average person that disagrees with you. Like sure, it can be dogmatic, but it isn't necessarily dogmatic.
I definitely got more dogmatic, but I also find it interesting because I scan visual stuff really fast, and typically notice things a while before people, ie while driving I'll spot a slick-top cop far ahead. So I have a lot of trust in my visual acuity. I got a score of 900 without trying the easy one.
The latter part of the test was 100% incriminating and I think I am quite dogmatic.
> This might be because the least dogmatic participants were more willing to view the easier version of the challenge when they were initially uncertain.
Can’t you test that hypothesis, or do you not have the data?
I also find it super annoying that one of the buttons to choose left is on the right and vice versa.
This link would better serve you and the community as a top-level post. I guess you did share it 2 years ago, though it looks like commenting is now closed. https://news.ycombinator.com/item?id=26620690
Share it again! The iron is hot!
I find the initial paragraphs of analysis rather insistent, one might say dogmatic, in their praise of non-dogmatism. Some later paragraphs express my immediate response: perhaps this dogmatism varies based on your relationship to your current information environment.
I'll suggest that consideration of these numbers might be better supported by tables to show participant and average numbers, and invite comparisons.
Neat experiment. Although, I was able to guess a higher than average number of dots correctly, I wonder if I would feel differently had I been under the average.
The explanation given at the end is interestingly to me. However, consider the following alternate: People more likely to answer honestly that they view others opinions as wrong or immoral (ie they would appear to have dogmatic thinking) are also people who consider the easy dot guesses as cheating and desire to avoid cheating. Whereas people who are more likely to want to win the dot guessing by any means are also more likely to lie about their negative views about the opinions of others.
I'm not trying to infer it. It's another possibility that would explain results besides the stated one that dogmatic thinking and not looking for more information go hand in hand.
Interestingly enough the dogmatic view is that dogmatic thinking is linked with refusing to seek more information. And here I am trying to be charitable to the "dogmatic” by suggesting that we should look for more information...
The hints felt either like a trick or like cheating to me. That's not a stretch that was just my personal feelings. I didn't even consider that the hints were a game theoretic best way to go if you aren't sure until the end where the explanation hand fed you that exact logic.
What makes you think there's any relationship between visual recognition and dogmatism?
Even your own results only show a 2.5% difference between the most dogmatic and least dogmatic participants, assuming they even answered the dogmatic portion of the test truthfully and thoughtfully. I can't see how that amounts to anything more than a statistical error.
Just in case, my score was 940/3.0, although again, I don't see anything to show there should be any relation.
So, I'm a little frustrated with this because it doesn't tell me how many times I opted for the easier version, just the average, because it seemed like a low cost to pay, I did it almost every time, (which it states is the rational thing to do) but then I also scored as very dogmatic, and got almost exactly average on the test.
The conclusions it drew about this were that I was not open to new information, which is totally off. I DID ask for new information almost every single time, far and above what the average participant requests. The important thing isn't the performance on the test but how often the person requested new information, but then this metric is completely discarded in the final assessment! I'm not sure what exactly this is meant to measure. It feels like it's just smugly calling me dumb for thinking I know better than the average person (which, if I didn't, why would I believe what I believe?)
I only believe things I already have a high degree of confidence in, and it would take good evidence to sway me from those opinions. If this is close minded, being "open minded" seems like a good way for your brain to just fall out of your head.
I scored 1,000 (perfect) on the game and 1.57 on the dogmatism score, which is both lower than the average score and lower than the average in the lowest quartile (people with low dogmatism).
I'm not quite sure what conclusion to take away from this result. While the low dogmatism score is no surprise to me the research results suggest that a low dogmatism-scoring person would be more likely to opt for the "easy version" handicap to verify their hunches but limit themselves to a maximum possible score of 800.
I don't FEEL like I have exceptional perceptual abilities for identifying dots, but I trusted my instincts and honestly rated my confidence as medium (7/10 times) and low confidence (3/10) times.
I'll also add that I'm a little tired and just finished a single beer, so I feel slightly dulled in my faculties right now. I'll probably go to sleep in an hour.
A 2% difference in scores between the most and least dogmatic users means your test complete hogwash.
Your refusal to provide any data beyond averages is very telling. My guess is that there's a very wide distribution of scores, little trend, and very little correlation.
It’s kind of a cool experiment, but I feel like I was hoping for more of a definitive payoff - I just kind of scored as expected, tactically chose the ‘easier’ version if I was less than confident, and at the end just answered along the lines of my usual “nothing is sacred but try to be nice to people” moral framework. Seeing more of a visualization of how my score ranked against others would be cool.
Fascinating. I scored 800 on the squares and a 2.0 on the dogmatism scale. Thanks for sharing this, the interactive quiz and research is really interesting.
> needed more time to solve challenging tasks but made fewer errors [1]
As someone else said, I can solve problems very quickly if the solutions don't have to be correct...
But more seriously, it seems like different people might have different thresholds for when they consider a problem solved?
If you decide to go back and review the problem and solution (even just mentally) to make sure you didn't make mistakes, of course that would take longer and give you more correct answers than the person who doesn't do that?
> The findings challenge the assumption that higher intelligence is the result of a faster brain. They suggest that faster is not necessarily better, and that under certain circumstances there is a tradeoff between speed and accuracy which results in better decisions.
Talk about conflating different aspects of something to arrive at faulty logic.
There clearly is a relationship between higher intelligence and a faster brain, to some degree. However faster thinking enables more sophisticated searching of complex problem spaces.
>There clearly is a relationship between higher intelligence and a faster brain, to some degree. However faster thinking enables more sophisticated searching of complex problem spaces.
I don't think that's clear at all. The confusion is around different definitions of speed and different definitions of the task.
You have the speed to process data points or variables, and the speed to come to a result. You also have the number of variables used to calculate a result and the number of variables needed to come to a result.
It is reasonable to believe that some brains can process the same data faster than others. It is also reasonable to believe that some brains consider more variables than others.
However, more variables is not always better. You can process faster, and include more variables, but still perform worse overall if you are using too many unecessary variables.
In terms of computing, an example would be multiplying 2x2.
A slower computer can give you a result faster if it is representing 2 as a 2-bit number than a faster computer representing it as a 64-bit number
I think of it as a computer with moderately fast registers but horribly slow main memory. In this case, more registers would clearly show a win. BUT a more organized person would eventually win as the number of variables grow.
Hence why systems and habits beat out raw intelligence on general life success, but why an intelligent person lives a simple life on easy mode and why those at the (uninherited) top are often scary smart AND hard core driven and organized.
"subjects with higher PMAT24_A_CR (fluid intelligence) made fewer mistakes, but were slower"
Yes, intelligent people took longer to solve hard problems. But they made fewer mistakes. Getting things right on the 1st try might be much faster than needing a 2nd attempt, even if the 1st try takes 20% longer.
Actually, solving problem quick and dirty, putting the solution to a test and iterating will probably result in better outcomes than simply thinking super hard and making less attempts for a whole bunch of tasks.
It sure helps to be able to iterate quickly in software development for one.
It has reminded me of an exchange from Shirobako (best anime ever, 100/100, watch it even if you prefer other forms); older animator is telling their younger colleague to learn to draw faster, because while they can work on the quality for the rest of their life, but they won't be able to draw fast when they are older. Drawing faster means more iterations, means more experience gained overall.
I'm thinking about too many things like chess. But in chess played with slower time controls, a critical skill is t recognize important positions and take time on them. And for many people, another important skill is to take more time in general.
Like, a lot of lower Elo game at 10-minute time controls end with the losing person having 8 minutes left. That's not good.
Jon Bentley notes in Programming Pearls that performance is secondary to correctness.
I thought he'd included an anecdote about a consultant tasked with solving an optimisation problem at an industrial concern who unveils his solution. A complaint is raised: yes, the method finds the correct solution, but it is slower than the old method (which didn't achieve the correct solution).
The consultant, perhaps something of a novice when it came to client relationships communications, responded that if he didn't have to find the correct answer to the problem, he could make his system much faster.
I don't find that in either PP or More Programming Pearls, however. Unfaithful memory.
It is a common aphorism in military training, related to the latency of effective fast-twitch reaction. The jerkiness of trying to point your weapon at a target as quickly as possible and then yanking on the trigger means you usually miss it.
The most important motion is bring your weapon to bear on target in a mechanically efficient way and pulling the trigger as it comes on target in a single motion. That single integrated motion can only be learned by doing it slowly but it is very accurate and smooth. If you practice the motion enough it becomes very fast. It is fine muscle memory. This is virtually always faster in terms of putting a bullet on target than relying on raw muscle speed. Also why military firearm skills are perishable, it has to be constantly practiced to keep the latency down.
> Intelligence is here defined as the performance in psychometric tests in cognitive domains like verbal comprehension, perceptual reasoning or working memory. A consistent finding is that individuals who perform well in one domain tend to perform well in the others, which led to the derivation of a general factor of intelligence called g-factor
Whelp, I guess I broke the mold on this one. I have more than 1.5 standard deviations between some of my scores lol.
I do not put much faith in IQ tests to begin with. I do not think the tests are completely useless, but I do think their utility is vastly overstated and the meaning of one's results are highly misused.
Honestly this makes the most sense to me. I guessed first before thinking it through and if I were doing the test and it were timed I might've just guessed.
> I would bet that quite a few people just guess when they find this type of question too difficult.
Psych research is such garbage. Of course people are going to start guessing if the problems are boring and they can't solve them. They tried to account for this by comparing timings of only correct answers. But on a multiple choice test, even random guessing will be correct (and fast!) sometimes.
I also wonder if they could see another part of the brain to see if intelligent people are more concerned of judgement from other intelligent people, or perhaps even from everyone in general for some intelligent people that intelligence is their identity.
Related: Thinking, Fast and Slow, by Daniel Kahneman. According to Wikipedia [1]:
"The book's main thesis is a differentiation between two modes of thought: "System 1" is fast, instinctive and emotional; "System 2" is slower, more deliberative, and more logical."
Intelligent people might rely more on System 2 than ordinary people, which pushes latency up.
A "large portion" is an exaggeration, and I don't know that any have been "refuted". Some of the studies around "priming" (Chapter 4 of the book) have been called into question for failure of being replicated, and Kahnemann himself has since said that the published studies on priming may not be replicable. Since the publication of the book we've had a "replication crisis" in the relevant literature, so the book may not be on as solid ground as Kahnemann believed when he wrote it, but it's still a very good book with important insights.
Although your response is a bit clever, I think you capture the actual dynamic, which the paper (https://www.nature.com/articles/s41467-023-38626-y) tries to obscure by avoiding the comparisons (time taken for each correctly answered question vs incorrect) needed to make it obvious.
On a multiple choice test, does it really matter if they filter to only correct answers? Guessing will still result in fast answers, and be correct 25% of the time.
Is this innately biological, or have intelligent people just been trained not to jump to conclusions/trust their gut, while this training was not as successful in other population segments?
Something tells me trying to bluntly define "more" and "less intelligent" and then compare the two groups with blanket studies like this is utterly ridiculous.
I don't claim to be intelligent, but I do dread doing group brainstorming sessions using Post-it notes because it takes me time to think about the problem.
I'm usually the the guy in the group with the fewest notes. I've rarely see anything useful come out of these sessions, even though I've participated in hundreds of these with different people, companies, and settings.
Your goal during the ideation phase of those workshops should be to output as many post its as possible in the given time. Output the bad ideas quickly and you'll move along to better ideas much faster when you're not humming and hawing over one post it. You have to be ok with looking slightly crazy however and not mind being linked to your poor ideas.
The conclusion in the title doesn't at all follow from the study in the article.
Intelligent people know they have what it takes to get the answer right, so they spend the time to do it.
Less intelligent people are familiar with their limits and their odds of getting the right answer, so they do some of the reasoning, quit, and guess from there.
That's why the intelligent people aren't just slower, but more accurate. They're actually solving the problems. The others are reaching the end of their ability much more quickly and guessing.
I always find it so strange and a little creepy to treat "intelligent" as a category like "brown haired" or "diabetic."
You take a test and receive a score (an "intelligence score" apparently) and if you are past X points you are intelligent. Now you are among the set of intelligent people in the world.
I know this is an agreed upon reality (especially among us nerdy types), but it always rubbed me the wrong way. Even bracketing off all the very real issues around measurement tools here, it always felt in general like neurotic pursuit to quantify the qualitative, or even an egoistic pursuit to claim superiority out of thin air.
And I read articles like these, and I can't help but feel slightly validated despite their presuppositions: maybe there isnt a spectrum of intelligences, but just heterogenous minds. We have come up with these tests, but they just show how well a person is at that test that we happen to call "an intelligence test." But you start digging deeply with the numbers... and of course you going to get counter intuitive results! You have investigated categories that are themselves sustained out of thinnest of scientific consensus and dubious ideological origins, delegating your measurement to fraught tools laden with cultural specificity. It just feels crazy to me, it feels like never leaving grade school.
But maybe they'll find "intelligence" one day, and then I'll have to eat my shoe while waiting in line to be recycled because I didn't pass muster as an intelligent human.
This complements the idea that problem-solving is the essence of intelligence. It's not always about speed, but the quality of decisions made, especially in complex situations
The title of the article should be "People with higher intelligence scores take longer to solve complex problems".
Let's say that I define being very intelligent as being able to rapidly solve hard problems. I think this is a reasonable definition of the word "intelligent". Indeed, I think that it is in many ways a more meaningful definition of "intelligence" than defining it as scoring well on intelligence tests.
Well, then the article title becomes self-contradictory.
Yeah, the title (and the article) doesn't say "than what". If intelligent people take longer to solve complex problems than stupid people, then stupid people are smart and smart people are stupid. But the article doesn't really explain that either.
I have a rule and you need to figure it out. The rule relates to a sequence of three numbers. You can propose a sequence and I’ll tell you yes/no if it meets the rule.
I’ll give you the first sequence to get you started:
I think people are overreading into this, assuming the results even mean much anyway. people who score higher on timed tests which corelate well with IQ, such as the Wonderlic or the SATs, are smarter.
There's a confounding factor here, which is that people who score poorly could do so either because they could not solve the problem at all, or because they took too long to solve it (due to having to create mental tooling on the spot that others could buy off the shelf through memorization) and had reached only a partial result.
In timed standardized exams where work is not shown or graded, both results are equally assigned zero points. As AI, even the ersatz AI available currently, becomes more sophisticated and widespread the value of a human who can mimic the capabilities of a machine will diminish rapidly.
Creative and explorative thinkers will, provided they are not merely skilled at the derivative "craft" of performative creativity but are truly creating value without precedent, will accordingly become increasingly sought after.
Intelligence is related to increased perception throughput abilities, i.e. neural volume and density, so more intelligent people are processing more information which takes slightly longer (probably logarithmic). It all ties back to the same sort of results in neural networks. Not sure why I got downvoted...seems studies support my conclusion.
A thirst to deeply understand the systems around one is irreplaceable. Curiosity and an openness to seeing what is there instead of loading some fast model on top of the problem.
In my experience when you're younger you can make a decision quickly without thinking through a lot of the edge cases and it works most of the time so it's much faster and just as good. Most of the time.
There are two measures of intelligence: Correctness and Speed.
Correctness is the primary measure, and if two parties are correct then speed differentiates their level of intelligence. This is the only measure that has been quantified and scientifically correlated with many other attributes of human existence like success and happiness. This measure is is called IQ.
If both people get an answer correct, then literally, by definition, the stupider person will be the person who takes longer to arrive at the correct answer. Remember: IQ tests are timed.
This study is sort of a play on the very definition of what it means to be stupid. Again, IQ tests are timed for a reason.
The real title of this is should be:
Stupid people take less time to arrive at a wrong answer then smart people take to arrive at the correct answer.
This is sort of a useless study, because yeah, I can answer the hardest questions in the entire universe with the wrong answer almost instantaneously. Of course wrong answers will be faster.
The fact that most of you aren't noticing this says something about your intelligence. Maybe you guys are just taking too long to notice this, so in that case according to this study you're all smarter than a dumb dumb like me.
It's not clear to me from Google that IQ tests are timed. Some sections of some tests are. I don't think any test is like "For question 4, you get 10 points for answering within 2 seconds, 5 points within 4 seconds, and 0 after." A time limit on the test could just be to keep you from accidentally measuring conscientiousness in people who are willing to spend 10 hours to get everything right.
That said I'm pretty sure reaction time and "clock speed" are part of intelligence, just correlated well enough that you don't need a reflex test added onto the paper test.
Parts of it are timed. I know because my brother is a trained administrator of giving these tests.
Even without the concept of an IQ test the fact that if you were given two people who both answered 50 questions correctly, one person took a full day to complete the questions while another person answered them in all in 2 minutes. Clearly our conceptual intuition of intelligence says the Faster person by literal definition of "intelligence" is more intelligent.
Like what is the experiment in this article measuring here? If it's comparing people who got the exact same test scores then the experimenter can't identify differing levels of intelligence because everyone got everything right. How can they say the faster person is stupider then the slower person if the scores are the same?
The only way to truly compare is to find people who got the answers wrong, but in this case your measuring the speed of arrival at a wrong answer which is in itself a pointless measurement.
Obviously wrong answers are faster to come up with and obviously a person with more wrong answers is going to be faster and stupider then the person with right answers.
In other words if you have a weak short-term or working memory you have to, by necessity, deeply think through everything - whether simple or complex. This may allow spotting the rare inconsistency or opportunity others may not, but as it comes at a performance and time penalty which, under circumstances commonly encountered in one's educational career (timed examinations) it more typically results in filtering such people out of fields where excursive, highly lateral modes of thinking would be beneficial.
To survive this filter one must either acquire (or be gifted with) the talent of exceptionally swift traversal of a large and heterogeneous general knowledge graph, as one cannot rely on a handful of tightly knit but relatively isolated silos of memorized specialization.