The CEFR is intended to measure the proficiency of foreign language learners and not measure the sophistication of native language speakers. Everyone that speaks English as a first language would pass a C2 level examination very easily.
The standard ways to measure text complexity in English for native speakers are the Flesch-Kincaid readability and grade level tests. These depend on the length of words and on the number of words in sentences so they're obviously not perfect, in particular they do not measure the use of rare vocabulary or references nor of difficult content.
I tested the OP and found:
Flesch reading ease 53.2 (fairly difficult)
Gunning Fog 11 (hard to read)
Flesch-Kincaid Grade Level 10.1 grade
Coleman-Liau 10th grade
SMOG Index 9.6 grade
ARI 9.5 grade
Linsear Write Formula 11.4 grade
Where the references to grade are to American school grades. In other words this text can be read by average American 10th graders without difficulty.
I ran an article from the current New Yorker through as well (the one on Basquiat) and that came out as 11th grade reading level.
> Everyone that speaks English as a first language would pass a C2 level examination very easily.
This is almost exactly equivalent to saying that an average ten year old can read the New Yorker. A ten year old already has their native language down, the rules of grammar and syntax, the accent, the vocabulary, the capacity to discriminate between words with the same denotation but different connotations. There are ten year olds who can profitably read the New Yorker but very few. At least 10% of the adult population will have an absolute score on an IQ test similar to the average ten year old’s.
There are undoubtedly New Yorker articles that a ten year old could completely understand with sufficient exegesis but it’s the US’ premier literary journal and has been for decades. If they haven’t published articles with the depth and complexity of a Supreme Court judgment on some level I will be greatly surprised.
Most people are literally incapable of passing a law degree just as they are of learning calculus. You can write formal logic in English prose instead of using the symbols. The English prose version will be no more comprehensible to an average native English speaker than the one with mathematical symbols.
>This is almost exactly equivalent to saying that an average ten year old can read the New Yorker.
It is not because it is fundamentally incorrect to say that the New Yorker is a C2 level text.
The CEFR is not intended as a scale to measure the complexity of written text for native speakers and/or readers of a language, it is intended as a four part (listening, reading, speaking, writing) assessment scale of the overall language abilities of people. At most, one could say that a text was consistent with what would be expected of a successful CEFR C2 candidate in the reading portion of the test.
One of the reasons that you cannot use the CEFR to characterise the proficiency of native speakers is that it assumes that you can understand texts of a similar complexity in your native language. Most such assessments are given to educated people, usually adults, so the texts reflect that.
Yes, there are people who are not highly proficient by the standards of a native speaker at reading and particularly writing in their native language. Who knows, I may be wrong to think that they would easily pass the written portion of a CEFR test, certainly they would smash the oral portions.
However the CEFR tests are fundamentally not designed to assess quality of education for native speakers. You could shoehorn them into that role but we already have other measures of language ability (in the US often calibrated to grade level) that are specifically designed to measure this.
There are a lot of problems with the way you approach this.
19% of Americans cannot read well enough to fill out a job application correctly.
The organization for economic cooperation and development found that 50% of U.S. adults can't read a book written at an 8th grade level, which is a statistic which obviously requires the estimate of "average American reading at a 7th or 8th grade level" be questioned heavily.
I've seen many estimates that the average high school student reads at a 6th grade level, and only 15% of the country is at an undergraduate level despite 30% of people having a degree.
I don't know where you get the idea that "grade level" relates to grades completed, but the average American is likely at a 5th grade reading level.
Well, I'll admit to not being an expert on the American school system with which I only had a few years of contact. If that really is the case, that grade level of reading ability and number of grades completed is not linked then that is certainly an indictment of the American system of education. I'm happy to amend my claim that 10th graders can read the New Yorker to say that by American academic standards, they should be able to but often are not.
It doesn't change the fact that the CEFR framework is not intended either to measure native proficiency nor to assess the difficulty of a written text.
I'm not disputing that the New Yorker is written at a higher level than the average American cares to read, just disputing the use of CEFR framework to assess the text.
> The CEFR is intended to measure the proficiency of foreign language learners and not measure the sophistication of native language speakers.
You’re right about this, but these are the systems I know, and they are arguably more useful in this context that most of the grade-level models you listed (very abstract, and most folks don’t really understand the level they are based on).
> Everyone that speaks English as a first language would pass a C2 level examination very easily.
C2 is the equivalent of a highly educated native speaker. This does not describe most Americans, even ones with seemingly appropriate credentials.
A discussion I’ve heard about native speakers of English expected to pass a C1 test in a foreign language: “Can they pass C1 in English?” The answer was not always so clear.
> In other words this text can be read by average American 10th graders without difficulty.
These are more like ideal goals for a high-performing Xth grader. I have worked with the vocab lists that textbooks writers are supposed to use — the expectations are very high.
While it sounds like your measurements are more attuned to native speakers, I am not so sure that any high schooler could easily pass a C2 exam. Here is an example C2 practice exercise that doesn't seem all that far off from something you might see in the SAT: https://www.examenglish.com/cpe/cpe_reading_part1.htm
I doubt that the average native English speaker would pass a C2 level exam (even if you only consider the US and UK, as there are many other countries that speak English (for example India). While they probably won't have any problems with the grammar, C2 uses a lot of vocabularity that you won't be familiar with if you don't read much.
The standard ways to measure text complexity in English for native speakers are the Flesch-Kincaid readability and grade level tests. These depend on the length of words and on the number of words in sentences so they're obviously not perfect, in particular they do not measure the use of rare vocabulary or references nor of difficult content.
I tested the OP and found: Flesch reading ease 53.2 (fairly difficult)
Gunning Fog 11 (hard to read)
Flesch-Kincaid Grade Level 10.1 grade
Coleman-Liau 10th grade
SMOG Index 9.6 grade
ARI 9.5 grade
Linsear Write Formula 11.4 grade
Where the references to grade are to American school grades. In other words this text can be read by average American 10th graders without difficulty.
I ran an article from the current New Yorker through as well (the one on Basquiat) and that came out as 11th grade reading level.