This seems silly to me--if an idea or subject _is_ difficult, then so be it. If something difficult to read is worth it to somebody, then that person will read it. I don't understand the fascination with difficulty--whatever that means, as an independent metric. To me, the value of writing is the idea or set of ideas the writing expresses.
I think it is important not to boil fiction down into the 'idea or set of ideas the writing expresses' because if the author could so well articulate their 'idea' then wouldn't they be better off writing an essay rather than a narrative?
Instead, I think the fascination with difficulty is exactly this -- the idea that some ideas are amorphous and difficult to express directly, and that authors have tried (successfully and less so) drastic measures to try and, in their own way, do exactly what you said in your comment.
And there is something, for some, inherently interesting in the different contortions of text that experimental writers have come up with.
> wouldn't they be better off writing an essay rather than a narrative?
There's an interesting quote by Eliezer Yudkowsky, who is best known for writing the fan-fiction Harry Potter and the Methods of Rationality.
"Nonfiction conveys knowledge and fiction conveys experience. If you want to understand a proof of Bayes’s Rule, I can use diagrams. If I want you to feel what it is to use Bayesian reasoning, I have to write a story in which some character is doing that."
It's interesting to note that he wrote HPMoR with a specific purpose in mind, namely to teach the specific skills of "rational" thinking he wrote about on the LessWrong site.
In his case it seems he saw fiction as something complementary to his essays, a means of conveying "experience", a simulation of living through situations in which the concepts could be used.
This is, of course, far from the only use of fiction, but I think it at least provides a specific example of a way in which fiction can be used to convey something in a way that cannot be (easily) done using dry prose (even if you are considering it purely from a practical standpoint without any reference to artistic merit).
> their 'idea' then wouldn't they be better off writing an essay rather than a narrative?
Not necessarily. It's a lot easier to empathize with characters and a novel can capture something more ephemeral. Camus would write a novel first then turn it into an essay.
> if the author could so well articulate their 'idea' then wouldn't they be better off writing an essay rather than a narrative?
I have pages and pages of what I think are well-articulated ideas that would be relatively easy to turn into essays. My challenge is finding a narrative that ties them all (or at least some of them) together.
The issue I think is that difficulty and complexity get conflated: in an effort to simplify, they reduce both depth and difficulty, which reduces the total value of the subject. The problem primarily being that this conflation isn’t widely recognized, so usually efforts towards broader reach produces worse outcomes. Even worse, these efforts (stripping difficulty while maintaining depth) often assume their own success, and remove access to the difficult (and deeper) material.
You see this in software as accessible vs power users
Frameworks to simplify web development
Libraries do it gp’s example
Schools do it by simplifying the literature selection/ topic breadth
Etc
Anytime you have management without a minimum “gate”, the issue occurs, because the conflation exists but no one admits it, and with the goal of widespread accessibility, it gets further embedded each iteration.
In other words the quote “if you can’t explain it to a six year old, you don’t understand it” is misread to “if you can’t explain it in six minutes, you don’t understand it”, and then everything gets “simplified” right out of existence
It seems a bit silly to me from the other angle, in that the author has chosen to write it in a particular way because that's the way they felt it best to convey their story.
I'm about a million miles from being an author, but I'm old enough that I have, what I would think, is a recognisable style that I'm comfortable with, and changing my approach would end up negatively affecting the quality of the writing because it comes less natural to me.
Authors will find their own level as much as readers will.
In a way--my question boils down to why this was written in the first place. Engaging with literary criticism is an invitation to perpetuate literary criticism :P