Code is how we realize abstractions. They complement each other. The point is that the code is a key part of the product, so saying it's an afterthought is to misunderstand the product.
I think the context matters here. The underlying point is not to be taken so literally. It means don't prematurely optimize your code until you have a functional, enjoyable piece of software. Then sure, work on maintainability and improved performance.
It's the abstractions that count.