On: Extracting concepts from GPT-4

[realPtolemy]

Indeed, and the very last section about how they’ve now “open sourced” this research is also a bit vague. They’ve shared their research methodology and findings… But isn’t that obligatory when writing a public paper?

[lanceflt → realPtolemy]

https://github.com/openai/sparse_autoencoder

They actually open sourced it, for GPT-2 which is an open model.

[realPtolemy → lanceflt]

Thanks, I must have read through the document to hastily.