From this recent study: https://arxiv.org/pdf/2307.09009.pdf
> For example, GPT-4 (March 2023) was very good at identifying prime numbers (accuracy 97.6%) but GPT-4 (June 2023) was very poor on these same questions (accuracy 2.4%).
There is more in the study but I just grabbed a short snippet as an example.
From this recent study: https://arxiv.org/pdf/2307.09009.pdf
> For example, GPT-4 (March 2023) was very good at identifying prime numbers (accuracy 97.6%) but GPT-4 (June 2023) was very poor on these same questions (accuracy 2.4%).
There is more in the study but I just grabbed a short snippet as an example.