Funnily enough the AMP version of my page is larger and takes longer to load than the non-amp version. And ironically I don't even get that little "amp" bolt symbol because it's a software product page and not a recipe, news post or blog post (there's only a handful of categories that are amp enabled).
I think I'm going to remove the AMP page, too. It offers nothing to me and is actually worse for my visitors than the normal responsive page.
You need to add [this js file](https://cdn.ampproject.org/v0.js) that is near to 45KB. I have just uploaded an AMP version for my site and it felt a little bit ridiculous... I made a simpler version (with no js and limited css), changed `<img>` for `<amp-img>` and added this js. It would load even faster without this js!!
I think I'm going to remove the AMP page, too. It offers nothing to me and is actually worse for my visitors than the normal responsive page.