Wow, so much praise for Kodi, and it's well-deserved.
Been using LibreELEC (which is basically a Kodi OS) on just a RPi3 for a few years now, it's a good enough client for non-smart TV to simply browse stuff from NAS with Yatse on Android. In a bare minimum case not too difficult to set up, just add a source via SFTP and you're done, no need for scanning.
This is great, starred! I like how you went beyond the usual "render page to png/pdf with CDP" stuff and made evaluate/exists/set screen size methods - one can see it's made for real use.
This could become a cool replacement for PhantomJS that people would actually use! I answer questions about PhantomJS on SO now and then - there are lots of questions on how to login to a site and download something while in a session, so - here's another idea for real world use: download to local fs method.
Other features people use often:
* waiting for (an element/set amount of time),
* event for when a page has (re)loaded, to check if login/submit was successful
* aborting select network requests - useful for scraping/testing
Yes. After Google Reader's demise decided to invest some time and find a good self-hosted solution. Very pleased with Tiny Tiny RSS since then: https://tt-rss.org
It's free, has simple design, consumes few VPS resources, supports plugins. There apps for Android, iOS, WP. Requirements: a webserver, PHP, Mysql/Postgres.
That's quite interesting! I thought node-webkit isn't suitable (yet) for such purpose. Could you go into more detail on how to do parsing/automation external sites with it?
It's very suitable! (I'm using it in DuckieTV in production, works like a charm!)
Basically, you can use xmlhttp to fetch any webpage becaused of relaxed restrictions. then use DOMParser (a built-in browser component, that you can even shim) to create a virtual DOM of that xmlhttp result, and execute regular querySelector and querySelectorAlll queries on that :)
CasperJS is a higher-level wrapper for PhantomJS, so - yes, it could be done with PhantomJS solely... But you wouldn't want to, because CasperJS makes automation easier.
Are there any libraries to facilitate database-connectivity to SQL Server or MySQL from javascript? I've used CasperJS to scrape some sites, but always fall back on post-processing the scraped data with another program in order to get it into my database. I'd love to be able to do it all from one piece of code.
You could always have your CasperJS scraping script make an AJAX request to a RESTful API for your MySQL DB. You won't be doing it all from one piece of code, but you'll be doing about 90% of it.
