Hacker News new | past | comments | ask | show | jobs | submit login

Yes, in the context of my comment higher in the thread about using libraries. This gives you a lot more control of the connection pool and queues, which can get a lot more performance than simple cURL usage. From the cURL manpage:

  curl will attempt to re-use connections for multiple file transfers, so that getting 
  many files from the same server will not do multiple connects / handshakes. This 
  improves speed. Of course this is only done on files specified on a single command 
  line and cannot be used between separate curl invokes.
So using a library gives you more flexibility in reusing connections (and avoiding the expensive TCP/TLS handshake) than the simple patterns you can use with the cURL CLI.

See also: https://docs.aiohttp.org/en/latest/http_request_lifecycle.ht...




Oh believe me, I am aware. I just didn't want to write a program for my task back then (even if it would have likely taken almost the same amount of time as it turned out in the end).

That's why I am searching for an alternative to the classic shell scripting and I have almost settled on OCaml.

Python is alright as well but never really liked it: just when you might need a tool that's quick to launch, you'll hit the Python interpreter startup overhead. Same goes for many other interpreted languages.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: