On: Moving 25TB data from one S3 bucket to another too...

[rapsey]

So you clearly picked the wrong tool for the job and spent an obscene amount of effort hacking around your tool instead of picking a better one.

[jml7c5 → rapsey]

What alternative would you have proposed?

[mixmastamyk → jml7c5]

In other threads folks are chatting about how awesome rclone is.

[rapsey → jml7c5]

A language better at parallellism. Elixir or go are both easy to pick up.

[tehlike → rapsey]

Umm what, java supports threads what's the deal :)

[ComputerGuru → tehlike]

The problem was Ruby, not Java.

[lmm → jml7c5]

Buck up and learn enough Java to write this basic program. It's really not a particularly complex or hard language.

[ed25519FUUU → lmm]

(Sarcasm) You should “buck up” and learn Rust or C. With a real language you won’t have to deal with the overhead of a runtime and will really be able to saturate the resources.

[lmm → ed25519FUUU]

I can and have written Rust, C, and indeed Ruby where warranted. Surely any self-respecting programmer would do the same?

[CydeWeys → lmm]

How's that significantly different from the Ruby tool they did write?

[lmm → CydeWeys]

Java libraries don't tend to break in the presence of multithreading the way Ruby ones do.