On: FOILing NYC’s Taxi Trip Data

[brianjolney]

Can we get this put on S3? Would love to play around with it.

[tejaswiy → brianjolney]

I think a torrent would be better. There will probably be lots of interest in this, so S3 can get expensive.

[IanCal → tejaswiy]

Useful tip, if you add "?torrent" to the end of the url for something stored in S3, you get a torrent. I think this only works for files < 5GB though.

[mikeash → IanCal]

Any idea of the reason for the size limit? That's a pretty weird limit to put on a torrent feature.

[mentat → mikeash]

Reducing the incentive to host uncompressed DVDs / BluRay?

[toomuchtodo → mikeash]

Its an S3 torrent endpoint architectural limitation.

[morisy → IanCal]

That is awesome. Thank for the tip.

[oh_sigh → tejaswiy]

S3 can serve its contents through bittorrent as well, so you only really need to serve up 1 copy of the file(realistically, it will end up being a bit more than that if we are dealing with good internet citizens)