On: Metaprogramming Python For Big Data

[Fede_V]

Excellent. For sparse storage, do you use Scipy Sparse, or you have your own custom built solution?

I know continuum was working on a version of memmapped numpy (blaze, iirc) arrays which looked really interesting.

[vtuulos → Fede_V]

I started with Scipy Sparse. I ditched it for a custom solution so I could support variable-length integers, run-length encoding etc.