Hacker News new | past | comments | ask | show | jobs | submit login
FlightCaster merges its statistical-learning code into Incanter (incanter-blog.org)
77 points by fogus on Dec 3, 2009 | hide | past | favorite | 9 comments



Flightcaster does some fantastic, innovative stuff in the statistical, distributed computing, and Clojure worlds.


Could you give some specifics?


Article about them in general: http://news.ycombinator.com/item?id=782960

Their stack (kinda): S3 -> EC2 -> Cloudera -> HDFS -> Hadoop -> Cascading -> Clojure.


This is really cool. I have been learning some stats, data mining, and machine learning stuff and I'm compelled by Incanter. I can see why a lisp is a good choice for statisical computing, with lists of data and easy composition of calculations.

Thanks to both the Incanter and FlightCaster devs for the generosity.


Using lisp as language for statistics has it's precursors like xlisp-stat. In a historical perspective, S (or similar functional languages) have taken the crown though.


Somewhere in the archives of comp.lang.lisp there is a post by Ross Ihaka where he mentions that they wanted to use scheme or another lisp-like language for R, but decided to go with something more familiar to most potential users. If I remember right, he said if they could do it all over again, they would use lisp.

There's also this, which I believe partly motivated Incanter's creation: http://books.google.com/books?id=8Cf16JkKz30C&pg=PA21#v=...


IMHO the popularity of R is grounded on its compatibility with S/S-Plus. if they hadn't used S as language, they would have never reached the position where they are now and R wouldn't be increasingly adapted as standard statistics package---competing with and/or replacing SPSS/PASW, SAS, stata etc.

On the incanter homepage there is a link to http://www.jstatsoft.org/v13 which includes a few interesting articles.

Anyway, I find the integration with java interesting. That's a strong argument in favour of a solution like incanter.



I can have a REPL with easy dynamic access to S3 for compute power? Nice.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: