> not sure where you get the idea dataframes are unique to SQL databases
I'm not sure I said this.
> HBase and Cassandra were even the original big data databases and they aren't relational.
They also had trouble doing joins and many other query operations which are common in analytics. Presto addresses this somewhat.
> And Spark can manifest almost any database as a dataframe.
Which entails a translation layer from whatever non-tabular form that data was (e.g. JSON) into a dataframe-like structure, rather keeping it in its native form, which reinforces my point. You still need to somehow transform data into tabular form. (ETL is just a batch way of doing this transformation; you can have live transformations of course, with accompanying overheads)
BI tools also generally require data to be in tabular form, which entails the use of a translation layer. The Mongo BI connector is one such translator.
> Actually MongoDB is quite popular in the analytics space.
I work in this space, interact regularly with vendors, and monitor the space actively for strategic developments. This does not track with my observations.
I'm not sure I said this.
> HBase and Cassandra were even the original big data databases and they aren't relational.
They also had trouble doing joins and many other query operations which are common in analytics. Presto addresses this somewhat.
> And Spark can manifest almost any database as a dataframe.
Which entails a translation layer from whatever non-tabular form that data was (e.g. JSON) into a dataframe-like structure, rather keeping it in its native form, which reinforces my point. You still need to somehow transform data into tabular form. (ETL is just a batch way of doing this transformation; you can have live transformations of course, with accompanying overheads)
BI tools also generally require data to be in tabular form, which entails the use of a translation layer. The Mongo BI connector is one such translator.
> Actually MongoDB is quite popular in the analytics space.
I work in this space, interact regularly with vendors, and monitor the space actively for strategic developments. This does not track with my observations.