Hacker News new | past | comments | ask | show | jobs | submit login

This is nice, but before you go to the trouble of using it, consider just putting your CSV, JSON, or parquet data file in S3 and query it with S3 Select https://docs.aws.amazon.com/AmazonS3/latest/userguide/select...

I haven't tried this myself but parquet + S3 select should be especially good for analytical queries.




Seems like it should be. That's pretty much the status quo with how Azure Synapse works. You put your Parquet file out on storage, and query it (via Spark or Pandas).




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: