Cloud costs increasing could be a sign of more data being utilized productively. In any way, a mixture of data engineers and analysts is a healthy way to scale a dbt project to increase speed-of-delivery of analytics requests vs cloud costs. We at dbt Labs encourage the "analytics engineering" mindset to bring software engineering best practices into the dbt analytics workflow (git version control, code reviews), and so cloud cost considerations should be incorporated into mature dbt development practices.
Check out dbt-expectations package[1]. It's a port of the Great Expectations checks to dbt as tests. The advantage of this is you don't need another tool for these pretty standard tests, and can be early incorporated into dbt workflows.
Thanks! I eliminated that it was my machine -- I observed the same phenomenon on two machines.
I launched my own EC2 web instance in us-east-1 and hosted one of the slow files, and repeatedly downloaded it using a `python -m SimpleHTTPServer`. I similarly observed a slow download speed (128Kbps) without my NordVPN connection.
Oddly enough, I also observed a slow download speed to my us-east-1 server WITH my NordVPN connection, so that let me to believe it's a broader issue, however I did observe a fast download speed from an AWS server located in eu-central-1.
I'm generally confused. Connecting to NordVPN eliminates my issue, but the tests I am conducting are providing inconclusive evidence as to why this is the case!
Warby Parker is a transformative lifestyle brand with a lofty objective: to offer designer eyewear at a revolutionary price while leading the way for socially-conscious businesses. By engaging directly with consumers, we’re able to offer ultra-high-quality, vintage-inspired frames for $95 including prescription lenses and shipping. We focus on the bigger picture, too: social innovation is woven into the DNA of our company, and for every pair of glasses purchased, a pair is distributed to someone in need.
We are searching for a Data Engineer to join our 4-person team. Our tech stack includes Postgres, Google BigQuery, python, and Looker. Our team supports all of our business functions and is integral to speeding up our supply chain and gaining new business insights. We are situated in a team of 60 on-site engineers, where we constantly are finding and implementing best practices.
For more information, see our job posting http://grnh.se/57cr041 or reach out to me. Thanks!
Warby Parker is a transformative lifestyle brand with a lofty objective: to offer designer eyewear at a revolutionary price while leading the way for socially-conscious businesses. By engaging directly with consumers, we’re able to offer ultra-high-quality, vintage-inspired frames for $95 including prescription lenses and shipping. We focus on the bigger picture, too: social innovation is woven into the DNA of our company, and for every pair of glasses purchased, a pair is distributed to someone in need.
We are searching for a Data Engineer to join our 60-person, on-site engineering team to help build the next generation of our data processing platform.
For more information, see our job posting http://grnh.se/57cr041 or reach out to me. Thanks!
Indeed, most of the top competitors have been practicing since high school. We were lucky to assemble a team that has been training well before.
MIT's team consists of freshmen who are still in good training since their national high school math olympiad trainings from their respective countries.
