Building a Data Pipeline - Languages and Stack

Choosing a language and stack


Hello! Welcome to the exciting topic of ingesting massive amounts of pastries data! We talked about ingest a bit in the previous tutorial; in this one, we’ll examine various architectures in great detail.

Let’s get the controversial part out of the way. Language. =)

Building a Data Pipeline - Part 0

Covers general elements of data pipelines, what they do, and why they do it

Intro When I started this blog, I wanted it to show building multiple different types of projects from a practical perspective. As an astute reader, I’m sure you’ve noticed that Iridium has been the only the project we’ve been working on. Time to change that! Welcome to the first post of Project Grimwhisker! (adsbygoogle = window.adsbygoogle || []).push({}); What? It’s a data pipeline.