Snowplow on Google Cloud 2 - The pipeline

With the Snowplow pipeline successfully running in your own Google Cloud project, you get an event pipeline that runs in your infrastructure and gives you high-quality event data in BigQuery.


Skill Level
Intermediate
Time to Complete
1 hour
OVERVIEW

About this course

We finished the first course in this series with a working Iglu server. The Iglu server hosts the schemas that we will use in the pipeline.

Now we will set up the last part: the event pipeline itself.

Even though we are setting up many more parts, the setup is simpler. The complicated parts are set up in the first part - like the VPC. That is why this course is much shorter.

If you want to learn more about the basics of Terraform or how Snowplow works on GCP, go back to part one and the corresponding lessons.
Trailer
WHO

Who is this course for

1
Data Engineer
You are the mastermind behind the scenes who makes sure all our data is playing nice together. You are the ones who keep the data blockages at bay, making sure everything runs like a well-oiled machine.
2
Marketing Analyst
You are like a secret agent, using your spy-like skills to analyze campaign performance. They comb through mountains of data to tell us what's working, what's not, and how we can improve our marketing strategies.
3
Product Analyst
You are the product data detective (Mrs. or Mr. Holmes), using your analytical skills to uncover insights from your products. You help businesses make strategic decisions and drive growth by identifying trends and patterns in the data.
CURRICULUM

LEARN-BY DOING WITH LESSONS

The choice is yours - you can either immerse yourself and complete the course in one go, or take a more gradual approach by repeating and skipping between lessons at your own pace.
KEY TAKEAWAYS

WHAT YOU LEARN

The best way to learn is by taking action, so it's time to get ready to work.
Here are some of the things you'll get out of doing this course:
Deploying an event pipeline on GCP
Adapting the Terraform configuration for the pipeline
Testing the setup with first test events
WHY

Why learn with Deepskydata?

We understand the struggle because we've once been in your shoes. Allow us to share what we know now to help you reach your destination with ease and make your learning journey smoother.
Shortcut to success
Get hands-on shortcuts across the data stack with our how-to videos, saving you time and resources on testing and debugging - where 90% of the work lies.
A new community
Rolling out in early 2023 the new community will bring you together with data practitioners who are on the same track, with the same struggles to share experiences.
We are here for you
This is not a watch and forget platform. We are here to help you. Do you have questions after watching a course - just get in touch with us.
DEEPSKYDATA TEACHERS

LEARN WITH EXPERIENCED DATA EXPERTS

Teacher
The background of the info card. Likely the portait of a person who is a teacher on the platform.
A colourful small side decoration on an info card.
Timo Dechau
Founder & Data Engineer