Master stream processing

You have a first successful experience with batch data pipelines and were asked to implement your first stream processing jobs?

You shouldn't consider stream processing as a batch on the unbounded data. It's much more than that!

There are various stream-processing concepts. This 3-modules course will show you them from lead you through them, from the data ingestion to the stateful stream processing!

Master batch processing (WIP)

The module is under development. Join the waiting list to be notified about the release.

Is writing batch pipelines more than just defining Extract, Load and Transform steps?

Yes, much more! Batch processing has its own data flow patterns, data exposition patterns, idempotency, backfilling, and data quality aspects.

It may be difficult to get them all right from the day 1. Unless you take a shortcut. This 3-modules course is one of them.

Data engineering patterns on the cloud

How to solve common data engineering problems with cloud services?

A list of comprehensive data processing, data storage, data security, data warehouse, data management, data orchestration and data transfer patterns to apply on the cloud.

Become a Data Engineer

You're trying to learn data engineering but there is...too much materials. Hadoop, Cloud, NoSQL, RDBMS, data warehouse, data lake, data lakehouse, ... are you feeling lost?

Learning data engineering is fascinating but can become a real problem if, as a beginner, you don't know how to identify the materials that can help you to reach the goal. You will spend a lot of time and at the end, probably still be confused about the data engineering skills to master.

You are not alone and other people have faced the same problems before, including myself! Based on that experience, the Become a Data Engineer course proposes a 10-modules course covering all important data concepts and patterns that you should know before starting your new job role.