What's new on the cloud for data engineers - part 7 (05-08.2022)

Four months in cloud history is a huge period of time. Even when 2 of the 4 months are the usual "holiday" months. As you can guess from the title, it's time to see what changed recently on the cloud from a data engineering perspective!

Looking for a better data engineering position and skills?

You have been working as a data engineer but feel stuck? You don't have any new challenges and are still writing the same jobs all over again? You have now different options. You can try to look for a new job, now or later, or learn from the others! "Become a Better Data Engineer" initiative is one of these places where you can find online learning resources where the theory meets the practice. They will help you prepare maybe for the next job, or at least, improve your current skillset without looking for something else.

👉 I'm interested in improving my data engineering skillset

See you there, Bartosz

engineers - part 7 (05-08.2022) Four months in cloud history is a huge period of time. Even when 2 of the 4 months are the usual "holiday" months. As you can guess from the title, it's time to see what changed recently on the cloud from a data engineering perspective!

AWS

Athena

Four news for this AWS ad-hoc querying service:

Aurora

Backup

Data Exchange

Data Sync

Database Migration Service

DocumentDB

DynamoDB

EC2

Although it's not a pure data service, EC2 got a few interesting auto-scaling updates:

ElastiCache

EMR

EventBridge

Glue

Streaming:

Jobs:

Notebooks:

Lambda

Processing:

Security:

Ops/Others:

Macie

MSK

Neptune

RDS

Oracle:

SQL Server:

MySQL:

PostgreSQL:

Global:

Redshift

Others:

Performance:

Security:

S3

Outpost:

Other features:

OpenSearch

Step Functions

QuickSight

Azure

Backup

Cache for Redis

Cosmos DB

Synapse Link:

MongoDB:

Misc:

Data Explorer

Databricks

Event Grid

Event Hubs

Functions

Some news for the serverless offering:

Durable functions:

Key Vault

Although it's not a pure data service, it got an important update:

Purview

SQL Database

Hyperscale:

PostgreSQL:

SQL Managed Instance:

MySQL:

Misc:

Storage Account

Stream Analytics

Synapse

Virtual Network

Although it's not a pure data service, it has 2 new features good to know as a data engineer:

VM

Although it's not a pure data offering, it's worth noticing one interesting news from a data workloads perspective.

GCP

BigQuery

Administration:

IO:

SQL:

Security:

Omni:

Collation:

Other features:

Cloud Composer

Cloud Composer 2:

Security:

Others:

Cloud Functions

Cloud SQL

SQL Server:

MySQL:

PostgreSQL:

PostgreSQL and MySQL:

Global:

Cloud Storage

Security:

Misc:

Data Catalog

Data Fusion

Two new releases (6.7.0 and 6.7.1) and some major changes in them:

Data Loss Protection

Dataflow

Dataproc

Datastream

Firestore

IAM

Pub/Sub

Spanner

Performance:

Other features:

Querying:

Storage Transfer Service

If I had to pick my Top 5 changes? Once again, serverless releases (Redshift, MSK, Dataflow, EMR) are my favorites. And in addition to them the flex option for Glue, so the mix of time- and cost-saving features :) What are yours?


If you liked it, you should read:

📚 Newsletter Get new posts, recommended reading and other exclusive information every week. SPAM free - no 3rd party ads, only the information about waitingforcode!