What's new on the cloud for data engineers - part 7 (05-08.2022)

Four months in cloud history is a huge period of time. Even when 2 of the 4 months are the usual "holiday" months. As you can guess from the title, it's time to see what changed recently on the cloud from a data engineering perspective!

New ebook 🔥

Learn 84 ways to solve common data engineering problems with cloud services.

👉 I want my Early Access edition

engineers - part 7 (05-08.2022) Four months in cloud history is a huge period of time. Even when 2 of the 4 months are the usual "holiday" months. As you can guess from the title, it's time to see what changed recently on the cloud from a data engineering perspective!

AWS

Athena

Four news for this AWS ad-hoc querying service:

Aurora

Backup

Data Exchange

Data Sync

Database Migration Service

DocumentDB

DynamoDB

EC2

Although it's not a pure data service, EC2 got a few interesting auto-scaling updates:

ElastiCache

EMR

EventBridge

Glue

Streaming:

Jobs:

Notebooks:

Lambda

Processing:

Security:

Ops/Others:

Macie

MSK

Neptune

RDS

Oracle:

SQL Server:

MySQL:

PostgreSQL:

Global:

Redshift

Others:

Performance:

Security:

S3

Outpost:

Other features:

OpenSearch

Step Functions

QuickSight

Azure

Backup

Cache for Redis

Cosmos DB

Synapse Link:

MongoDB:

Misc:

Data Explorer

Databricks

Event Grid

Event Hubs

Functions

Some news for the serverless offering:

Durable functions:

Key Vault

Although it's not a pure data service, it got an important update:

Purview

SQL Database

Hyperscale:

PostgreSQL:

SQL Managed Instance:

MySQL:

Misc:

Storage Account

Stream Analytics

Synapse

Virtual Network

Although it's not a pure data service, it has 2 new features good to know as a data engineer:

VM

Although it's not a pure data offering, it's worth noticing one interesting news from a data workloads perspective.

GCP

BigQuery

Administration:

IO:

SQL:

Security:

Omni:

Collation:

Other features:

Cloud Composer

Cloud Composer 2:

Security:

Others:

Cloud Functions

Cloud SQL

SQL Server:

MySQL:

PostgreSQL:

PostgreSQL and MySQL:

Global:

Cloud Storage

Security:

Misc:

Data Catalog

Data Fusion

Two new releases (6.7.0 and 6.7.1) and some major changes in them:

Data Loss Protection

Dataflow

Dataproc

Datastream

Firestore

IAM

Pub/Sub

Spanner

Performance:

Other features:

Querying:

Storage Transfer Service

If I had to pick my Top 5 changes? Once again, serverless releases (Redshift, MSK, Dataflow, EMR) are my favorites. And in addition to them the flex option for Glue, so the mix of time- and cost-saving features :) What are yours?

If you liked it, you should read:

The comments are moderated. I publish them when I answer, so don't worry if you don't see yours immediately :)

📚 Newsletter Get new posts, recommended reading and other exclusive information every week. SPAM free - no 3rd party ads, only the information about waitingforcode!