What's new on the cloud for data engineers - part 9 (01-03.2023)

Have you missed any cloud data engineering-related news in the last 3 months? No worries, I got you covered with the new part of the "What's new on the cloud for data engineers..." series.

Looking for a better data engineering position and skills?

You have been working as a data engineer but feel stuck? You don't have any new challenges and are still writing the same jobs all over again? You have now different options. You can try to look for a new job, now or later, or learn from the others! "Become a Better Data Engineer" initiative is one of these places where you can find online learning resources where the theory meets the practice. They will help you prepare maybe for the next job, or at least, improve your current skillset without looking for something else.

👉 I'm interested in improving my data engineering skillset

See you there, Bartosz

This 9th part covers all that happened between 17.12.2022 and 10.03.2023. You'll see that despite the Christmas period, the data services got a lot of exciting updates! As previously, I highlighted the most interesting news.

AWS

Athena

Aurora

Batch

CloudWatch

Database Migration Service

DocumentDB

DynamoDB

ElastiCache

EMR

Serverless:

Others:

Glue

Crawlers:

Streaming:

Studio:

Others:

Kendra

Kinesis

Data Streams:

Firehose:

Lambda

Processing:

Ops/Others:

Managed Workflows for Apache Airflow

Neptune

Redshift

Serverless:

Others:

S3

Storage Lens:

Security:

Other features:

Storage Gateway

MemoryDB

OpenSearch

RDS

Oracle:

SQL Server:

PostgreSQL:

MariaDB:

MySQL + PostgreSQL:

Global:

Snow Family

Step Functions

Timestream

QuickSight

Azure

Backup

Cache for Redis

Cosmos DB

PostgreSQL

Misc:

Data Explorer

Database Migration

Databricks

Event Grid

Functions

Purview

SQL Database

Hyperscale:

PostgreSQL:

SQL Managed Instance:

MySQL:

Security:

Misc:

Storage Account

Stream Analytics

GCP

BigQuery

Administration/OPS:

IO:

SQL:

Security:

Omni:

Console:

Other features:

BigQuery Transfer Service

BigLake

Cloud Composer

Bug fixes:

Cloud Functions

Cloud SQL

SQL Server:

MySQL:

PostgreSQL:

PostgreSQL and MySQL:

Global:

Cloud Storage

Data Fusion

Data Loss Protection

New detectors and connections:

Others:

Dataflow

Dataplex

Dataproc

Datastream

Firestore

IAM

Spanner

Storage Transfer Service

This time I noticed less targeted-changes. In the previous updates, I had a feeling that the cloud providers were working on a particular topic each time, such as table file formats or streaming. Here, the changes are different but definitively, the new autoscaling on BigQuery, DocumentDB stream, or cross-cloud connectivity, are interesting features. What's yours?


If you liked it, you should read:

📚 Newsletter Get new posts, recommended reading and other exclusive information every week. SPAM free - no 3rd party ads, only the information about waitingforcode!