Last Week in a Byte on Delta Lake | 2023-04-11

You can watch or read the latest #DeltaLake news a week late (2023-04-11 edition)!

delta-spark 2.3.0 has been released!

The big news from last week is that delta-spark 2.3.0 was released!

There are a lot of great features in this release including:

• Zero-copy convert to Delta from #apacheiceberg via CONVERT TO DELTA
• SHALLOW CLONE for Delta, #parquet, and Iceberg tables
• Idempotent writes for DML operations
• Improved MERGE with "when not matched by source"
• Reading Change Data Feed (CDF) in #SQL queries #changedatafeed
• Improved read and write #performance in #aws #s3
• Record VACUUM operations in the transaction log
• And one of my favorites - reading Delta table with #deletionvectors

Shout outs!

Even after a heavily packed release, we did want to have some quick shout-outs!

• Will Girten for his always informative #deltasharing posts like his latest one on how you can #stream from #shared Delta tables in Delta Sharing 0.6+
• To continue showcasing Linux Foundation collaboration, the FINOS Legend project officially included Delta Lake as part of its integrations. cc The Linux Foundation , #finos, #legend
• We are trying out linen.dev to archive Delta Lake Slack so they are Google searchable as well. Check out at https://linen.delta.io/
• Nick Karpov wrote a great post Introducing Support for Delta Lake Tables in AWS Lambda which provides the steps to integrate Delta Lake with #AWS #lambda

Connect with us!

Want to learn more about Delta Lake and chat with other users and contributors? Join us at delta.io, Slack, LinkedIn, and GitHub.