New generative AI capabilities for Amazon DataZone to further simplify data cataloging and discovery (preview)

Today, we are announcing a preview of an automation feature backed by generative artificial intelligence (AI) for Amazon DataZone that will dramatically decrease the amount of time needed to provide context for organizational data. The new feature can automate the traditionally labor-intensive process of data cataloging. Powered by the large language models (LLMs) of Amazon Read more about New generative AI capabilities for Amazon DataZone to further simplify data cataloging and discovery (preview)[…]

Amazon DynamoDB zero-ETL integration with Amazon OpenSearch Service is now available

Today, we are announcing the general availability of Amazon DynamoDB zero-ETL integration with Amazon OpenSearch Service, which lets you perform a search on your DynamoDB data by automatically replicating and transforming it without custom code or infrastructure. This zero-ETL integration reduces the operational burden and cost involved in writing code for a data pipeline architecture, Read more about Amazon DynamoDB zero-ETL integration with Amazon OpenSearch Service is now available[…]

New Amazon Q in QuickSight uses generative AI assistance for quicker, easier data insights (preview)

Today, I’m happy to share that Amazon Q in QuickSight is available for preview. Now you can experience the Generative BI capabilities in Amazon QuickSight announced on July 26, as well as two additional capabilities for business users. Turning insights into impact faster with Amazon Q in QuickSightWith this announcement, business users can now generate Read more about New Amazon Q in QuickSight uses generative AI assistance for quicker, easier data insights (preview)[…]

AWS Glue Data Catalog now supports automatic compaction of Apache Iceberg tables

Today, we’re making available a new capability of AWS Glue Data Catalog to allow automatic compaction of transactional tables in the Apache Iceberg format. This allows you to keep your transactional data lake tables always performant. Data lakes were initially designed primarily for storing vast amounts of raw, unstructured, or semi structured data at a Read more about AWS Glue Data Catalog now supports automatic compaction of Apache Iceberg tables[…]

Amazon Aurora MySQL zero-ETL integration with Amazon Redshift is now generally available

“Data is at the center of every application, process, and business decision,” wrote Swami Sivasubramanian, VP of Database, Analytics, and Machine Learning at AWS, and I couldn’t agree more. A common pattern customers use today is to build data pipelines to move data from Amazon Aurora to Amazon Redshift. These solutions help them gain insights Read more about Amazon Aurora MySQL zero-ETL integration with Amazon Redshift is now generally available[…]

Amazon DataZone Now Generally Available – Collaborate on Data Projects across Organizational Boundaries

Today, we’re announcing the general availability of Amazon DataZone, a new data management service to catalog, discover, analyze, share, and govern data between data producers and consumers in your organization. At AWS re:Invent 2022, we preannounced Amazon DataZone, and in March 2023, we previewed it publicly. During the keynote of the last re:Invent, Swami Sivasubramanian, Read more about Amazon DataZone Now Generally Available – Collaborate on Data Projects across Organizational Boundaries[…]

AWS Weekly Roundup – Amazon Bedrock Is Now Generally Available, Attend AWS Innovate Online, and More – Oct 2, 2023

Last week I attended the AWS Summit Johannesburg. This was the first summit to be hosted in my own country and my own city since 2019 so it was very special to have the opportunity to attend. It was great to get to meet with so many of our customers and hear how they are Read more about AWS Weekly Roundup – Amazon Bedrock Is Now Generally Available, Attend AWS Innovate Online, and More – Oct 2, 2023[…]

Amazon MSK Introduces Managed Data Delivery from Apache Kafka to Your Data Lake

I’m excited to announce today a new capability of Amazon Managed Streaming for Apache Kafka (Amazon MSK) that allows you to continuously load data from an Apache Kafka cluster to Amazon Simple Storage Service (Amazon S3). We use Amazon Kinesis Data Firehose—an extract, transform, and load (ETL) service—to read data from a Kafka topic, transform Read more about Amazon MSK Introduces Managed Data Delivery from Apache Kafka to Your Data Lake[…]

Announcing Amazon Managed Service for Apache Flink Renamed from Amazon Kinesis Data Analytics

Today we are announcing the rename of Amazon Kinesis Data Analytics to Amazon Managed Service for Apache Flink, a fully managed and serverless service for you to build and run real-time streaming applications using Apache Flink. We continue to deliver the same experience in your Flink applications without any impact on ongoing operations, developments, or Read more about Announcing Amazon Managed Service for Apache Flink Renamed from Amazon Kinesis Data Analytics[…]