Amazon Kinesis Data Analytics now supports Java-based Apache Beam streaming workloads
Amazon Kinesis Data Analytics for Apache Flink now supports streaming applications built using Apache Beam Java SDK version 2.23. Apache Beam is an open-source, unified model for defining streaming and batch data processing applications that can be executed across multiple execution engines. This release allows you to build Apache Beam streaming applications in Java and run them using Apache Flink 1.8 on Amazon Kinesis Data Analytics, Apache Spark running on-premises, and other execution engines supported by Apache.
Amazon Kinesis Data Analytics for Apache Flink now supports streaming applications built using Apache Beam Java SDK version 2.23. Apache Beam is an open-source, unified model for defining streaming and batch data processing applications that can be executed across multiple execution engines. This release allows you to build Apache Beam streaming applications in Java and run them using Apache Flink 1.8 on Amazon Kinesis Data Analytics, Apache Spark running on-premises, and other execution engines supported by Apache.
Amazon Kinesis Data Analytics is the easiest way to transform and analyze streaming data in real time with Apache Flink. Apache Flink is an open source framework and engine for processing data streams. Amazon Kinesis Data Analytics reduces the complexity of building and managing Apache Flink applications. Amazon Kinesis Data Analytics for Apache Flink integrates with Amazon Managed Streaming for Apache Kafka (Amazon MSK), Amazon Kinesis Data Streams, Amazon Elasticsearch Service, Amazon DynamoDB streams Amazon S3, custom integrations, and more using built-in connectors.
You can learn more about Amazon Kinesis Data Analytics for Apache Flink here and build your own Apache Beam pipeline through the Streaming Analytics Workshop. You can learn more about Apache Flink and Apache Beam by visiting their official website.
For Amazon Kinesis Data Analytics region availability, refer to the AWS Region Table.