SourceAWS Glue 6.0 now available with 30% lower price and full Apache Iceberg v3 support
Data engineers can lower their operational costs while processing semi-structured, geospatial, or high-frequency financial data more efficiently. This reduces the need for manual schema flattening and enables faster real-time event processing.
- Delivers 30% lower pricing compared to previous AWS Glue versions.
- Provides full support for Apache Iceberg v3 features, including VARIANT data type shredding, geometry/geography data types, nanosecond-precision timestamps, and unknown type handling.
- Upgrades runtime engine to Apache Spark 4.1, Python 3.12, and Scala 2.13 for faster performance.
- Introduces Spark declarative pipelines for simplified ETL authoring without manual orchestration overhead.
- Adds Arrow-native execution for Python UDFs and UDTFs, removing JVM serialization overhead and improving PySpark performance.
- Features a stateless real-time streaming mode achieving single-digit millisecond latency.
- Generally available in all AWS Regions where AWS Glue operates with no required API changes.