Amazon MWAA Serverless now supports PythonOperator and BashOperator
Data engineering teams can perform tasks like data transformations and quality checks without the need to provision additional infrastructure.
- Supports running custom Python functions and shell scripts directly in the serverless runtime using PythonOperator and BashOperator
- Enables data engineering teams to execute daily code patterns such as data transformations, format conversions, and data quality checks without provisioning additional infrastructure
- Users package Python modules or shell scripts as code packages, upload them to Amazon S3, and reference them in workflows
- Snapshots code at workflow creation time to ensure consistent execution across subsequent runs
- Available in all AWS Regions where Amazon MWAA Serverless is available