#Slack replaced SSH-based execution in Amazon EMR pipelines with Quarry - a REST-driven orchestration layer.

The migration covered 700+ Airflow operators, improving security, reliability & observability while removing direct SSH access to production clusters and enabling server-side job lifecycle management.

🔗 Learn more: https://bit.ly/4eJs0V6

#InfoQ #Observability #Migration #DataPipelines #SoftwareArchitecture