AWS has introduced the Data Processing MCP Server and Agent, open-source tools designed to streamline the development of analytics environments by simplifying workflows through natural language interactions. By leveraging the Model Context Protocol (MCP), these tools enhance productivity, enabling AI assistants to guide developers in managing complex data processing tasks across various AWS services. The integration with AWS Glue, Amazon EMR, and Athena allows for intelligent recommendations and improved observability of analytics operations.
Pinterest's Big Data Platform team has developed Moka, a next-generation data processing platform deployed on AWS Elastic Kubernetes Service (EKS). The article outlines Moka's infrastructure, including its logging and observability strategies, which leverage tools like Fluent Bit for log management and Prometheus for metrics storage and monitoring. Key learnings and future directions for Moka's development are also discussed.