Click any tag below to further narrow down your results
Links
This article argues against the notion that Postgres can replace Kafka, highlighting their distinct purposes. It explains how using Postgres for event streaming can lead to challenges and inefficiencies, particularly for use cases Kafka is designed to handle.
This article explains the Command Query Responsibility Segregation (CQRS) design pattern, which separates read and write operations in database management. It discusses the benefits and challenges of CQRS, including data replication methods and offers a demo application example using a voting system.
This article discusses the pitfalls of microservices, particularly how they can devolve into complex, unmanageable systems. It introduces the concept of a polytree as a structural model to help maintain clear dependencies and ownership, reducing development headaches and improving system reliability.
This article discusses the drawbacks of eventual consistency in database systems, particularly for application developers and users. It highlights the confusion and bugs that arise from stale data when using read replicas and presents Aurora DSQL as a solution that ensures strong consistency for all reads.
The article critiques the evolution of programming from object-oriented programming (OOP) to microservices, arguing that while OOP has its flaws, the alternatives have exacerbated those issues. It highlights how increased complexity and distrust in software development have led to a convoluted architecture that is just as problematic as OOP.
This article details LinkedIn's transition from Zookeeper to a new scalable service discovery system designed to handle the demands of a growing number of microservices. The new system, which uses Kafka and a Service Discovery Observer, improves scalability, compatibility, and extensibility while supporting multiple programming languages.
The article details how Uber transitioned from static rate limiting to a more dynamic load management system to handle database overload effectively. It explores the architecture of Uber’s databases, the challenges faced, and the innovative solutions implemented, such as CoDel queues and the Scorecard engine, to ensure stability and fairness in a multitenant environment.
The article highlights recurring issues in microservices, emphasizing that complexity and chaos are inherent in distributed systems. It discusses common pitfalls such as excessive services per engineer, poorly managed gateways, technology sprawl, and the problems of aligning architecture with organizational structure.
Agentfield provides a control plane for deploying intelligent agents as microservices, addressing the challenges of scale and trust in production systems. It offers built-in identity, auditing, and production-ready infrastructure to simplify the transition from prototypes to operational software.
Coinbase uses Resolve AI to streamline incident resolution and improve daily operations. The AI tool provides instant context during incidents and integrates production data into engineering workflows, boosting efficiency and reliability.
This article explains how Dapr, an open-source project under the CNCF, streamlines the development of microservices by automating common tasks like messaging, tracing, and observability. It also discusses Dapr's integration with other tools like KEDA for dynamic autoscaling in event-driven applications.
This article discusses Orkes Conductor, a managed platform that enhances Netflix Conductor for enterprise needs. It simplifies microservices orchestration by providing high availability, security, and easy integration without the infrastructure hassles. The platform supports AI automation and offers tools for quick development and migration.
mirrord allows developers to run microservices locally while connecting directly to cloud environments without complex setups. This tool speeds up development cycles, reduces cloud costs, and eliminates the need for constant redeployments for testing.
Aiven offers a free plan for Apache Kafka, designed for users to build applications without infrastructure costs. The service includes a managed Kafka cluster with a Schema registry and REST proxy, allowing for quick deployment and testing of event-driven architectures. Users can start building in just a few steps, with no credit card required.
This article outlines a library of Claude Code infrastructure created from six months of practical use in a TypeScript microservices project. It offers patterns and systems to auto-activate skills and manage complex tasks efficiently, serving as a reference for developers to integrate into their own projects.
This article outlines how to apply hexagonal architecture to an Apache Flink microservice, specifically for dynamic pricing. It emphasizes separating business logic from Flink's infrastructure, creating a clean domain layer, and developing unit tests before integrating with Flink.
Amazon ECR now lets users share common image layers across repositories using blob mounting. This speeds up image pushes and cuts storage costs by reusing layers instead of uploading duplicates. The feature is easy to enable through the ECR console or AWS CLI.
This article outlines how to deploy microservices using Azure Kubernetes Service (AKS) automated through GitHub Actions. It covers the necessary prerequisites, the CI/CD pipeline stages, and best practices for a successful deployment. You’ll learn how to set up the process for building, pushing, and deploying Docker images effectively.
Many companies struggle with AI agent platforms that start as separate projects but eventually become a tangled monolith. The solution lies in applying microservices principles to create modular, independent agents that can scale and adapt without being tightly coupled. By treating AI agents as microservices, organizations can enhance reliability and facilitate smoother operations.
Modern systems are evolving from monolithic architectures to complex, distributed graphs of computation that require effective coordination strategies for workflows spanning multiple services. The article introduces a framework for understanding the relationship between event-driven architecture, stream processing, and orchestration, emphasizing the importance of durable triggers and progressable work in achieving reliable workflows. It also discusses the critical roles of choreography and orchestration in managing these workflows effectively.
The article discusses how to visualize distributed traces using Datadog's tracing capabilities, particularly focusing on the integration of distributed maps with AWS Step Functions. It emphasizes the importance of monitoring complex workflows and how these visualizations can enhance observability and troubleshooting in microservices architectures.
Kubernetes traffic management is challenging due to the complexity of modern applications and the limitations of traditional tools like Ingress. The Gateway API offers a standardized, Kubernetes-native framework that improves traffic management by enabling advanced routing, load balancing, and security while simplifying configurations across clusters. This solution addresses the operational difficulties associated with managing multiple services in dynamic environments.
The article provides an analysis of the current momentum of Cloud Native Computing Foundation (CNCF) projects as of mid-year. It highlights the growth and adoption trends of various CNCF projects, emphasizing their impact on the cloud native ecosystem and the increasing importance of containerization and microservices in modern software development.
The article discusses Microsoft's implementation of the Pact framework, highlighting its benefits for creating consumer-driven contracts in microservices. It emphasizes the importance of ensuring compatibility between services and the advantages of using Pact in software development workflows. Additionally, it provides insights into best practices for integrating Pact into existing systems.
The article discusses the complexities and challenges associated with managing egress traffic in Kubernetes environments. It emphasizes the importance of proper egress controls to ensure secure and efficient communication between microservices and external resources. Strategies for optimizing egress traffic and enhancing security are also highlighted.
Azure offers three distinct containerisation services: Azure Kubernetes Service (AKS) for complex workloads requiring Kubernetes control, Azure App Service for straightforward web apps and APIs with minimal management, and Azure Container Apps for serverless, event-driven microservices. Choosing the right service depends on the specific needs of the workload, team expertise, and desired level of control. New cloud-native projects often benefit from starting with Container Apps for its balance of simplicity and power.
Implementing the Saga pattern in microservices can improve data consistency across distributed systems. The article discusses how to leverage NestJS and Kafka for managing complex transactions in microservices architecture, providing examples and best practices for effective implementation.
Dapr, the Distributed Application Runtime, simplifies building distributed systems by offering reusable components, while Argo CD provides GitOps automation for managing Kubernetes deployments. This guide details the integration of Dapr and Argo CD to enhance microservices development, featuring step-by-step instructions for deploying applications and managing their synchronization. Key configurations for ignoring specific differences during deployment are also outlined to prevent sync conflicts.
Tail latency, or high-percentile latency, significantly impacts user experience in modern architectures with multiple service calls. As the number of parallel calls increases, the likelihood of encountering high-latency responses rises, making it crucial to monitor and understand latency statistics beyond just the mean. Effective monitoring should include awareness of high percentiles and consider customer use cases to capture the full picture of service performance.
Kafka poses significant challenges for securing cardholder data in compliance with PCI-DSS, particularly due to its lack of built-in encryption for data at rest. Kroxylicious, a Kafka protocol-aware proxy, enables end-to-end encryption of sensitive payment information without requiring code changes to existing applications, thus simplifying the implementation of security measures in a microservices architecture. The article discusses how to set up Kroxylicious to encrypt Kafka messages effectively.
The article discusses the potential of GraphQL in the context of the MCP (Microservices Control Plane), highlighting its advantages in managing data fetching and improving developer experience. It emphasizes how GraphQL can streamline operations and provide a more efficient way to interact with microservices architectures.
The article discusses the advantages of adopting microservices architecture for startups, emphasizing flexibility, scalability, and the ability to innovate rapidly. It outlines key considerations for implementation, including team structure, technology choices, and the importance of maintaining a clear communication strategy. Startups are encouraged to leverage microservices to enhance their product development and operational efficiency.
Phil Calçado discusses his experiences building AI-driven products, particularly focusing on the challenges and biases inherent in the development of AI systems within a microservices architecture. He emphasizes the importance of iterative development and shares insights from his startup, Outropy, which aimed to automate managerial tasks using generative AI. Calçado critiques common pitfalls in the AI product development process, including a tendency to build for future models rather than current technology limitations.
Tilt simplifies microservice development by automating the process from code changes to updating the development environment, ensuring services behave properly. It offers easy installation, configuration guides for various programming languages, and a community for support and contributions. Users can also follow updates and engage with the community through Slack and social media.
The article presents a unique perspective on the evolving landscape of microservices and cloud-native architectures, emphasizing the importance of managing complexity through effective server management practices. It argues against the mainstream hype surrounding microservices, advocating for a more grounded approach to implementation and maintenance. The piece highlights the necessity of understanding the underlying infrastructure to optimize performance and reliability.
The article discusses how monday.com successfully transformed their monolithic architecture into a more agile, microservices-based system using AI technology, reducing development time from eight years to just six months. It highlights the challenges faced during this transition and the innovative solutions implemented to enhance efficiency and scalability.
The article appears to focus on the concept of orchestration in the context of workflow management, particularly using the Camunda platform. It aims to demystify how orchestration can enhance business processes by integrating various microservices and automating workflows effectively.
A company that transitioned from a Ruby on Rails monolith to microservices faced significant productivity declines and challenges due to mismanagement of the architecture change. The article outlines critical considerations companies should evaluate before migrating to microservices, emphasizing that such a move is rarely necessary and often detrimental without clear justification and proper planning.
Grafana Traces Drilldown is now generally available, offering a queryless experience for tracing data that enables faster root-cause analysis in microservices environments. With features like seamless navigation between metrics and traces, built-in investigative tools, and real-time analysis capabilities, it streamlines the process for incident responders and developers to quickly identify and resolve issues. Recent updates include integrated exemplars and TraceQL streaming for improved user experience and efficiency.