1 link tagged with all of: kafka + event-processing + postgresql + dead-letter-queue + retry-mechanism
Links
This article discusses a system built for Wayfair that uses PostgreSQL as a Dead Letter Queue (DLQ) to manage failed event processing. Instead of using Kafka for failed events, the system stores them in a PostgreSQL table, allowing for better visibility and easier reprocessing. It also outlines a retry mechanism with exponential backoff to prevent flooding the DLQ with transient failures.
postgresql ✓
kafka ✓
dead-letter-queue ✓
retry-mechanism ✓
event-processing ✓