3 links tagged with all of: scaling + performance + database
Click any tag below to further narrow down your results
Links
This article details how OpenAI scaled PostgreSQL to handle the massive traffic from 800 million ChatGPT users. It discusses the challenges faced during high write loads, optimizations made to reduce strain on the primary database, and strategies for maintaining performance under heavy demand.
Pinecone's Dedicated Read Nodes (DRN) offer exclusive infrastructure for high-demand applications, providing predictable performance and cost. They allow for dedicated capacity without the interference of other workloads, making them suitable for tasks like semantic search and real-time recommendation systems. Users can scale their workloads easily by adjusting replicas and shards.
Recall.ai faced significant performance issues with their Postgres database due to the high concurrency of NOTIFY commands used during transactions, which caused global locks and serialized commits, leading to downtime. After investigating, they discovered that the LISTEN/NOTIFY feature did not scale well under their workload of tens of thousands of simultaneous writers. They advise against using LISTEN/NOTIFY in high-write scenarios to maintain database performance and scalability.