5 links
tagged with all of: database + sqlite
Click any tag below to further narrow down your results
Links
SQLite query optimization significantly improved the performance of the Matrix Rust SDK, boosting event processing from 19,000 to 4.2 million events per second. The article details the structure of data persistence using LinkedChunk and how identifying and addressing inefficiencies in SQL queries led to this enhancement. It emphasizes the importance of profiling tools and strategic indexing to optimize database interactions.
The article discusses optimizing SQLite indexes to improve query performance, highlighting the importance of composite indexes over multiple single-column indexes and the significance of index column order. By understanding SQLite's query planner and utilizing techniques like partial indexes, the author achieved a 35% speedup in query execution for their application, Scour, which handles a rapidly increasing volume of content.
The article discusses the implementation of checksums in SQLite's Write-Ahead Logging (WAL) mode, detailing how they ensure data integrity and consistency. It explores the algorithms used for the checksums and their impact on performance and reliability during database operations. Additionally, it highlights potential issues that can arise without proper checksum validation.
Copying large SQLite databases can be inefficient due to the presence of indexes, which increase file size and transfer time. By using SQLite's .dump command to create a compressed text file of the database, users can significantly reduce the size for faster transfers while ensuring data consistency during the copying process. This method has proven to save time and improve reliability when handling large databases.
Turso Database is a new in-process SQL database written in Rust that is compatible with SQLite and currently in BETA. It supports features like change data capture, asynchronous I/O, cross-platform capabilities, and enhanced schema management, with a focus on reliability and community contributions. Experimental features include encryption at rest and incremental computation, and it is designed for future developments like vector indexing for fast searches.