20 links
tagged with sqlite
Click any tag below to further narrow down your results
Links
Durable Execution (DE) engines allow for the persistence of multi-step workflows, enabling them to resume from the last successful step after interruptions. This article explores the development of a simple DE engine called Persistasaurus in Java, which utilizes SQLite for logging execution state and highlights key implementation choices.
The article discusses the importance of choosing technologies that ensure longevity and minimize maintenance, highlighting sqlite's perceived drawbacks as essential features that promote backward compatibility. It argues that warts in technology can be beneficial as they indicate careful consideration for future-proofing applications. The author emphasizes the value of web technologies for their stability over time compared to desktop and mobile applications.
ZeQL+ is a lightweight, open-source command-line tool that allows users to quickly access and interact with SQLite database files across multiple operating systems, including macOS, Linux, and Windows. It features a fast, paginated view of database tables and the ability to run custom SQL queries without any installation dependencies. Pre-built binaries are available for easy setup, and users can also build the tool from source using V programming language.
SQLiteData is a lightweight and efficient alternative to SwiftData, utilizing SQL for data management and supporting CloudKit synchronization. It allows for easy integration with SwiftUI and UIKit through property wrappers that simplify database interactions. The library is built on the GRDB framework and is designed to be accessible for developers familiar with SQLite concepts.
The article discusses optimizing SQLite indexes to improve query performance, highlighting the importance of composite indexes over multiple single-column indexes and the significance of index column order. By understanding SQLite's query planner and utilizing techniques like partial indexes, the author achieved a 35% speedup in query execution for their application, Scour, which handles a rapidly increasing volume of content.
SQLite query optimization significantly improved the performance of the Matrix Rust SDK, boosting event processing from 19,000 to 4.2 million events per second. The article details the structure of data persistence using LinkedChunk and how identifying and addressing inefficiencies in SQL queries led to this enhancement. It emphasizes the importance of profiling tools and strategic indexing to optimize database interactions.
The article discusses the implementation of checksums in SQLite's Write-Ahead Logging (WAL) mode, detailing how they ensure data integrity and consistency. It explores the algorithms used for the checksums and their impact on performance and reliability during database operations. Additionally, it highlights potential issues that can arise without proper checksum validation.
Base is a user-friendly SQLite database editor for macOS that simplifies database management with features like a visual table editor, schema inspector, and SQL query tools. It allows users to browse, filter, and edit data effortlessly, while also supporting data import and export in various formats. The free version has limited features, with a one-time purchase required for the full version.
SQLite JS is an extension that integrates JavaScript functionality into SQLite, allowing users to create custom functions, aggregates, and collations directly within their databases. It supports various types of functions including scalar, aggregate, window functions, and enables JavaScript evaluation, enhancing data manipulation capabilities. Installation instructions and examples for using the extension across different platforms are provided for developers.
Copying large SQLite databases can be inefficient due to the presence of indexes, which increase file size and transfer time. By using SQLite's .dump command to create a compressed text file of the database, users can significantly reduce the size for faster transfers while ensuring data consistency during the copying process. This method has proven to save time and improve reliability when handling large databases.
A Python application that syncs Gmail messages to a local SQLite database, allowing for incremental or full sync options, multi-threaded performance, and robust error handling. Users can manage their email data effectively with customizable sync commands and a structured database schema for analysis.
LiveStore is a robust client-centric data layer designed to enhance app development with a reactive SQLite database and real-time synchronization capabilities. It supports various platforms and offers features like flexible data modeling, offline-first workflows, and custom merge conflict resolution, making it a suitable alternative to libraries such as Redux and MobX. Developers can utilize instant queries and change events that sync seamlessly across clients and tabs.
The article discusses the use of SQLite in Rails applications, highlighting both its advantages and the potential pitfalls that can lead to outages or data loss. It emphasizes the importance of proper deployment practices, such as ensuring persistent storage for the SQLite database, and explores strategies for managing database contention and scaling applications effectively.
Antoine shares his experiences developing a local-first app that syncs a SQLite database with a remote server, focusing on challenges and solutions regarding reactivity and performance. After experimenting with various tools, he outlines a minimal sync engine tailored for a single-player notes application.
The article describes how the author created a useful AI assistant using only a single SQLite table and a few cron jobs. It outlines the simplicity and efficiency of the setup, highlighting the potential for such a solution in personal productivity and automation.
The article explores the potential benefits of using SQLite as a container for the OpenDocument Presentation format (ODP) instead of the current ZIP archive structure. It discusses improvements in document size, performance, memory usage, crash recovery, and accessibility, suggesting that a simple SQLite database could enhance future file format designs without altering the core functionalities of OpenDocument.
aiosqlitepool is a high-performance connection pool designed for asyncio SQLite applications, enhancing database performance by reusing long-lived connections to eliminate overhead and maximize concurrent throughput. It is not a replacement for SQLite drivers but acts as a performance layer, allowing for faster query execution and improved application efficiency under heavy loads. Proper configuration and usage patterns are essential for maximizing its benefits in various application scenarios.
Turso Database is a new in-process SQL database written in Rust that is compatible with SQLite and currently in BETA. It supports features like change data capture, asynchronous I/O, cross-platform capabilities, and enhanced schema management, with a focus on reliability and community contributions. Experimental features include encryption at rest and incremental computation, and it is designed for future developments like vector indexing for fast searches.
The GitHub repository jzombie/sqlite-sqllogictest-corpus contains a minimal Docker setup for cloning the official SQLite SQLLogicTest Fossil repository and copying its test corpus into a local directory. This setup allows users to easily obtain a fresh snapshot of SQLite's SQLLogicTest cases for testing purposes. Instructions for building the Docker image and extracting the tests are provided in the README file.
The article presents the GitHub repository "sqlite3-dump," a fast converter for SQLite3 databases to CSV and Parquet formats, developed in Rust. It highlights the tool's zero-copy parsing capabilities and performance improvements over traditional SQLite exports, showcasing its speed with large datasets. The project is licensed under Apache-2.0 and is intended for users needing efficient data export solutions.