HGMem is a framework that improves the ability of large language models to tackle sense-making questions by using hypergraph-based memory structures. It adapts dynamically to specific questions, outperforming traditional retrieval-augmented generation (RAG) methods when direct answers aren't available in documents.

This article introduces a Python script called runprompt that allows users to execute .prompt files for language models directly from the command line. It outlines how to create prompt templates, pass inputs, and utilize tools for various operations within the shell environment.

FastMCP 2.0 is a comprehensive framework for building production-ready Model Context Protocol (MCP) applications, offering advanced features like enterprise authentication, deployment tools, and testing utilities. It simplifies server creation for LLMs through a high-level Python interface, making it easy to expose data and functionality while handling complex protocol details. FastMCP stands out with its robust authentication options and support for various deployment scenarios.

Tiny Agents in Python allows developers to create agents using the Model Context Protocol (MCP) to seamlessly integrate external tools with Large Language Models (LLMs). The article guides users through setting up a Tiny Agent, executing commands, and customizing agent configurations while highlighting the simplicity of building these agents in Python. It emphasizes the advantages of using MCP for managing tool interactions without the need for custom integrations.

oLLM is a lightweight Python library designed for large-context LLM inference, allowing users to run substantial models on consumer-grade GPUs without quantization. The latest update includes support for various models, improved VRAM management, and additional features like AutoInference and multimodal capabilities, making it suitable for tasks involving large datasets and complex processing.

The smartfunc library allows users to convert docstrings into functions that interact with language models, simplifying prompt generation and execution. It leverages the llm library's capabilities while providing a user-friendly interface, including support for Pydantic models, async operations, and debugging features. This makes it suitable for rapid prototyping and ease of use in various applications.

MarkItDown is a Python utility designed for converting various file types into Markdown format, facilitating integration with large language models (LLMs) and text analysis tools. The recent update introduced breaking changes, improved handling of file-like streams, and added support for optional dependencies to enhance functionality. Users can easily install and use MarkItDown for a variety of document types, including PowerPoint, Word, and audio files, while also supporting third-party plugins.

LangExtract is a Python library designed to extract structured information from unstructured text using large language models (LLMs) based on user-defined prompts. It features precise source grounding, reliable output formats, interactive visualizations, and supports both cloud-based and local LLMs, making it adaptable to various domains without the need for fine-tuning. Users can easily set up API keys for cloud models and extend functionality with custom model providers.