Top RAG Tools for Developers

llm · optimization · rag

LLM application framework with auto-optimization — auto-tune prompts and RAG pipelines like PyTorch

local-llm · rag · chatbot

All-in-one AI application for building private, custom chatbots using any LLM on your own documents and data.

rag · optimization · open-source

Automated RAG optimization tool that finds the best RAG pipeline configuration for your data automatically.

chunking · rag · open-source

Fast and lightweight text chunking library optimized for RAG pipelines with multiple chunking strategies.

vector-db · rag · embeddings

Open-source embedding database designed for AI-native applications, easy to run locally or in the cloud.

llm · enterprise · open-weights

Cohere's flagship enterprise LLM. 111B parameters, 256K context, open-weights. Optimized for agentic tasks, tool use, and multilingual enterprise RAG with grounded citations.

llm · rag · enterprise

Enterprise-grade LLM optimized for RAG and tool use — Cohere's flagship model for production agents

embeddings · rag · search

Enterprise-grade multilingual embeddings API for semantic search, classification, and RAG pipelines.

rag · vision · document

Efficient document retrieval with vision language models — retrieve PDF pages using visual embeddings

llm · cohere · enterprise

Cohere's most capable enterprise LLM with advanced RAG support and business-grade reliability.

evaluation · testing · llm

Unit testing framework for LLM apps with 14+ built-in metrics. Hallucination detection, RAG evaluation, works like Pytest.

platform · workflow · rag

Open-source LLM app development platform. Visual workflow builder for RAG pipelines, AI agents, and chatbots. 60K+ GitHub stars. Self-host or Dify Cloud. Supports 50+ model providers.

enterprise · agent-builder · rag

Enterprise AI assistant platform for building custom AI agents that connect to company data (Notion, Slack, GitHub, Salesforce). No-code agent builder with RAG.

search · api · semantic

Semantic search API for AI apps — searches the web by meaning, not keywords

embeddings · bge · rag

State-of-the-art open-source embedding models — BGE series, top MTEB leaderboard performance

rag · pipeline · framework

Open-source LLM app framework by deepset. Pipeline abstraction, modular RAG, and agent building for production use.

embeddings · api · multimodal

Multimodal embedding and search API — state-of-the-art embeddings for text, image, and code

rag · document · local

Open-source RAG-based document chat app. Supports multi-document Q&A, multi-modal (images in PDF), plug-in LLMs and vector stores. Clean local UI for researchers and developers.

framework · llm · rag

Building applications with LLMs through composability

low-code · visual · rag

Low-code visual builder for RAG and multi-agent AI workflows, powered by LangChain

rag · knowledge-graph · retrieval

Graph-enhanced RAG system that builds a knowledge graph from documents and enables graph-aware retrieval. Handles complex multi-hop questions far better than naive chunking.

rag · parsing · cloud

Managed document parsing and indexing service by LlamaIndex. Production-grade RAG infrastructure with LlamaParse.

parsing · rag · pdf

Advanced document parser for RAG — extracts structured data from PDFs, tables, and complex docs

privacy · local-llm · rag

Chat with your documents using local LLMs — 100% private, no data sent to the cloud.

typescript · rag · memory

TypeScript AI agent framework with built-in memory, tools, RAG, and workflow orchestration

vector-db · open-source · similarity-search

Open-source vector database built for scalable AI similarity search

embeddings · reranking · rag

State-of-the-art embedding and reranking models for semantic search and RAG pipelines.

visualization · embeddings · data-exploration

Interactive AI data map for visualizing, exploring, and understanding large embedding datasets.

embeddings · open-source · rag

Open-source, high-performance text embeddings model — 8192 token context, fully reproducible

api · stateful · rag

OpenAI's stateful agent API. Built-in thread management, file search (RAG), code interpreter, and function calling. Build AI assistants without managing context windows.

vector-db · postgresql · open-source

Open-source PostgreSQL extension for vector similarity search — no separate DB needed

vector-database · rag · managed

Vector database for machine learning applications

privacy · local-llm · rag

100% private local RAG — interact with your documents offline using LLMs without data leaving your machine.

vector-database · rag · search

Vector search engine for AI applications

vector-database · cloud · rag

Managed cloud version of the high-performance Qdrant vector database. Supports hybrid search for RAG and semantic search.

evaluation · rag · testing

Evaluation framework for RAG pipelines. Automatically measures retrieval accuracy, faithfulness, and answer relevance.

rag · document · open-source

Open-source RAG engine with deep document understanding. Handles PDFs, Word, Excel, images with layout-aware parsing. Built-in chunking strategies, citation, and chat UI.

parsing · rag · pdf

Document parsing API for RAG — accurate extraction from PDFs, tables, and complex layouts

vector-database · postgresql · pgvector

Vector storage built on PostgreSQL + pgvector, seamlessly integrated with the Supabase platform. Great for RAG apps.

search · api · agent

Search API built for AI agents — fast, accurate web search with structured results

evaluation · observability · rag

LLM app evaluation and observability tool. Feedback functions evaluate hallucination, context relevance, and RAG triad.

data-ingestion · document-parsing · rag

Open-source library for parsing PDFs, HTML, and documents into LLM-ready data

evaluation · observability · rag

Open-source LLM observability and evaluation platform with 20+ predefined checks for RAG pipelines and agents.

embeddings · rag · semantic-search

Specialized embedding API for high-accuracy semantic search and RAG, with domain-optimized models for code and finance.

vector-database · rag · search

Open-source vector database