Tools & Frameworks

A browser extension that brings Claude AI directly into the Chrome browser. Enables users to interact with Claude while browsing, summarize web pages...

An open-source AI code assistant that runs in VS Code and JetBrains. Continue allows developers to use any LLM (local or cloud) for code completion,...

A PostgreSQL extension for vector similarity search. pgvector adds vector data types and similarity search operators to PostgreSQL, enabling semantic...

A modern web framework for building fast, content-focused websites. Astro pioneered the "islands architecture" where interactive components load ind...

A Microsoft framework for building multi-agent conversational systems where agents communicate through message passing. AutoGen models agent interacti...

An experimental open-source project that chains LLM calls to autonomously achieve goals defined by the user. AutoGPT pioneered the concept of "autonom...

A framework for orchestrating role-playing AI agents that work together as a "crew" to accomplish complex tasks. CrewAI emphasizes agent specializatio...

An open-source framework by deepset for building production-ready LLM applications, with strong focus on RAG and search. Haystack uses a pipeline abst...

A framework for developing applications powered by language models. LangChain provides modular abstractions for building chains (sequential LLM calls...

A library for building stateful, multi-actor applications with LLMs, built on top of LangChain. LangGraph models agent workflows as graphs where nodes...

An agent framework focused on long-term memory and stateful AI assistants. Originally known as MemGPT, Letta implements a memory hierarchy that allow...

A data framework for LLM applications, specializing in connecting LLMs to external data sources. LlamaIndex provides sophisticated indexing, retrieval...

NVIDIA's toolkit for adding programmable guardrails to LLM applications. NeMo Guardrails uses a domain-specific language (Colang) to define conversa...

A configuration and enhancement framework for OpenCode that provides opinionated defaults, curated skills, and productivity improvements. Similar to...

Microsoft's open-source browser automation framework for end-to-end testing and web scraping. Playwright supports Chromium, Firefox, and WebKit brows...

Retrieval Augmented Generation Assessment - a framework for evaluating RAG pipelines. RAGAS provides reference-free metrics to evaluate retrieval qua...

A Microsoft SDK for integrating LLMs into applications with enterprise-grade patterns. Semantic Kernel emphasizes plugins (skills), planners, and memo...

An open-source AI agent framework by Jesse Vincent (obra) focused on building powerful, composable AI assistants. Superpowers provides a modular arch...

An open-source embedding database designed for AI applications. Chroma provides a simple API for storing and querying embeddings, with a focus on deve...

A Python framework for validating LLM outputs. Guardrails AI provides validators for checking response quality, safety, and structure. It can automa...

A Python library for structured output extraction from LLMs using Pydantic models. Instructor patches LLM clients to return validated, typed objects i...

Meta's open-weight large language model family released in 2024. Llama 3 models are available in 8B and 70B parameter sizes with competitive perform...

Meta's safety classifier model for LLM applications. Llama Guard is a fine-tuned Llama model that classifies prompts and responses according to safe...

A collection of Model Context Protocol (MCP) server implementations that extend AI assistants with various capabilities. The official repository inc...

Meta's family of open-weight LLMs, including Llama 2 and Llama 3. Llama models can be downloaded and run locally or fine-tuned, making them the founda...

A library for fast and memory-efficient LLM fine-tuning. Unsloth optimizes the training loop with custom CUDA kernels, enabling 2-5x faster fine-tuni...

An autonomous AI coding methodology that runs AI agents in continuous bash loops until specifications are verifiably complete. Named after the persis...

An AI safety company offering the Claude family of LLMs. Known for research on AI alignment and Constitutional AI. Claude models are competitive with ...

An ML observability platform that has expanded to support LLM applications. Arize provides monitoring, tracing, and evaluation for both traditional M...

Cloudflare's JAMstack platform for deploying static sites and full-stack applications. Pages provides automatic builds from Git repositories, global ...

Cloudflare's serverless compute platform that runs JavaScript, TypeScript, and WebAssembly at the edge. Workers execute in V8 isolates with milliseco...

An enterprise-focused AI company offering LLMs and embeddings optimized for business applications. Cohere is known for strong embedding models (Embed ...

An open-source LLM application development platform with visual workflow builder. Dify provides a no-code/low-code interface for building chatbots, ...

A cloud platform providing secure sandboxed environments for AI agents to execute code. E2B offers isolated, ephemeral virtual machines where AI-gen...

A distributed search and analytics engine that now includes vector search capabilities. Originally built for full-text search, Elasticsearch added d...

An open-source low-code platform for building LLM applications with a drag-and-drop interface. Flowise is built on top of LangChain and LlamaIndex, ...

Google's comprehensive cloud computing platform offering infrastructure, compute, storage, databases, AI/ML services, and developer tools. GCP inclu...

Google Cloud's unified ML platform that includes access to Gemini models, PaLM, and other Google AI capabilities. Vertex AI provides model serving, ...

Google's multimodal AI model family, available through Vertex AI and the Gemini API. Gemini models are natively multimodal, processing text, images, a...

Google's AI-powered application development platform that enables rapid prototyping and deployment of AI applications. Stitch provides a visual inte...

An open-source observability platform for LLM applications. Helicone acts as a proxy layer that logs all LLM API calls, providing analytics, caching,...

The central hub for machine learning models, datasets, and applications. Hugging Face provides model hosting, the Transformers library, dataset mana...

A data-centric AI platform for creating and managing training data. Labelbox provides annotation tools, workflow management, and model-assisted label...

An open-source LLM engineering platform for observability, analytics, and evaluation. Langfuse provides tracing for LLM applications, prompt manageme...

A developer platform for debugging, testing, evaluating, and monitoring LLM applications. Built by LangChain, LangSmith provides tracing, prompt pla...

An open-source vector database built for scalable similarity search and AI applications. Milvus supports billion-scale vector search with high perfor...

A French AI company known for efficient, open-weight models that punch above their parameter count. Mistral's models are popular for their quality-to-...

A cloud platform for running compute-intensive Python applications, particularly popular for ML inference, training, and AI agent workloads. Modal p...

A workflow automation platform that has added AI capabilities. n8n connects apps, APIs, and AI models with a visual workflow builder. It includes no...

The leading commercial LLM provider, offering GPT-4, GPT-4o, o1, and other models via API. OpenAI defined many standards in the LLM space—their API fo...

An AI gateway and observability platform for LLM applications. Portkey provides a unified API to access 200+ LLMs, with built-in features for reliab...

A high-performance open-source vector database written in Rust. Qdrant focuses on speed and efficiency, with advanced filtering capabilities and suppo...

A data labeling and AI infrastructure platform. Scale AI provides human-in-the-loop data annotation, evaluation services, and enterprise AI infrastru...

A data-centric AI platform focused on programmatic labeling and data development. Snorkel pioneered weak supervision - using labeling functions to p...

A cloud platform for deploying and hosting web applications with a focus on frontend frameworks and serverless functions. Vercel pioneered the "deplo...

An open-source vector database with built-in vectorization modules and GraphQL API. Weaviate emphasizes ease of use with automatic embedding generatio...

An ML experiment tracking and model management platform that has expanded to support LLM development. W&B provides experiment logging, hyperparameter...

An MCP (Model Context Protocol) server that exposes Playwright browser automation capabilities to AI assistants. Enables AI agents to navigate web p...

A fully managed service from AWS that provides access to foundation models from multiple providers through a single API. Bedrock offers models from ...

Microsoft's enterprise offering of OpenAI models through Azure. Provides access to GPT-4, GPT-3.5, DALL-E, Whisper, and embedding models with Azure'...

Anthropic's third-generation model family released in March 2024, featuring three tiers: Haiku (fast/cheap), Sonnet (balanced), and Opus (most capabl...

Anthropic's mid-generation update to Claude 3, with Claude 3.5 Sonnet released in June 2024. Despite being a "Sonnet" tier model, 3.5 Sonnet matched...

Anthropic's fourth-generation model family representing the latest frontier of Claude capabilities. Claude 4 builds on the foundation of Claude 3 wit...

A collaborative AI workspace from Anthropic that enables multiple users and Claude instances to work together on shared projects. Cowork provides pe...

An AI code assistant offering free unlimited autocomplete for individual developers. Codeium provides code completion, chat, and search across 70+ l...

A documentation retrieval service that provides AI coding assistants with up-to-date library and framework documentation. Context7 indexes official ...

A secrets management platform that provides secure storage, syncing, and injection of environment variables and API keys across development, staging,...

Google's multimodal AI model family, successor to PaLM. Gemini models are natively multimodal, trained from the ground up on text, images, audio, an...

An AI-powered code completion and assistance tool integrated into code editors. GitHub Copilot uses OpenAI Codex (and newer models) to suggest code ...

OpenAI's flagship large language model family released in March 2023. GPT-4 introduced multimodal capabilities (text and image input), significantly ...

An optimized variant of GPT-4 released in November 2023 with a 128K context window, updated knowledge cutoff, and significantly lower pricing. GPT-4 ...

OpenAI's omni model released in May 2024, designed to handle text, audio, image, and video inputs with unified architecture. GPT-4o offers GPT-4-leve...

A search AI company providing embedding models, rerankers, and search infrastructure. Jina offers open-weight embedding models (jina-embeddings), a ...

Mistral AI's flagship large language model, competing at the frontier with GPT-4 and Claude. Mistral Large offers strong multilingual performance, p...

OpenAI's reasoning-focused model family released in late 2024. o1 models use extended "thinking" time to solve complex problems, particularly excell...

OpenAI's advanced reasoning model announced in late 2024, building on the o1 architecture with enhanced reasoning capabilities. o3 achieved breakthro...

A managed vector database service designed for production AI applications. Pinecone handles the infrastructure complexity of vector search at scale, o...

A specialized embedding model provider focused on retrieval-optimized embeddings. Voyage AI offers embedding models trained specifically for search ...

A memory layer for AI assistants and agents. Zep provides long-term memory, conversation history management, and user context for LLM applications. ...

A tool for fine-tuning LLMs with a focus on ease of use and flexibility. Axolotl supports various fine-tuning methods (full, LoRA, QLoRA), multiple ...

Anthropic's official CLI-based AI coding assistant. Claude Code provides agentic coding capabilities directly in the terminal, including code generat...

Anthropic's desktop application for Claude that supports the Model Context Protocol (MCP). Claude Desktop allows users to connect Claude to local too...

An AI-first code editor built as a fork of VS Code. Cursor deeply integrates AI capabilities including code completion, chat, multi-file editing, and...

A fast, feature-rich terminal emulator written in Zig by Mitchell Hashimoto (HashiCorp co-founder). Ghostty emphasizes performance, correctness, and ...

A unified interface for calling 100+ LLM providers using the OpenAI API format. LiteLLM acts as a translation layer—write code once using the OpenAI f...

A C/C++ implementation of LLM inference optimized for running on consumer hardware without GPUs. llama.cpp pioneered efficient CPU inference and quant...

A desktop application for running LLMs locally with a user-friendly GUI. LM Studio provides model discovery, downloads, chat interface, and local API ...

A tool for running LLMs locally with a simple CLI and API. Ollama makes local LLM deployment accessible by handling model downloads, quantization, and...

An open-source AI coding assistant that runs in the terminal. OpenCode provides agentic coding capabilities including code generation, editing, file ...

A test framework for evaluating and red-teaming LLM applications. Promptfoo enables systematic testing of prompts across different models, comparing ...

Hugging Face's production-ready inference server for LLMs. TGI provides high-performance serving with features like continuous batching, tensor parall...

Microsoft's free, open-source code editor that has become the dominant IDE for modern software development. VS Code features an extensive extension ...

A high-throughput LLM inference and serving library using PagedAttention for efficient memory management. vLLM is the leading open-source solution for...