Alternatives

Open Source Alternatives to LangSmith

LangSmith alternatives listed by the directory.

Open Source Alternatives to LangSmith

Use the same directory search, ordering, and pagination controls inside this collection.

10 of 10 tools

Agenta

MIT

Open-source LLMOps platform providing prompt management, evaluation, and observability tools for building robust AI applications with team collaboration.

HumanloopLangSmithPromptLayer
4.2K StarReactMIT1 day ago
547 forksCodexClassroom

Agno

Apache-2.0

Open-source platform that enables developers to create, deploy and monitor AI agents with built-in memory, knowledge integration, and external tool connectivity.

Relevance AILangSmithCrewAI Enterprise
41K StarReactApache-2.020 hours ago
5.5K forksCodexClassroom

Arize Phoenix

Unknown

Open-source platform for LLM tracing, evaluation, and optimization. Features automatic instrumentation, prompt playground, and real-time AI application monitoring.

LangSmithLangChainHumanloop
10K StarLlmUnknown14 hours ago
921 forksCodexClassroom

Laminar

Apache-2.0

Laminar is an open-source platform that helps collect, understand, and utilize data for building high-quality LLM applications.

LangSmithHumanloopBraintrust
3.0K StarLlmApache-2.023 hours ago
205 forksCodexClassroom

Langfuse

Unknown

Langfuse provides tracing, evaluations, prompt management, and analytics to debug and improve LLM applications.

LangSmithLangChainHumanloop
29K StarLlmUnknown19 hours ago
3.0K forksCodexClassroom

Latitude

MIT

Traces AI agents in production, automatically clusters failures into issues, generates evals from real failures, and alerts you when something breaks or regresses.

LangSmithHumanloopWeightsBiases
4.1K StarLlmMIT11 hours ago
329 forksCodexClassroom

Mem0

Apache-2.0

Adds persistent, searchable memory to AI agents and apps, so they remember user preferences and past interactions across sessions without pipeline changes.

LangSmithPineconeZep Cloud
58K StarLlmApache-2.021 hours ago
6.7K forksCodexClassroom

OpenLIT

Apache-2.0

Open-source observability platform for GenAI and LLM applications. Real-time monitoring, distributed tracing, prompt management, and AI model evaluation built on OpenTelemetry.

LangSmithDatadogNew Relic
2.5K StarLlmApache-2.02 days ago
298 forksCodexClassroom

OpenLLMetry

Apache-2.0

Open-source observability platform for LLMs using OpenTelemetry. Monitor performance, track costs, and debug AI applications with just 2 lines of code.

DatadogLangSmithNew Relic
7.2K StarLlmApache-2.02 days ago
992 forksCodexClassroom

Helicone

Apache-2.0

Open-source platform for logging, monitoring, and debugging LLM applications. Route, debug, and analyze AI apps with comprehensive observability tools.

LangSmithDatadogNew Relic
5.8K StarReactApache-2.03 days ago
600 forksCodexClassroom