1. LangSmith
Connect prompt development with evaluations and production traces
LangSmith combines prompt development, tracing, datasets, and evaluation for LLM applications. Teams can inspect application runs, turn useful examples into test datasets, and compare revisions before deploying changes. Its prompt playground and management capabilities connect experimentation to the surrounding application behavior, rather than treating each prompt as an isolated text file. LangSmith works beyond LangChain-based applications through supported integrations and instrumentation. It is particularly useful when developers need to understand whether a failure came from instructions, retrieved context, tool use, or another application step.
Pros
- Combines prompt workflows with detailed application tracing
- Supports datasets, experiments, and evaluation workflows
- Usable with applications that do not rely on LangChain
Cons
- Full value depends on application instrumentation
- Tracing and evaluation usage require cost monitoring
