Set up LangSmith to debug, trace, and monitor your agents from the LangSmith dashboard. Before starting, complete the quickstart guide to have an agent running on Idun Agent Platform.Documentation Index
Fetch the complete documentation index at: https://docs.idunplatform.com/llms.txt
Use this file to discover all available pages before exploring further.
Set up LangSmith observability
Get your LangSmith API key
If you do not have a LangSmith API key yet:
- Go to LangSmith
- Sign up or log in to your account
- Navigate to Settings (gear icon) > API Keys
- Click Create API Key
- Copy your API Key
Create an observability configuration
- On the Idun Agent Platform main page, navigate to Observability
- Click Add configuration
- Select LangSmith
- Enter a Configuration Name (for example, “LangSmith Prod”)
- Fill in the required details:
- API Key: Your LangSmith API key (starts with
lsv2-...) - Project Name: The name of the project in LangSmith (for example,
defaultorprod-agent) - Project ID: (Optional) The specific project identifier if needed
- Endpoint: (Optional) Custom endpoint if you are self-hosting LangSmith (for example,
https://api.smith.langchain.com) - Tracing Enabled: Toggle to enable or disable tracing globally
- Capture Inputs/Outputs: Toggle to log full text of inputs and outputs
- API Key: Your LangSmith API key (starts with
- Click Create configuration
Attach LangSmith to your agent
- Navigate to the agent you want to trace
- Click Edit Agent
- Click Next to reach the observability configuration step
- Select LangSmith as the observability provider
- Select the LangSmith configuration you want to use
- Click Next
- Click Save changes to finalize
View observability data
Once your agent is running with observability enabled:- Interact with your agent through the Manager UI or API
- Open your LangSmith dashboard at smith.langchain.com
- Navigate to your project to view traces
Best practices
- Use distinct projects for development and production environments
- Tag runs to filter traces when investigating specific issues (configured within agent logic)
- Review error traces in LangSmith to identify and resolve problems quickly
Troubleshooting
Observability not working?
- Check API key: Verify it is valid and has the required permissions
- Verify project name: Traces are sent to the “default” project if the project name is not specified or is incorrect
- Check tracing toggle: Confirm the tracing toggle is enabled in the configuration