langchain · LangGraph and LangChain Agents Docs
Agent Server Scale Configure LangSmith Agent Server for scale
Provides architectural best practices and configuration tuning for scaling the LangSmith Agent Server, specifically focusing on managing write load through NJOBSPERWORKER adjustments and queue worker utilization.
Derived skill
Files assembled from official documentation
Viewing SKILL.md
Agent Server Scale Configure LangSmith Agent Server for scale
Provides architectural best practices and configuration tuning for scaling the LangSmith Agent Server, specifically focusing on managing write load through NJOBSPERWORKER adjustments and queue worker utilization.
When To Use
Use when you need to optimize LangSmith Agent Server performance for high-throughput workloads or when adjusting worker concurrency to balance CPU and IO constraints.
Reference Files
| File | Contains | Use For |
|---|---|---|
SKILL.md | Entry point: scope, routing table, and workflow. | Start here. |
docs/langsmith-agent-server-scale-configure-for-workflow-guide.md | A guide detailing best practices and configuration parameters for scaling the LangSmith Agent Server write path, including NJOBSPERWORKER adjustments. | Questions about a guide detailing best practices and configuration parameters for scaling the LangSmith Agent Server write path, incl... |
examples/langsmith-agent-server-scale-configure-for-langsmith-agent-server-scale-.python | A Python code example demonstrating how to configure the LangSmith Agent Server for scaling operations. | Exact payloads, commands, or snippets shown in A Python code example demonstrating how to configure the LangSmith Agent Server for scaling operations. |
examples/langsmith-agent-server-scale-configure-for-langsmith-agent-server-scale--2.python | A Python code example demonstrating how to configure the LangSmith Agent Server for scaling operations. | Exact payloads, commands, or snippets shown in A Python code example demonstrating how to configure the LangSmith Agent Server for scaling operations. |
examples/langsmith-agent-server-scale-configure-for-langsmith-agent-server-scale--3.python | A Python code example demonstrating how to configure and interact with the LangSmith Agent Server for scaling using the langgraph-sdk. | Exact payloads, commands, or snippets shown in A Python code example demonstrating how to configure and interact with the LangSmith Agent Server for scaling using t... |
examples/langsmith-agent-server-scale-configure-for-langsmith-agent-server-scale-.yaml | A YAML configuration file demonstrating how to enable and configure the queue for scaling the LangSmith Agent Server. | Exact payloads, commands, or snippets shown in A YAML configuration file demonstrating how to enable and configure the queue for scaling the LangSmith Agent Server. |
examples/langsmith-agent-server-scale-configure-for-langsmith-agent-server-scale-.text | A text-based example demonstrating how to calculate and configure available jobs for scaling the LangSmith Agent Server. | Exact payloads, commands, or snippets shown in A text-based example demonstrating how to calculate and configure available jobs for scaling the LangSmith Agent Server. |
examples/langsmith-agent-server-scale-configure-for-langsmith-agent-server-scale--2.text | A text file containing the mathematical formula for calculating throughput per second for the LangSmith Agent Server. | Exact payloads, commands, or snippets shown in A text file containing the mathematical formula for calculating throughput per second for the LangSmith Agent Server. |
examples/langsmith-agent-server-scale-configure-for-langsmith-agent-server-scale--3.text | A text-based calculation formula for determining the required number of queue workers based on throughput and execution time. | Exact payloads, commands, or snippets shown in A text-based calculation formula for determining the required number of queue workers based on throughput and executi... |
examples/langsmith-agent-server-scale-configure-for-langsmith-agent-server-scale--2.yaml | A YAML configuration example for scaling LangSmith Agent Server with low read and high write request ratios. | Exact payloads, commands, or snippets shown in A YAML configuration example for scaling LangSmith Agent Server with low read and high write request ratios. |
examples/langsmith-agent-server-scale-configure-for-langsmith-agent-server-scale--3.yaml | A YAML configuration for scaling the LangSmith Agent Server to handle high read and low write request loads. | Exact payloads, commands, or snippets shown in A YAML configuration for scaling the LangSmith Agent Server to handle high read and low write request loads. |
examples/langsmith-agent-server-scale-configure-for-langsmith-agent-server-scale--4.yaml | A YAML configuration for scaling the LangSmith Agent Server with specific resource requests and limits for API, queue, redis, and postgres components. | Exact payloads, commands, or snippets shown in A YAML configuration for scaling the LangSmith Agent Server with specific resource requests and limits for API, queue... |
examples/langsmith-agent-server-scale-configure-for-langsmith-agent-server-high-t.yaml | A YAML configuration file defining resource requests, limits, and replica counts for scaling LangSmith Agent Server to handle high read and write loads. | Exact payloads, commands, or snippets shown in A YAML configuration file defining resource requests, limits, and replica counts for scaling LangSmith Agent Server t... |
examples/langsmith-agent-server-scale-configure-for-langsmith-agent-server-autosc.yaml | A YAML configuration file demonstrating how to enable and set replica limits for autoscaling the LangSmith agent server and queue. | Exact payloads, commands, or snippets shown in A YAML configuration file demonstrating how to enable and set replica limits for autoscaling the LangSmith agent serv... |
What This Skill Covers
-
Documentation Index Fetch the complete documentation index at: https://docs.langchain.com/llms.txt Use this file to discover all available pages before ex...
- Main sections:
Scaling for write load,Best practices for scaling the write path,Change NJOBSPERWORKER based on assistant characteristics,Avoid synchronous blocking operations,Minimize redundant checkpointing.
Workflow
- Open the most relevant file under
docs/for the exact documented workflow and wording. - Open
schemas/files for exact structured contracts. - Open
examples/files for concrete requests, commands, snippets, and manifests. - Do not add behavior or configuration that is not present in the attached source files.
Canonical source: https://docs.langchain.com/langsmith/agent-server-scale.md