Can I use Braintrust as a CLI?

Yes. KosmoKrator exposes a Braintrust CLI through kosmo integrations:call and the provider shortcut command. Commands can return JSON for scripts, CI, and coding agents.

Can I expose Braintrust through MCP?

Yes. The KosmoKrator MCP gateway can expose selected Braintrust tools to clients such as Claude Code, Cursor, Codex, and other MCP-compatible tools.

Where are Braintrust credentials stored?

Braintrust credentials are configured in KosmoKrator's local integration settings and reused by CLI, Lua, and MCP gateway surfaces.

Can I deny write access for Braintrust MCP tools?

Yes. Start the gateway with --write=deny for read-only clients, or use ask/allow only for trusted workspaces.

analytics

Braintrust MCP Gateway for AI Agents

Expose Braintrust tools to Claude Code, Cursor, Codex, and other MCP clients through the local KosmoKrator MCP gateway.

Braintrust MCP Gateway

Expose Braintrust to MCP clients with `kosmokrator mcp:serve --integration=braintrust`.

If the client has never used KosmoKrator before, install it first, then register this integration as a stdio MCP server.

Install KosmoKrator

curl -fsSL https://raw.githubusercontent.com/OpenCompanyApp/kosmokrator/main/install.sh | bash

Install gateway entry

kosmokrator mcp:gateway:install --integration=braintrust --write=deny --json

MCP configuration

{
  "mcpServers": {
    "kosmokrator-braintrust": {
      "type": "stdio",
      "command": "kosmo",
      "args": [
        "mcp:serve",
        "--integration=braintrust",
        "--write=deny"
      ]
    }
  }
}

Serve manually

kosmokrator mcp:serve --integration=braintrust --write=deny

Client Notes

Use one scoped MCP gateway entry, then adapt the config location to the client or framework.

Claude Code Connect local KosmoKrator integrations to Claude Code through one scoped MCP gateway entry. Claude Code can launch the local kosmo binary directly from the project MCP config.

Cursor Expose selected local integrations to Cursor through KosmoKrator without configuring each service as its own MCP server. Use the same KosmoKrator install and integration credentials that power terminal and headless runs.

Codex Use KosmoKrator as a local MCP proxy for Codex so coding sessions can reach selected integrations with explicit write policy. Keep write access denied or ask-based unless the workspace is trusted.

OpenAI Agents SDK Attach KosmoKrator integration tools to OpenAI Agents SDK workflows through a local MCP gateway. Use headless JSON commands for CI-style execution and MCP for agent tool discovery.

Claude Agent SDK Give Claude Agent SDK workflows access to KosmoKrator integrations through a local MCP server. Use a narrow integration list so the agent does not load unrelated tools.

Vercel AI SDK Use KosmoKrator as a local integration gateway for Vercel AI SDK agents and scripts. Prefer CLI JSON calls when a workflow only needs one deterministic integration operation.

LangChain Bridge LangChain agents to local KosmoKrator integration tools through MCP or headless CLI calls. Keep the gateway scoped to the integration and operation class needed by the chain.

LangGraph Run KosmoKrator integration calls from LangGraph nodes while preserving local credentials and permissions. Headless CLI calls fit repeatable graph edges; MCP fits exploratory agent nodes.

CrewAI Expose KosmoKrator integrations to CrewAI workers as scoped local tools. Use per-worker integration scopes to avoid giving every worker every tool.

Generic MCP Clients Connect any stdio-compatible MCP client to local KosmoKrator integration tools. Start with read-only write policy and expand only for trusted projects.

MCP Tool Names

KosmoKrator exposes integration tools through the gateway with stable names.

MCP tool	Source function	Type
`integration__braintrust__braintrust_list_projects`	`braintrust.braintrust_list_projects`	Read `read`
`integration__braintrust__braintrust_create_project`	`braintrust.braintrust_create_project`	Write `write`
`integration__braintrust__braintrust_get_project`	`braintrust.braintrust_get_project`	Read `read`
`integration__braintrust__braintrust_update_project`	`braintrust.braintrust_update_project`	Write `write`
`integration__braintrust__braintrust_delete_project`	`braintrust.braintrust_delete_project`	Write `write`
`integration__braintrust__braintrust_insert_logs`	`braintrust.braintrust_insert_logs`	Write `write`
`integration__braintrust__braintrust_fetch_logs`	`braintrust.braintrust_fetch_logs`	Read `read`
`integration__braintrust__braintrust_feedback_logs`	`braintrust.braintrust_feedback_logs`	Write `write`
`integration__braintrust__braintrust_list_experiments`	`braintrust.braintrust_list_experiments`	Read `read`
`integration__braintrust__braintrust_create_experiment`	`braintrust.braintrust_create_experiment`	Write `write`
`integration__braintrust__braintrust_get_experiment`	`braintrust.braintrust_get_experiment`	Read `read`
`integration__braintrust__braintrust_update_experiment`	`braintrust.braintrust_update_experiment`	Write `write`
`integration__braintrust__braintrust_delete_experiment`	`braintrust.braintrust_delete_experiment`	Write `write`
`integration__braintrust__braintrust_insert_experiment`	`braintrust.braintrust_insert_experiment`	Write `write`
`integration__braintrust__braintrust_fetch_experiment`	`braintrust.braintrust_fetch_experiment`	Read `read`
`integration__braintrust__braintrust_feedback_experiment`	`braintrust.braintrust_feedback_experiment`	Write `write`
`integration__braintrust__braintrust_summarize_experiment`	`braintrust.braintrust_summarize_experiment`	Read `read`
`integration__braintrust__braintrust_list_datasets`	`braintrust.braintrust_list_datasets`	Read `read`
`integration__braintrust__braintrust_create_dataset`	`braintrust.braintrust_create_dataset`	Write `write`
`integration__braintrust__braintrust_get_dataset`	`braintrust.braintrust_get_dataset`	Read `read`
`integration__braintrust__braintrust_update_dataset`	`braintrust.braintrust_update_dataset`	Write `write`
`integration__braintrust__braintrust_delete_dataset`	`braintrust.braintrust_delete_dataset`	Write `write`
`integration__braintrust__braintrust_insert_dataset`	`braintrust.braintrust_insert_dataset`	Write `write`
`integration__braintrust__braintrust_fetch_dataset`	`braintrust.braintrust_fetch_dataset`	Read `read`
`integration__braintrust__braintrust_feedback_dataset`	`braintrust.braintrust_feedback_dataset`	Write `write`
`integration__braintrust__braintrust_summarize_dataset`	`braintrust.braintrust_summarize_dataset`	Read `read`
`integration__braintrust__braintrust_list_prompts`	`braintrust.braintrust_list_prompts`	Read `read`
`integration__braintrust__braintrust_create_prompt`	`braintrust.braintrust_create_prompt`	Write `write`
`integration__braintrust__braintrust_upsert_prompt`	`braintrust.braintrust_upsert_prompt`	Write `write`
`integration__braintrust__braintrust_get_prompt`	`braintrust.braintrust_get_prompt`	Read `read`
`integration__braintrust__braintrust_update_prompt`	`braintrust.braintrust_update_prompt`	Write `write`
`integration__braintrust__braintrust_delete_prompt`	`braintrust.braintrust_delete_prompt`	Write `write`
`integration__braintrust__braintrust_list_functions`	`braintrust.braintrust_list_functions`	Read `read`
`integration__braintrust__braintrust_create_function`	`braintrust.braintrust_create_function`	Write `write`
`integration__braintrust__braintrust_upsert_function`	`braintrust.braintrust_upsert_function`	Write `write`
`integration__braintrust__braintrust_get_function`	`braintrust.braintrust_get_function`	Read `read`
`integration__braintrust__braintrust_update_function`	`braintrust.braintrust_update_function`	Write `write`
`integration__braintrust__braintrust_delete_function`	`braintrust.braintrust_delete_function`	Write `write`
`integration__braintrust__braintrust_invoke_function`	`braintrust.braintrust_invoke_function`	Write `write`
`integration__braintrust__braintrust_query_btql`	`braintrust.braintrust_query_btql`	Read `read`
`integration__braintrust__braintrust_launch_eval`	`braintrust.braintrust_launch_eval`	Write `write`
`integration__braintrust__braintrust_proxy_chat_completions`	`braintrust.braintrust_proxy_chat_completions`	Write `write`
`integration__braintrust__braintrust_proxy_completions`	`braintrust.braintrust_proxy_completions`	Write `write`
`integration__braintrust__braintrust_proxy_embeddings`	`braintrust.braintrust_proxy_embeddings`	Write `write`
`integration__braintrust__braintrust_proxy_auto`	`braintrust.braintrust_proxy_auto`	Write `write`
`integration__braintrust__braintrust_list_project_scores`	`braintrust.braintrust_list_project_scores`	Read `read`
`integration__braintrust__braintrust_list_project_tags`	`braintrust.braintrust_list_project_tags`	Read `read`
`integration__braintrust__braintrust_list_dataset_snapshots`	`braintrust.braintrust_list_dataset_snapshots`	Read `read`
`integration__braintrust__braintrust_list_groups`	`braintrust.braintrust_list_groups`	Read `read`
`integration__braintrust__braintrust_list_roles`	`braintrust.braintrust_list_roles`	Read `read`
`integration__braintrust__braintrust_list_users`	`braintrust.braintrust_list_users`	Read `read`
`integration__braintrust__braintrust_list_organizations`	`braintrust.braintrust_list_organizations`	Read `read`

Write Access

Start with --write=deny for read-only MCP clients. Use --write=ask or --write=allow only when the client and workspace are trusted.