KosmoKrator

analytics

Braintrust MCP, CLI, and Lua Integration for AI Agents

Braintrust integration docs for AI agents: MCP gateway setup, Braintrust CLI commands, Lua API reference, credentials, and function schemas.

Braintrust for agents

Credentials can be configured manually in web or CLI hosts.

Use this integration from Lua code mode, the headless integrations CLI, or the KosmoKrator MCP gateway. The same package metadata powers all three surfaces.

Agent Surfaces

Braintrust CLIHeadless setup, JSON output, direct function calls. Braintrust MCPExpose selected tools to local MCP clients. Braintrust LuaAgent-facing namespace and Lua reference. FeedbackReport missing tools, auth issues, or bad metadata.

Machine-Readable Metadata

integration_slug
braintrust
route_slug
braintrust
package
braintrust
auth_strategy
api_key
cli_setup_supported
true
cli_runtime_supported
true
mcp_gateway_supported
true
lua_supported
true

Function Catalog

FunctionTypeParametersDescription
braintrust.braintrust_list_projects Read read 0 List Braintrust projects.
braintrust.braintrust_create_project Write write 0 Create a Braintrust project.
braintrust.braintrust_get_project Read read 0 Retrieve a Braintrust project by ID.
braintrust.braintrust_update_project Write write 0 Patch a Braintrust project.
braintrust.braintrust_delete_project Write write 0 Delete a Braintrust project.
braintrust.braintrust_insert_logs Write write 0 Insert project log events.
braintrust.braintrust_fetch_logs Read read 0 Fetch project log events.
braintrust.braintrust_feedback_logs Write write 0 Record feedback on project logs.
braintrust.braintrust_list_experiments Read read 0 List Braintrust experiments.
braintrust.braintrust_create_experiment Write write 0 Create a Braintrust experiment.
braintrust.braintrust_get_experiment Read read 0 Retrieve a Braintrust experiment.
braintrust.braintrust_update_experiment Write write 0 Patch a Braintrust experiment.
braintrust.braintrust_delete_experiment Write write 0 Delete a Braintrust experiment.
braintrust.braintrust_insert_experiment Write write 0 Insert events into an experiment.
braintrust.braintrust_fetch_experiment Read read 0 Fetch experiment events.
braintrust.braintrust_feedback_experiment Write write 0 Record feedback on experiment rows.
braintrust.braintrust_summarize_experiment Read read 0 Summarize experiment metrics.
braintrust.braintrust_list_datasets Read read 0 List Braintrust datasets.
braintrust.braintrust_create_dataset Write write 0 Create a Braintrust dataset.
braintrust.braintrust_get_dataset Read read 0 Retrieve a Braintrust dataset.
braintrust.braintrust_update_dataset Write write 0 Patch a Braintrust dataset.
braintrust.braintrust_delete_dataset Write write 0 Delete a Braintrust dataset.
braintrust.braintrust_insert_dataset Write write 0 Insert records into a dataset.
braintrust.braintrust_fetch_dataset Read read 0 Fetch dataset records.
braintrust.braintrust_feedback_dataset Write write 0 Record feedback on dataset rows.
braintrust.braintrust_summarize_dataset Read read 0 Summarize dataset contents.
braintrust.braintrust_list_prompts Read read 0 List Braintrust prompts.
braintrust.braintrust_create_prompt Write write 0 Create a Braintrust prompt.
braintrust.braintrust_upsert_prompt Write write 0 Create or update a Braintrust prompt.
braintrust.braintrust_get_prompt Read read 0 Retrieve a Braintrust prompt.
braintrust.braintrust_update_prompt Write write 0 Patch a Braintrust prompt.
braintrust.braintrust_delete_prompt Write write 0 Delete a Braintrust prompt.
braintrust.braintrust_list_functions Read read 0 List Braintrust functions, tools, and scorers.
braintrust.braintrust_create_function Write write 0 Create a Braintrust function.
braintrust.braintrust_upsert_function Write write 0 Create or update a Braintrust function.
braintrust.braintrust_get_function Read read 0 Retrieve a Braintrust function.
braintrust.braintrust_update_function Write write 0 Patch a Braintrust function.
braintrust.braintrust_delete_function Write write 0 Delete a Braintrust function.
braintrust.braintrust_invoke_function Write write 0 Invoke a Braintrust prompt, tool, or scorer.
braintrust.braintrust_query_btql Read read 0 Query logs, experiments, and datasets with Braintrust SQL.
braintrust.braintrust_launch_eval Write write 0 Launch a Braintrust eval run.
braintrust.braintrust_proxy_chat_completions Write write 0 Call Braintrust AI proxy chat completions.
braintrust.braintrust_proxy_completions Write write 0 Call Braintrust AI proxy completions.
braintrust.braintrust_proxy_embeddings Write write 0 Call Braintrust AI proxy embeddings.
braintrust.braintrust_proxy_auto Write write 0 Call the Braintrust proxy auto endpoint.
braintrust.braintrust_list_project_scores Read read 0 List project score definitions.
braintrust.braintrust_list_project_tags Read read 0 List project tags.
braintrust.braintrust_list_dataset_snapshots Read read 0 List dataset snapshots.
braintrust.braintrust_list_groups Read read 0 List Braintrust groups.
braintrust.braintrust_list_roles Read read 0 List Braintrust roles.
braintrust.braintrust_list_users Read read 0 List Braintrust users.
braintrust.braintrust_list_organizations Read read 0 List Braintrust organizations.