Run Collector¶
The AI Assets Collector collects AI assets from your data sources, builds an inventory, and records relationships between them for AI Governance.
Start AI Assets Collector Using Runtime on K8s¶
A Trust3 Runtime is a lightweight deployment plane that runs inside your own EKS/AKS cluster. It lets Trust3 deploy and manage collectors — such as the AI Assets Collector — directly in your environment, without requiring inbound connectivity from the internet into your cluster.
When you create a Runtime, Trust3 installs a small agent in your cluster (the Runtime Plane) that maintains an outbound-only connection to the Trust3 control plane. You then add collectors to that Runtime through the Trust3 dashboard, and Trust3 deploys them as pods in your cluster automatically.
This approach keeps your data local — the AI Assets Collector reads from your Databricks workspace or Azure/ Azure Foundry environment and sends only governance metadata to Trust3, never raw data.
When to use this path: Use the Runtime on K8s path if your Databricks workspace or Azure/Azure Foundry environment is network-restricted, if your security policy requires all compute to run inside your own cluster, or if you prefer Kubernetes-native deployment and lifecycle management over running Docker locally.
If you are evaluating Trust3 or running a quick local test, use the Docker tab instead — it requires no Kubernetes cluster.
Follow this workflow to run the AI Assets Collector in your EKS or AKS cluster using a Trust3 Runtime.
Note
If your security policy requires runtime images from your own Azure Container Registry instead of the Trust3 image hub, complete Using Custom ACR with Runtime before creating the runtime. That guide uses Advanced Config and image mirroring; the steps below use Basic Config with the default Trust3 registry.
Create a Runtime¶
- In the Trust3 dashboard, navigate to Settings > Runtime.
- Click Create New.
-
On the Create Runtime Plane page, configure the runtime:
Setting Value Deployment Type Partially Managed (D2P) — the Trust3 control plane is cloud-hosted; the data plane runs in your own cluster Configuration Mode Basic Config Cloud Provider AWS or Azure Region Select the region where your cluster is deployed Runtime Name Auto-generated — you can rename it, this will be your namespace in kubernetes Auto Upgrade Set to true — the runtime plane updates automatically when new releases are available -
Select the AWS Prerequisites or Azure Prerequisites checkbox to confirm all prerequisites are met. Click View full details if you need to complete any missing prerequisites before continuing.
- Click Generate.
Deploy the Runtime Plane¶
The next screen shows two commands to run from your terminal:
- curl or wget command — downloads the Trust3 runtime installation script to your machine.
- Helm command — deploys the Trust3 Runtime Plane components into your Kubernetes cluster and connects them to Trust3Cloud. Run this exactly as shown — it includes a pre-populated token for your tenant.
Run the commands in order. When the status on screen changes to Connection Established, click Done.
Tip
If the connection does not establish within 5 minutes, verify that your Kubernetes cluster has outbound internet access and that the namespace Helm targets exists in your cluster.
Add AI Assets Collector¶
- Go to Settings > Runtime and click the running runtime to open its detail view.
- Select the Collectors tab.
- Click Add New.
- From Available Collectors, select AI Assets Collector.
- In Basic Info, enter:
- Name — a descriptive name for this collector instance
- Description (optional)
- Click Continue.
-
In Datasource Configuration, provide your configuration values.
Collector Configs — provide values for the platforms you are connecting. You can configure Databricks, Azure, Azure Foundry or all.
Variable Purpose DATABRICKS_HOSTDatabricks workspace URL (e.g. https://your-workspace.cloud.databricks.com)DATABRICKS_TOKENDatabricks personal access token DATABRICKS_ENVIRONMENT_NAMELabels this workspace in the Trust3 inventory — does not affect connectivity. Use dev,stage,prod, ortest. Defaults toprodif omitted.collector.databricks.model-usage.enabledEnable foundation-model and serving-endpoint usage collection from Databricks system tables. Default: true. Runtime UI toggle; env equivalent:DATABRICKS_MODEL_USAGE_ENABLED. Setfalseto skip.collector.databricks.sql-warehouse-http-pathSQL warehouse HTTP path for usage queries ( system.ai_gateway.usage,system.serving.endpoint_usage). Required when model usage is enabled. Shown in Runtime UI only when the model-usage toggle is on. Env equivalent:DATABRICKS_SQL_WAREHOUSE_HTTP_PATH. See Databricks prerequisites.AZURE_TENANT_IDAzure tenant ID AZURE_CLIENT_IDAzure application (client) ID AZURE_CLIENT_SECRETAzure client secret AZURE_FOUNDRY_ENVIRONMENT_NAMELabels this workspace in the Trust3 inventory — does not affect connectivity. Use dev,stage,prod, ortest.Leave any variables you are not using blank — remove them entirely rather than leaving them with empty values.
Monitoring — Monitoring is disabled by default. Set
TRACE_COLLECTION_ENABLED=trueto enable the trace fetch, classify, evaluate, and push pipeline.Variable Default Purpose TRACE_COLLECTION_ENABLEDfalseSet to trueto enable the trace fetch/classify/evaluate/push pipeline.DATABRICKS_MLFLOW_ENABLEDtrueEnable MLflow trace collection. DATABRICKS_GENIE_ENABLEDtrueEnable Genie conversation collection. DATABRICKS_MODEL_USAGE_ENABLEDtrueEnable foundation-model and serving-endpoint usage collection from Databricks system tables. Set falseto skip.DATABRICKS_DAYS_BACK30Initial lookback period (in days) for MLflow traces. CLASSIFIER_BACKENDllmSet to llmto enable LLM-based trace classification.CLASSIFIER_LLM_PROVIDERopenaiopenaioranthropic(required whenCLASSIFIER_BACKEND=llm).CLASSIFIER_LLM_MODELgpt-4o-miniLLM model name (required when CLASSIFIER_BACKEND=llm).CLASSIFIER_LLM_API_KEY— API key for the configured LLM provider (required when CLASSIFIER_BACKEND=llm).Kubernetes Configs — update resource values to match your cluster configuration.
-
Click Save. Trust3 creates the AI Assets Collector pod in your runtime namespace.
Note
The collector runs on a 15-minute schedule. Your first assets will appear in the Trust3 portal under AI Assets within 15 minutes of the pod starting.
Verify the Collector Pod¶
Confirm the collector is running using kubectl:
| Bash | |
|---|---|
Tip
<your-runtime-namespace> will be the Runtime Name configured in Step 3.
Look for a pod named trust3-ai-assets-collector-* with status Running. If the pod is in CrashLoopBackOff or Error, check the logs:
| Bash | |
|---|---|
You can also open Collectors in the Trust3 Portal, Navigate to Settings > Runtime > Runtime Name > Collectors Tab and confirm the AI Assets Collector shows a running status there.
Tip
If you use k9s, navigate to the runtime namespace and confirm the collector pod is running.
Quick checklist¶
- Deployment Type set to Partially Managed (D2P)
- Cloud Provider set to AWS or Azure, region matches AWS / AKS cluster region
- AWS / Azure prerequisites confirmed
- Runtime installation commands run from terminal (curl/wget first, then Helm)
- Runtime shows Connection Established before clicking Done
- AI Asset Collector added from Collectors > Add New
- Databricks configuration provided (if connecting Databricks)
- AWS configuration provided (if connecting AWS)
- Azure configuration provided (if connecting Azure)
- Collector pod shows
Runningin kubectl - AI assets appear in Trust3 portal within 15 minutes
- Databricks: Databricks
- Azure: Azure
- Azure Foundry: Azure Foundry
Download docker-compose.yml¶
Save the file in a directory on your machine (for example ai-assets-collector/). Use the link below — it triggers a download using the site’s download helper.
Create .env¶
Under the same directory where you keep docker-compose.yml, create a file named .env and add the variables below. Set values for each platform you connect (Databricks, Azure, Azure Foundry or all) and AI_GOVERNANCE_API_KEY (To retrieve the API key, log in to Trust3 and navigate to Settings -> API Keys. Make sure you have ADMIN Role to access this page)
| Bash | |
|---|---|
Leave a line blank or omit variables you are not using, following your collector’s expectations.
Login Trust3 AI Docker Repository¶
To log in to the Trust3 AI Docker repository, use the following command:
| Bash | |
|---|---|
When prompted for a password, enter your API key. To retrieve the API key, log in to Trust3 and navigate to Settings > API Keys.
Run with Docker Compose¶
-
Open a terminal under the directory where you keep
docker-compose.ymland.env. -
Start the collector (detached):
Bash -
Watch logs — while
docker composeis up, the collector runs on a schedule (every 15 minutes in the current release):Bash -
Tear down when you no longer want scheduled collection on this host:
Bash
Environment variables (for .env)¶
| Variable | Purpose |
|---|---|
DATABRICKS_HOST | Databricks workspace URL |
DATABRICKS_TOKEN | Personal access token |
DATABRICKS_ENVIRONMENT_NAME | Databricks Workspace Env Type (dev/stage/prod) |
DATABRICKS_MODEL_USAGE_ENABLED | Enable model/serving usage from Databricks system tables. Default: true. Set false to skip. Runtime UI: collector.databricks.model-usage.enabled. |
DATABRICKS_SQL_WAREHOUSE_HTTP_PATH | SQL warehouse HTTP path for model/serving usage system-table queries. Required when model usage is enabled — see Databricks prerequisites |
AZURE_TENANT_ID | Azure tenant ID |
AZURE_CLIENT_ID | Azure application (client) ID |
AZURE_CLIENT_SECRET | Azure client secret |
AZURE_FOUNDRY_ENVIRONMENT_NAME | Azure Foundry Env Type (dev/stage/prod) |
AI_GOVERNANCE_API_KEY | API key for AI Governance ingest, when your deployment expects it |
Monitoring environment variables¶
Monitoring is disabled by default. Set TRACE_COLLECTION_ENABLED=true to enable the fetch, classify, evaluate, and push pipeline.
| Variable | Default | Purpose |
|---|---|---|
TRACE_COLLECTION_ENABLED | false | Set true to enable the trace fetch/classify/evaluate/push pipeline |
DATABRICKS_MLFLOW_ENABLED | true | Enable MLflow trace collection |
DATABRICKS_GENIE_ENABLED | true | Enable Genie conversation collection |
DATABRICKS_MODEL_USAGE_ENABLED | true | Enable foundation-model and serving-endpoint usage from system catalog tables; set false to skip |
DATABRICKS_DAYS_BACK | 30 | Initial lookback days for MLflow traces |
CLASSIFIER_BACKEND | llm | llm to enable LLM-based trace classification |
CLASSIFIER_LLM_PROVIDER | openai | openai or anthropic (required when CLASSIFIER_BACKEND=llm) |
CLASSIFIER_LLM_MODEL | gpt-4o-mini | Model name (required when CLASSIFIER_BACKEND=llm) |
CLASSIFIER_LLM_API_KEY | — | LLM API key (required when CLASSIFIER_BACKEND=llm) |
Quick checklist¶
-
docker-compose.ymlin a directory (download or copy fromai-assets-collector/docker/in the repo) -
.envunder that same directory with the variables above filled in as needed -
docker compose up -d -
docker compose logs -f trust3-ai-assets-collectorto verify the run - Databricks: Databricks
- Azure: Azure
Next steps¶
Once your collector is running, your AI assets will appear in the Trust3 portal under AI Assets within 15 minutes.
-
Core concepts
-
Custom ACR with Runtime