Models
One endpoint for OpenAI, Anthropic, Bedrock, Azure OpenAI, Vertex AI and your own GPUs. Load balancing, failover and retries that never leave your permitted routes. Deadline-aware batch planning.
Tools
An MCP gateway per project: an approved tool catalog, per-tool permissions and rate limits, approvals for sensitive actions, poisoning and rug-pull checks. Your REST APIs become tools.
Agents
Agents are named identities that act on behalf of signed-in users, never beyond what that user may do. Agent-to-agent tasks pass the same checkpoint.
Guardrails
Checks on prompts, responses and tool results, including prompt injection. Bring your own: Presidio, Bedrock Guardrails, Azure Content Safety, Google Model Armor, OpenAI Moderation.
Cost
Token limits and budgets by team, project and key, including traffic on your own provider keys. Alerts and hard caps. A response cache where your data rules allow it.
Identity
Single sign-on with OIDC and SAML, SCIM provisioning from Okta and Entra, roles, and short-lived credentials for workloads.
Evidence and operations
Tamper-evident decision records, streamed to Splunk, Datadog, S3 or syslog. Runs multi-replica on Postgres, installed with Helm, including fully disconnected sites.