Observability
Request logs with prompt, response, tokens, cost and latency; metrics and tracing export; alerts for budgets, outages and latency; and audit logs.
Observability
See every AI request
Every request through the gateway is logged with who made it, which model answered, how many tokens it used, what it cost and how long it took.
Metrics and traces export to your observability tools and to Comptech AIOps, and alerts reach the right team before users notice.
Who uses it
Answers for every team
Operations
Latency, errors and outages per model and provider.
Finance
Spend by team, application and model.
Audit and risk
Who used which model, with what data, and which guardrails fired.
Features
Logs, metrics and alerts
Request logs
Prompt, response, tokens, cost, latency, key, team and model for every request, with configurable redaction.
Metrics
Requests, errors, latency, tokens and spend, exported in standard formats.
Tracing
Trace export to observability tools, linking AI calls to the application request.
Budget alerts
Alerts when a key or team approaches or exceeds its budget.
Outage and latency alerts
Alerts when a model fails or slows down.
Audit logs
Every admin change to keys, teams, models and policies, with who made it.
Data
What is recorded
Request log
- Contents
- Prompt, response, tokens, cost, latency, model, key, team
- Used for
- Troubleshooting and review
Metrics
- Contents
- Requests, errors, latency, tokens, spend
- Used for
- Dashboards and capacity planning
Traces
- Contents
- Spans for each AI call
- Used for
- End-to-end application tracing
Alerts
- Contents
- Budgets, outages, latency
- Used for
- Operations and finance
Audit log
- Contents
- Admin changes with user and time
- Used for
- Audit and compliance
Included
With every Comptech product
On premises or air-gapped
Runs in your own data centre, so prompts and responses stay under your control.
Single sign-on
SAML and OIDC sign-in, with AD/LDAP groups mapped to teams and roles.
Secrets vault
Provider credentials held centrally, never handed to applications.
DC/DR design
Designed for a primary data centre and a disaster recovery site.
Local support
Comptech engineers in Bangladesh for deployment and support.
Pilot and training
A focused pilot on one use case, plus training for platform and application teams.
Explore
Other Comptech products
Comptech Container Platform
Enterprise Kubernetes with GitOps, a private registry and DC/DR.
Comptech AI Platform
Private generative AI and MLOps on your own GPUs.
Comptech Data Pipeline
Open lakehouse with SQL, pipelines, dashboards and lineage.
Comptech DocuVault
Document management for banks: capture, document AI, workflows and records.
Comptech AIOps
Monitoring, service desk, AI root cause and DR assurance for bank infrastructure.
Comptech VisionVault
On-prem AI video intelligence, transcription and evidence management.
Comptech SecOps
Security for every workload across your Comptech platforms.
Request a pilot
Tell us which applications and models you want to bring under control first. We'll plan an AI Gateway pilot around them.
Related services