NOVUS CORTEX · IN DEVELOPMENT

Governed enterprise AI gateway

A governed AI gateway for enterprises that need model access, MCP tools, and agent gateway capability without replacing an existing API gateway.

CAPABILITIES

Designed around the Cortex use cases.

01AI model & provider governance

Provide tenant-aware AI controls with measurable provider and model operations.

02Provider health and quality

Provide tenant-aware AI controls with measurable provider and model operations.

03Tenant-scoped usage analytics

Provide tenant-aware AI controls with measurable provider and model operations.

04MCP and agent identity

Provide tenant-aware AI controls with measurable provider and model operations.

05Governed AI, MCP and agent calls

Provide tenant-aware AI controls with measurable provider and model operations.

06Cost and reliability visibility

Provide tenant-aware AI controls with measurable provider and model operations.

END-TO-END FLOW

How Cortex fits into enterprise delivery.

A product-specific operating diagram copied from the prototype flow pattern.

AI consumers

AppsAgentsCopilotsServices

One API

OpenAI-compatibleStreamingEmbeddings
Novus CortexNOVUSCORTEXAI Gateway
RouteGovernObserveOptimize

Models & providers

OpenAIAnthropicAzure AIBedrockVertex AI
UNIFIED OBSERVABILITY

Understand APIs, AI and agents from the same operating view.

Illustrative product telemetry showing the kinds of signals Novus is being designed to correlate across gateway, model and agent workloads.

AI intelligenceAgentic analyticsMulti-protocol trafficDistributed traces
AI INTELLIGENCEModel traffic & economics
Last 60 min
AI requests8.7M+18%
Tokens14.2B+24%
Cost / 1K$0.018-11%
Cache hit41.8%+9%
AI requestsToken volumeOpenAI · Anthropic · Bedrock · Vertex AI · Azure
AGENTIC ANALYTICSAgent execution
Live
Tasks186K+31%
Success97.4%+1.8%
Tool calls1.9M+27%
P95 task4.8s-14%
Tasks started186K
Plans created179K
Tool executions1.9M
Completed181K
avg 10.2 tool calls/task2.6% human intervention0.8% policy blocked
MULTI-PROTOCOLTraffic distribution
12.4M requests
REST38%
MCP21%
gRPC14%
SSE10%
WebSocket7%
GraphQL5%
API & PROTOCOL LOGSLive request stream
● Live
All protocolsAll statusSearch endpoint, tool, agent...
REST200POST /v1/orders84ms
MCP200tools/call · search312ms
gRPC200Inference.Stream441ms
SSE200/v1/chat/stream1.8s
A2A202agent/tasks126ms
HTTP/2504payments-v22.0s
DISTRIBUTED TRACEAI agent → MCP → model
1.84s
trace 8fa2...91cprod · claims-agent
Agent request
OmniGate
Identity + policy
MCP tools/call
Agent planning
Model route
Anthropic inference
Response
One request contextAPI + AI + MCP + AgentMetrics + Logs + Traces + Cost + Policy
PRODUCT EXPERIENCE

Operational views built for the work at hand.

These interface previews illustrate the intended experience; they are not representations of a generally available product.

AI workspaceInference · history · usage
Model catalogModels · health · policy
Tenant analyticsUsage · cost · reliability
AVAILABILITY

Cortex is currently in development.

This page describes the current product direction and planned capabilities. Availability and implementation details may change before release.

  1. Development
  2. Private preview
  3. Early access
  4. General availability