CARouter

0 reviews

CARouter is AI gateway software that routes inference requests through Canadian-based providers while maintaining OpenAI API compatibility. The platform ensures data residency and operational sovereignty by defaulting to Canadian-owned and hosted providers unless specified otherwise. It integrates with multiple providers across provinces. CARouter supports OpenAI API functions like chat completions, embeddings, and model listing. Redirection occurs by changing the base URL and API key. The system prioritizes sovereign providers, factoring in pricing and failover capabilities. Budget controls include per-key spend limits and request-level accounting for tokens, latency, cost, and serving province, with data exportable as CSV files. The platform stores no prompts or completions, retaining only billing metadata. Providers' data retention policies are published. Response headers detail the serving provider, region, cost, and token counts for each request.