09 · AI platform
CweCi gateway
Cape Wesley's self-hosted AI assistant for engineering teams.
A self-hosted, OpenAI-compatible gateway that routes a team's AI through one endpoint: local models first, cloud fallback, and a guardrail pipeline on every request.
- 01Local first — Ollama by default, with fallback to Claude and GPT models; a new model is configuration, not code.
- 02Guardrail pipeline — PII redaction (Presidio), then injection defence, then engineering policy, then audit, in that order.
- 03An assistant on top — CweCi, the company website's chat assistant, runs through it with a rate limit and a scoped prompt.
- 04Observable — Prometheus and Grafana dashboards for latency, spend and errors.
- 05Observability and analytics — Prometheus and Grafana dashboards for model throughput, latency, cost and usage.
- Local models first
- Cloud fallback
- Guardrails in order
SurfacesAPIWeb chatSelf-hosted
- LiteLLM
- Ollama
- Presidio
- PostgreSQL · Redis
- Open WebUI
- Prometheus · Grafana