FLAGSHIP · AUTONOMOUS AI ENGINEERING
ORION — AI Engineering Control Center
An automated RAG experimentation platform that creates retrieval hypotheses, runs controlled experiments, evaluates results, stores experiment history, and keeps a human approval step before changes are accepted.
Reported gains: +33.3% retrieval recall and +15.2% answer F1. Evaluation scope: 9 public and 4 held-out items; not a broad production benchmark.
View architecture
RAG changes are often accepted without controlled measurement or memory of failed ideas.
Investigate → hypothesize → experiment → remember → request human approval.
Retrieval recall and answer F1 across separate public and held-out evaluation sets.
Docker images published through GitHub Actions and deployed to Azure Container Apps.