Incident Command Center
Filter, inspect, acknowledge, resolve, and investigate AI-generated incidents with evidence and actions.
Senior Full-Stack AI Architecture Project
Autonomous Multi-Modal Incident Intelligence Fabric
OmniSight turns camera, sensor, audio, document, and API signals into evidence-backed incident investigations with agentic reasoning, safety guardrails, observability, and a polished operator console.
DetectCorrelateRetrieveReasonGuardAlert
Architecture
Production-style event-driven AI platform
Built as a modular MVP with clean boundaries for future microservice extraction, Redpanda consumers, real vision/audio models, Qdrant, Redis, and LangGraph.
Data Sources
Cameras · Sensors · Audio · Docs
Cameras · Sensors · Audio · Docs
→
FastAPI Gateway
JWT · RBAC · Validation
JWT · RBAC · Validation
→
Event Bus
Redpanda-ready topics
Redpanda-ready topics
→
Processing
Dedup · Enrich · Correlate
Dedup · Enrich · Correlate
→
Memory Fabric
Postgres · Redis · Qdrant · Graph
Postgres · Redis · Qdrant · Graph
→
Agents
Investigate · Plan · Guard
Investigate · Plan · Guard
Product Capabilities
Everything needed for a portfolio-grade AI platform
Multimodal Event Operations
Vision, audio, sensor, webhook, and custom canonical event flows with Redpanda-ready topic contracts.
Documents & RAG
Upload manuals, chunk documents, index semantic memory, and retrieve evidence-backed chunks.
Agent Runtime
Observer, Retriever, Investigator, Planner, Safety Guard, and Executor workflow with trace viewer.
Knowledge Graph
Interactive graph of incidents, events, machines, zones, and documents with relationship inspection.
Governance & Audit
JWT, RBAC, audit logs, human approval policies, and guardrail decisions for enterprise AI safety.
Interactive Simulator
Explore OmniSight Capabilities in Real-Time
Interact with our live browser-side simulators to see how multimodal ingestion, correlation rules, RAG, agents, graphs, and security controls function under the hood.
Trigger Multimodal Signals
Simulate external devices feeding telemetry into OmniSight. Click on any source to package a standard telemetry schema and emit it to the canonical API boundary.
// Awaiting signal trigger...
Correlation Engine
Observe how discrete event streams are evaluated within a rolling 10-minute correlation window to construct consolidated operations incidents.
IF
restricted_zone_intrusion (CCTV)AND
temperature_anomaly >= 85°C (IoT Sensor)THEN Correlate into a High Severity Incident
High Severity
Risk: 88%
Incident #INC-01: Machine A Overheating & Restricted Zone Activity
Automated correlation matching connected forklift entry in Zone A with subsequent Machine A temperature surge (92.4°C).
10:30:00 - CCTV Forklift detection
10:31:10 - Machine A temperature spike
Semantic Memory Retrieval
Documents uploaded to OmniSight are chunked, vectorized, and indexed in vector memory. Type a query to simulate visual vector retrieval mapping.
CITED: Machine A manual (Chunk #2) · Score 0.95
Vector Chunk Blocks (Similarity Heatmap)
Auditable Reasoning Chain
When an incident triggers, our agentic runtime initiates an autonomous analysis cycle. Clicking run will animate the orchestrator stages.
ObserverPerceive Signals
RetrieverFetch SOP / Context
InvestigatorBuild Hypotheses
PlannerFormulate Action
GuardVerify Policies
ExecutorMitigate Alert
// Press "Execute Investigation Run" to begin...
Relationship Topology
Hover over nodes in the interactive network map to see the semantic links connecting incidents, events, documents, and machinery locations together.
Hover over any node to inspect relationship details.
Enterprise RBAC Governance
Toggle system access roles to instantly audit and witness how authorization tokens change the permission scopes and the corresponding system audit logs.
Interactive Docs
Explore Project Documentation
Dynamically loaded directly from the `docs/` repository folder using zero-backend client-side rendering.
Select a document from the sidebar to view it here.
Project Structure
Complete file structure, routes, and implementation map
This section shows exactly where the frontend, backend, APIs, reports, infrastructure, connectors, and documentation live inside the AMIF project.
Repository Tree
amif/amif/
backend/
app/
connectors/
camera_connector.py · audio_connector.py · ...
core/
config.py · security.py
db/
session.py · init_db.py
models/
models.py · enums.py
schemas/
schemas.py
routers/
auth.py · events.py · incidents.py · ...
services/
event_service.py · event_processor.py · agent_service.py · ...
static/
console.html · architecture.html · assets/
main.py
Dockerfile · requirements.txt
docs/
architecture.md · api-spec.md · evaluation.md · frontend-ux.md · senior-architecture-blueprint.md
reports/
PDF report · PPTX presentation · interactive HTML report · report generators
scripts/
seed_demo.py
docker-compose.yml · README.md · index.html
Frontend Routes
Static UI
index.html Professional project home page
static/console.html Full OmniSight operator dashboard
static/architecture.html System architecture visual
reports/AMIF_Interactive_Project_Report.html Interactive report
reports/AMIF_Complete_Project_Report.pdf PDF report
reports/AMIF_Project_Presentation.pptx Presentation
Documentation