Live App →
Developers

Data Flows

Document pipeline, chat lifecycle, and agentic run state machines.

Data Flows

End-to-end data flow for the three primary platform journeys.

Flow 1: Document Processing

User uploads PDF
    │
    ▼
Sentinel Frontend ──► Studio Middleware (auth + proxy)
    │
    ▼
Nexus Backend ──► S3 (binary storage)
    │
    ▼
Celery Worker (Light/Heavy/XL queue)
    │
    ├──► ClassificationAgent ──► Document type
    ├──► LayoutExtractor ──► Regions
    ├──► ParallelExtractionAgent ──► Securities, NAVs
    ├──► ValidationAgent ──► Cross-check sums
    └──► StorageAgent ──► MongoDB + OpenSearch
    │
    ▼
Webhook callback ──► External system (optional)
    │
    ▼
User reviews ──► Edits ──► Re-validates ──► Exports

Data stores touched: S3, MongoDB, OpenSearch, Redis (queue), PostgreSQL (audit)

Flow 2: Chat Session

User sends message
    │
    ▼
Sentinel Frontend ──► Studio Middleware
    │
    ▼
Zen Chatbot Platform ──► Session validation
    │
    ▼
Agentic Backend ──► Supervisor (intent classification)
    │
    ├──► document_qa ──► KB / OpenSearch (RAG)
    ├──► portfolio_review ──► Portfolio engine
    ├──► general_chat ──► Web search + reasoning
    └──► vision ──► Vision model
    │
    ▼
LLM Invocation Orchestrator ──► Provider selection
    │
    ├──► AWS Bedrock (Claude)
    ├──► OpenAI (GPT-4)
    └──► Fallback chain
    │
    ▼
Streaming response (SSE) ──► User
    │
    ▼
Session state updated ──► MongoDB

Data stores touched: MongoDB, OpenSearch, Redis (session), PostgreSQL (audit + cost)

Flow 3: Portfolio Review Report

User requests report
    │
    ▼
Sentinel Frontend ──► Studio Middleware
    │
    ▼
Agentic Backend ──► Portfolio Review Agent
    │
    ├──► Fetch latest extractions (MongoDB)
    ├──► Fetch live NAVs (yfinance)
    ├──► Compute metrics (PyPortfolioOpt)
    ├──► Generate narrative (LLM Orchestrator)
    └──► Compose PDF/PPTX
    │
    ▼
Report stored ──► S3
    │
    ▼
User downloads ──► Webhook notification (optional)

Data stores touched: MongoDB, S3, PostgreSQL (cost tracking)

Flow 4: Support Ops (WF4)

Zoho Desk ticket created
    │
    ▼
Integrations Backend ──► Webhook ──► Agentic Backend
    │
    ▼
WF4 Support Ops Agent
    │
    ├──► Classify intent (supervisor)
    ├──► Retrieve SOP from KB (RAG)
    ├──► Generate response with citations
    └──► Create Excel export (if needed)
    │
    ▼
Auto-reply to Zoho ──► Or escalate to L2