Penso Bot Space

ISG Agentic AI — Request Flow

End-to-end agent request path through the Broadcom Agentic AI stack

🔒 Security & Policy
  • PAM (JIT Access)
  • DLP (Privacy and data)
  • IDSP (Non-Human ID)
Applies throughout all layers
📊 Observability
  • Logging
  • Debugging
  • Tracing
  • NetOps
Cross-cutting — captures every step
① Initiation
1
Cloud Admin / External Trigger
Mainframe eventAPI callScheduled task
2
Agent FW (SpringAI)
AuthRequest validationPolicy enforcement
② Routing
3
AVI Load Balancer + Agent Session Router
Session affinityHealth checksTraffic distribution
4
Service Marketplace
Skill discoveryTool registryAgent catalog
③ Agent Execution
5a
AI Agent (Worker)
Single task
5b
AI Agent – Team Leader
Multi-agentDelegates to workers
Agent Lifecycle: spawn → execute → evaluate → retry → terminate
⚡ HiTL Check
Approve / redirect / terminate
④ Middleware Processing
6
AI Middleware
Secrets servicesAudit serviceIdentity serviceCode sandboxRate limitingEval serviceShared memory
MCP GW ↓
Agent → Tools & Services
← A2A GW →
Agent ↔ Agent communication
Service Brokers
Route to agentic & data services
Model Service Brokers
Route to cloud or on-prem models
⑤ Service Execution
7a
Agent Hosting Runtime
MCPSkillsBrowser service
Agentic Runtime
Platform · Developer · Marketplace
7b
Data Engineering Services
Data flowRabbitMQPostgresGreenplumGenfireValkey
7c
Model as a Service
Model cachingHarbor
☁️ Cloud
Models
🏠 On-Prem
SLM / LLM
⑥ Infrastructure
8
VMware Cloud Foundation — Supervisor Cluster
COMPUTESTORAGENETWORKOPERATIONSAUTOMATIONPRIVATE AI
vDefend Firewall
GPU
NVIDIA
intelAMD💥
CPU
↩ Response Path
Results aggregate back through middleware
Eval service validates · Audit service logs · Shared memory updated
Agent returns response → Load Balancer → Session Router
Response delivered to Cloud Admin / caller

Total round trip: entry → security → routing → agent → middleware → brokers → services → infra → back

🤖 Agent Workers
  • AI Agent ×4
  • Team Leader
  • Spawn on demand
👤 HiTL
  • Approve action
  • Redirect agent
  • Terminate task
☁️ Cloud Models
  • OpenAI (GPT)
  • Google Gemini
🏠 Private Models
  • ON PREM SLM (CPU)
  • ON PREM LLM (GPU)
  • Ollama / Harbor
ISG Agentic AI Logical Blueprint — Broadcom Proprietary & Confidential © 2026 | Flow diagram for architecture review