菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-03-28
📄 Abstract - From Inference Routing to Agent Orchestration: Declarative Policy Compilation with Cross-Layer Verification

The Semantic Router DSL is a non-Turing-complete policy language deployed in production for per-request LLM inference routing: content signals (embedding similarity, PII detection, jailbreak scoring) feed into weighted projections and priority-ordered decision trees that select a model, enforce privacy policies, and produce structured audit traces -- all from a single declarative source file. Prior work established conflict-free compilation for probabilistic predicates and positioned the DSL within the Workload-Router-Pool inference architecture. This paper extends the same language from stateless, per-request routing to multi-step agent workflows -- the full path from inference gateway to agent orchestration to infrastructure deployment. The DSL compiler emits verified decision nodes for orchestration frameworks (LangGraph, OpenClaw), Kubernetes artifacts (NetworkPolicy, Sandbox CRD, ConfigMap), YANG/NETCONF payloads, and protocol-boundary gates (MCP, A2A) -- all from the same source. Because the language is non-Turing-complete, the compiler guarantees exhaustive routing, conflict-free branching, referential integrity, and audit traces structurally coupled to the decision logic. Because signal definitions are shared across targets, a threshold change propagates from inference gateway to agent gate to infrastructure artifact in one compilation step -- eliminating cross-team coordination as the primary source of policy drift. We ground the approach in four pillars -- auditability, cost efficiency, verifiability, and tunability -- and identify the verification boundary at each layer.

顶级标签: llm agents systems
详细标签: policy language declarative compilation agent orchestration cross-layer verification inference routing 或 搜索:

从推理路由到智能体编排:具备跨层验证能力的声明式策略编译 / From Inference Routing to Agent Orchestration: Declarative Policy Compilation with Cross-Layer Verification


1️⃣ 一句话总结

这篇论文提出了一种统一的声明式策略语言,能够将原本用于单次AI模型推理请求的路由规则,无缝扩展并自动编译成管理多步骤智能体工作流、云基础设施配置和网络协议的完整策略,从而在一个编译步骤内保证策略一致性、消除跨团队协调错误,并自动生成可审计的追踪记录。

源自 arXiv: 2603.27299