Orchestration
Orchestration engineering
An orchestrator that plans, routes, retries and knows when to stop, on workflows that survive failures.
What you get
-
Planning & routing
Work is split and sent to the right agent.
-
Durable runs
Workflows resume after failures, not restart.
-
Budgets
Cost, latency and step limits on every run.
-
Parallel agents
Fan out, merge and verify results.
What a run looks like
support-triage.flow
The flow: a new ticket goes to the orchestrator, which sends it to a classifier, a research and a drafting agent; tickets below 0.8 confidence wait for human review before the reply is sent.
14:02:11 orchestrator → classifier intent=billing p=0.94
14:02:13 research → crm.lookup account found, 2 open invoices
14:02:17 drafting → evals grounded, tone, pii: all pass
| Run | Ticket | Route | Result | Time | Cost |
|---|---|---|---|---|---|
| #1041 | Invoice question | Automatic | resolved | 6.4 s | €0.031 |
New tickets appear here as the flow runs them. Times include waiting for a person.
Eval suite: 48 real tickets
passed on the last change
- Correct route 94%
- Grounded answers 96%
- Tone & policy 92%
- PII handling 100%
Below 0.8 confidence a ticket waits for a person. This session: 0 of 1 tickets went to review.
Where it fits
Every ticket triaged and drafted first
- 1 New ticket
- 2 Classify intent
- 3 Research account & docs
- 4 Draft reply
- 5 Human review if unsure
Tools it would use:
helpdesk
crm.lookup
search_docs
Inbound documents into clean records
- 1 Document arrives
- 2 Extract fields
- 3 Validate & dedupe
- 4 Write to ERP
- 5 Flag exceptions
Tools it would use:
ocr
erp.create
rules.check
Research accounts and prepare every call
- 1 Meeting booked
- 2 Gather account history
- 3 Summarise news
- 4 Write brief
- 5 Log follow-ups
Tools it would use:
calendar
crm.search
web.fetch
Agents that know your codebase
- 1 Alert or PR opened
- 2 Read code & logs
- 3 Propose a fix
- 4 Run the tests
- 5 Open a pull request
Tools it would use:
git
ci.run
logs.query
Good questions
What is orchestration engineering?
Designing how agents, tools and people work together on one job: who plans, who executes, how results are checked, what happens when a step fails and what a run may cost.
Do we need several agents?
Often not at first. We start with the simplest design that works and add agents only when a task genuinely splits.