๐Ÿข AI Receptionists & Front Office

Multi-Department Call Routing with AI Voice Agents

Most organizations of any size have the same front-door routing problem: one main number, many departments, and an IVR tree that callers hate navigating. "Press 1 for sales. Press 2 for support. Press 3 for billing.

Rohan Pavuluri
Rohan Pavuluri
March 4, 2026 ยท 6 min read
Speechify

Most organizations of any size have the same front-door routing problem: one main number, many departments, and an IVR tree that callers hate navigating. "Press 1 for sales. Press 2 for support. Press 3 for billing. Press 4 to hear this menu again." Callers mash zero, wait for a human, and the receptionist spends their day asking "who are you trying to reach?" An AI voice agent replaces the menu with a conversation and routes faster, more accurately, and without the press-1-2-3 tax.

This article covers the design of a multi-department AI router โ€” how to model the routing tree, how to train the agent, and the failure modes you'll spend three months debugging if you don't plan ahead.

TL;DR

  • Replace IVR menus with conversational intent classification. Callers just say why they're calling.
  • Start with the top 5โ€“8 departments. Everything else routes to a human operator.
  • Build a clean hand-off with context โ€” the receiving team should never ask "who is this?" again.
  • Measure misroute rate, abandonment, and time-to-human. These are your KPIs.
  • "Zero out" behavior (caller asks for a human) must work instantly.

Why IVR loses to conversational routing

Classic IVR:

  • Takes 15โ€“30 seconds to present the menu.
  • Forces the caller to translate their intent into one of four pre-defined buckets.
  • Has no graceful handling for requests that don't match.
  • Feels impersonal and cold.

Conversational routing:

  • Opens with "How can I help?"
  • Caller states intent in natural language in 3โ€“8 seconds.
  • Agent classifies and routes.
  • Handles novel intents with a human fallback.

The best IVRs route in ~25 seconds. A competent AI router routes in 8โ€“12 seconds. That difference compounds across thousands of calls per week.

Modeling your routing tree

List your departments. For each, write:

  • Department name (internal and caller-facing).
  • Primary intents handled โ€” what calls should land here?
  • Hours of availability.
  • Hand-off mechanism โ€” warm transfer, cold transfer, callback, ticket.
  • Fallback โ€” if this department is unavailable, where?

Example (mid-sized SaaS company):

DepartmentIntentsHoursHand-off
Salesnew deals, demos, pricingMโ€“F 8โ€“6warm transfer to AE on call
Supportexisting-customer issues24/7 via shiftswarm transfer to tier-1
Billinginvoices, paymentsMโ€“F 9โ€“5cold transfer to billing
Partnershipsbusiness dev inquiriesMโ€“F 9โ€“5callback booking
Everything elsehuman operator

This table becomes the agent's routing reference.

Training the intent classifier

Most voice AI platforms handle routing as "what's the caller asking for?" โ€” an intent classification built into the LLM's system prompt. You don't need a separate ML model; you need a tight prompt with labeled examples.

Good prompt pattern:

You're the front-door agent for Acme Corp. Your only job
is to figure out who the caller needs and route them.
Do not try to answer their question yourself unless it
fits one of the allowed "handle directly" categories.

DEPARTMENTS:
- sales: pricing, demos, new accounts, upgrades
- support: existing customer bugs, login issues, how-to
- billing: invoices, payment methods, refunds
- partnerships: BD, integrations, reseller inquiries
- other: anything not above โ†’ route to operator

HANDLE DIRECTLY (no route):
- office hours, location, general info
- "how do I reach [named person]?" โ†’ transfer

After classifying, call route_to(department, context).

Test this against a sample of 100 real calls before go-live. Your misroute rate should be under 10%.

For a deeper treatment of prompt patterns, see designing system prompts for multi-turn voice conversations.

The warm hand-off contract

The biggest quality gain from AI routing comes from hand-off context. The caller said their reason. The department receiving the transfer should see that reason.

Implementation:

  1. Agent captures intent and brief context.
  2. Agent calls route_to(department, context) function.
  3. The function either (a) dials the department and screen-pops the context to the receiving rep, (b) opens a ticket with the context pre-filled and the call is answered with that ticket context, or (c) warm-transfers via a three-way bridge where the AI briefs the human first.

Any of these beats the IVR-era pattern where the caller re-explains everything from scratch.

For the integration patterns, see connecting voice agents to salesforce CRM and how AI agents coordinate with helpdesks like Zendesk.

Handle "human please" instantly

Some callers know what they want and it isn't an AI. When they say:

  • "Operator"
  • "Can I talk to a person?"
  • "I just need to speak to someone"

The agent transfers. Immediately. No trying to "help first." This is table stakes. Skipping this step is the single most common complaint about AI routers.

Write this as a hard rule in the system prompt and verify it in testing.

The routes that should never automate

Some intents should go straight to a human regardless of apparent intent match:

  • Visible emotion or crisis. Anger, panic, grief โ€” immediate human.
  • Ambiguous intent after two clarifications. If you've asked twice and still don't know, route to operator.
  • Mentions of litigation, regulatory, media. Route to your legal or PR-designated intake.
  • Named executives or VIP customers. Always warm-transfer.

Common failure modes

Overloaded intent classes. "Support" ends up handling everything because you didn't split sales vs support vs billing cleanly. Split earlier than you think.

Rigid menu mirroring. Team models the AI like an IVR tree. Agent asks "is this sales, support, or billing?" Caller says "uhh, support I guess." You've lost the natural-language advantage.

Missing fallback. No "other" route. Caller with an unusual intent gets bounced around.

No cross-department awareness. Caller says "I want to upgrade and also my last invoice was wrong." Agent routes to sales; billing question gets forgotten.

No measurement. No feedback loop. Team has no idea whether routing accuracy is 92% or 72%.

Measuring routing quality

  • Misroute rate. Sample calls; human graders label correct department. Target < 10%.
  • Abandonment rate. % of callers who hang up during or after routing.
  • Time-to-human. Median seconds from call pickup to connected agent.
  • First-department resolution. % of calls that don't get bounced between departments.
  • Zero-out rate. % of callers who ask for a human. High = your AI is annoying people; drill in.

For the framework, see how to measure voice agent quality.

FAQ

How many departments is too many? Beyond 8โ€“10, routing accuracy degrades. If you need more, consider a two-level tree โ€” first route to a "super-department" (customer-facing vs internal), then refine.

Should the agent stay on the line during hand-off? Warm transfers (agent stays to brief the human) have higher CSAT. Cold transfers are faster. Mix based on call type.

What if departments have different hours? Route to the in-hours destination. For out-of-hours, route to a callback booking or an on-call rotation.

Can the agent handle cross-department intents? Yes, but it's harder. Queue the secondary intent as a ticket that lands on the other department after the primary call.

How is this different from an IVR with speech recognition? Speech-enabled IVR forces callers into predefined buckets via voice instead of DTMF. A conversational AI actually understands free-form intent and can handle follow-ups. For the comparison, see voice agents vs IVR: a side-by-side comparison.

Rohan Pavuluri
Rohan Pavuluri
Building SIMBA Voice Agents

Rohan Pavuluri builds SIMBA Voice Agents at Speechify. Previously, he founded and led Upsolve, the largest nonprofit in the United States serving low-income Americans through technology. He writes about real-world voice-agent deployments โ€” customer support, outbound sales, AI receptionists โ€” and the practical product, design, and operational lessons that actually move the needle.

More from Rohan Pavuluri

View all โ†’

Related reading

Voice AI, twice a month.

Get the best of the SIMBA resources hub โ€” new articles, trend notes, and operator guides. No spam.