ishLab / Portfolio
Voice Agent Readiness logo

Project 05

Voice Agent Readiness

An interactive voice agent that gathers readiness evidence, measures session latency, traces tool activity, and exports findings as Markdown.

Voice Agent Readiness Review conducts a technical conversation for developers, solutions engineers, and product teams building voice AI. It captures evidence about latency, tool calling, failure handling, and observability, then maps each finding to a readiness state.

Review flow

The ElevenLabs-powered agent asks one question at a time, follows up on previous answers, and requests measurable evidence where needed. During the session, the application:

  • Reviews nine criteria across Latency & Turn-Taking, Tool Calling & Grounding, and Observability & Monitoring
  • Records evidence through client-side agent tool calls
  • Updates findings as the conversation progresses
  • Measures end-of-speech-to-first-audio latency for its own session
  • Shows a timestamped trace of speech events, tool calls, failures, and state changes
  • Exports a Markdown report with captured evidence and recommendations

Readiness states

Each criterion receives one of three states:

  • Ready: sufficient evidence shows that the capability is addressed
  • Needs Validation: the review cannot verify the capability
  • Needs Attention: the review identifies a known risk or gap

The model keeps an unverified result separate from a confirmed problem. For example, a tool timeout produces Needs Validation because the review could not verify the dependency.

Failure handling and observability

A controlled CRM health-check timeout exercises the failure path. The application records the timeout, updates session metrics and readiness state, and includes the event in the execution trace.

Speech events, tool activity, failures, and state changes remain visible during the review. This exposes the evidence behind each classification and the agent's measured session latency.

Report output

The exported Markdown report groups findings by readiness state. Each finding includes its captured evidence and a recommendation.

Tech stack

  • Next.js 16 with the App Router
  • React 19 and TypeScript
  • ElevenLabs React SDK for voice conversations and client-side agent tools
  • Zustand for tool-driven application state
  • Tailwind CSS v4 and shadcn/ui for the interface system
  • Three.js and React Three Fiber for the animated voice orb
  • Vitest for assessment, reporting, metrics, and end-to-end flow tests
  • Biome for linting and formatting