Raahat Scenario Harness

Curated conversation replay against the real runtime with stepwise diagnostics, readable deltas, and deterministic checks.

Boarding Clear Booking

boarding_clear_booking · boarding · 1/1 turns executed

Scenario Summary

IDboarding_clear_booking
TitleBoarding Clear Booking
Categoryboarding
Turns1/1
Run Statecompleted
booking known

Seed State

UserKnown user
Phone919900000101
Seed Workflow
Seed State Machine

Current Runtime State

Routeboarding
Workflowboarding
State Machine
Stageready_for_availability_check

Checks And Lifecycle

Expectations Passed2
Expectations Failed0
Heuristic Warnings0
Stage advanced
Final assessmentScenario completed cleanly with no flagged issues.

Final Outcome

Completed

Completed vs partial run state.

Final Route

boarding

Current route at the end of the replay.

Final Workflow / State

boarding

Workflow preferred; state machine shown if no workflow is active.

Final Stage

ready_for_availability_check

Resolved from workflow progress or active snapshot.

Expectation Totals

Pass 2 Fail 0

Heuristic Totals

Warnings 0

Missing Fields

No unresolved workflow fields.

Lifecycle Events Seen

Stage advanced
Turn 1
boarding boarding ready_for_availability_check intent_match
Stage advanced New slots filled Memory updated
PASS PASS
User
Need boarding for 2 cats from Friday to Monday in Baner no pickup
Assistant
Got it. I have the dates, cat count, and area for the boarding stay. I’ll have the team confirm availability and get back to you.

What Changed This Turn

  • Workflow changed none -> boarding.
  • Stage advanced none -> ready_for_availability_check.
  • New slot filled: check_in_date=2026-03-20.
  • New slot filled: pet_count=2.
  • New slot filled: pickup_area=Baner.
  • New slot filled: pickup_required=False.
  • New slot filled: raw_date_text=friday.
  • New slot filled: request_kind=availability.
  • New slot filled: service_area=Baner.
  • New slot filled: stage=ready_for_availability_check.
  • Memory updated with area.
  • Memory updated with cat_count.
  • Memory updated with check_in_date.
  • Memory updated with date_phrase.
  • Memory updated with last_non_medical_domain.
  • Memory updated with pickup_required.
  • Memory updated with request_kind.
  • Snapshot version incremented to 1.

Expectation And Heuristic Results

Expectations
PASS: workflow_name matched expected value 'boarding' PASS: Action intent includes 'check_boarding_inventory'
Routing And Interpretation
{
  "confidence": 0.9,
  "reason_codes": [
    "intent_match"
  ],
  "route_type": "boarding",
  "workflow_name": "boarding"
}
{
  "confidence": 0.9,
  "entities": {
    "area": "baner",
    "cat_count": 2,
    "city": "pune",
    "date_phrase": "friday",
    "drop_area": "Monday In Baner No Pickup",
    "pickup_area": "Friday",
    "pickup_required": false,
    "zone": "west"
  },
  "is_vague": false,
  "primary_domain": "transport",
  "reason": "clear transport request",
  "secondary_domains": [
    "boarding"
  ],
  "should_continue_active_workflow": false,
  "should_preempt_active_workflow": false,
  "urgency_signal": "none"
}
Workflow Progress And Intents
{
  "missing_fields": [],
  "next_question": null,
  "notes": [],
  "stage": "ready_for_availability_check",
  "state_payload": {
    "check_in_date": "2026-03-20",
    "check_in_time_window": null,
    "check_out_date": null,
    "check_out_time_window": null,
    "duration_nights": null,
    "last_question_key": null,
    "medical_flags": [],
    "pet_count": 2,
    "pet_names": [],
    "pickup_area": "Baner",
    "pickup_required": false,
    "raw_date_text": "friday",
    "raw_duration_text": null,
    "request_kind": "availability",
    "service_area": "Baner",
    "special_needs": [],
    "stage": "ready_for_availability_check"
  },
  "status": "ready",
  "summary": "Aisha Scenario: 2 cats, 2026-03-20, Baner",
  "superseded_by": null,
  "workflow_name": "boarding"
}
[
  {
    "action_type": "collect_boarding_request",
    "idempotency_key": "a14d99c92dac49f8",
    "metadata": {
      "missing_fields": [],
      "normalized_slots": {
        "check_in_date": "2026-03-20",
        "check_in_time_window": null,
        "check_out_date": null,
        "check_out_time_window": null,
        "duration_nights": null,
        "medical_flags": [],
        "pet_count": 2,
        "pet_names": [],
        "pickup_area": "Baner",
        "pickup_required": false,
        "raw_date_text": "friday",
        "raw_duration_text": null,
        "request_kind": "availability",
        "service_area": "Baner",
        "special_needs": []
      },
      "snapshot_version": 1,
      "workflow_name": "boarding",
      "workflow_stage": "ready_for_availability_check"
    },
    "payload": {
      "check_in_date": "2026-03-20",
      "check_in_time_window": null,
      "check_out_date": null,
      "check_out_time_window": null,
      "duration_nights": null,
      "medical_flags": [],
      "pet_count": 2,
      "pet_names": [],
      "pickup_area": "Baner",
      "pickup_required": false,
      "raw_date_text": "friday",
      "raw_duration_text": null,
      "request_kind": "availability",
      "service_area": "Baner",
      "special_needs": []
    },
    "priority": "normal",
    "reason": "boarding workflow has enough structured detail for ops handling",
    "requires_admin_review": false,
    "source_workflow": "boarding",
    "status": "ready",
    "user_visible": false
  },
  {
    "action_type": "check_boarding_inventory",
    "idempotency_key": "417491c728be77b5",
    "metadata": {
      "missing_fields": [],
      "normalized_slots": {
        "check_in_date": "2026-03-20",
        "check_in_time_window": null,
        "check_out_date": null,
        "check_out_time_window": null,
        "duration_nights": null,
        "medical_flags": [],
        "pet_count": 2,
        "pet_names": [],
        "pickup_area": "Baner",
        "pickup_required": false,
        "raw_date_text": "friday",
        "raw_duration_text": null,
        "request_kind": "availability",
        "service_area": "Baner",
        "special_needs": []
      },
      "snapshot_version": 1,
      "workflow_name": "boarding",
      "workflow_stage": "ready_for_availability_check"
    },
    "payload": {
      "check_in_date": "2026-03-20",
      "check_in_time_window": null,
      "check_out_date": null,
      "check_out_time_window": null,
      "duration_nights": null,
      "medical_flags": [],
      "pet_count": 2,
      "pet_names": [],
      "pickup_area": "Baner",
      "pickup_required": false,
      "raw_date_text": "friday",
      "raw_duration_text": null,
      "request_kind": "availability",
      "service_area": "Baner",
      "special_needs": []
    },
    "priority": "normal",
    "reason": "boarding workflow is ready for an availability check",
    "requires_admin_review": false,
    "source_workflow": "boarding",
    "status": "ready",
    "user_visible": false
  },
  {
    "action_type": "request_boarding_admin_review",
    "idempotency_key": "1eb2a75d8bc89ec6",
    "metadata": {
      "missing_fields": [],
      "normalized_slots": {
        "check_in_date": "2026-03-20",
        "check_in_time_window": null,
        "check_out_date": null,
        "check_out_time_window": null,
        "duration_nights": null,
        "medical_flags": [],
        "pet_count": 2,
        "pet_names": [],
        "pickup_area": "Baner",
        "pickup_required": false,
        "raw_date_text": "friday",
        "raw_duration_text": null,
        "request_kind": "availability",
        "service_area": "Baner",
        "special_needs": []
      },
      "snapshot_version": 1,
      "workflow_name": "boarding",
      "workflow_stage": "ready_for_availability_check"
    },
    "payload": {
      "check_in_date": "2026-03-20",
      "check_in_time_window": null,
      "check_out_date": null,
      "check_out_time_window": null,
      "duration_nights": null,
      "medical_flags": [],
      "pet_count": 2,
      "pet_names": [],
      "pickup_area": "Baner",
      "pickup_required": false,
      "raw_date_text": "friday",
      "raw_duration_text": null,
      "request_kind": "availability",
      "service_area": "Baner",
      "special_needs": []
    },
    "priority": "normal",
    "reason": "boarding workflow is complete enough for team confirmation",
    "requires_admin_review": true,
    "source_workflow": "boarding",
    "status": "needs_admin_review",
    "user_visible": false
  },
  {
    "action_type": "request_availability_check",
    "idempotency_key": "a857490d8d8acfee",
    "metadata": {
      "missing_fields": [],
      "normalized_slots": {
        "check_in_date": "2026-03-20",
        "check_in_time_window": null,
        "check_out_date": null,
        "check_out_time_window": null,
        "duration_nights": null,
        "medical_flags": [],
        "pet_count": 2,
        "pet_names": [],
        "pickup_area": "Baner",
        "pickup_required": false,
        "raw_date_text": "friday",
        "raw_duration_text": null,
        "request_kind": "availability",
        "service_area": "Baner",
        "special_needs": []
      },
      "snapshot_version": 1,
      "workflow_name": "boarding",
      "workflow_stage": "ready_for_availability_check"
    },
    "payload": {
      "check_in_date": "2026-03-20",
      "check_in_time_window": null,
      "check_out_date": null,
      "check_out_time_window": null,
      "duration_nights": null,
      "medical_flags": [],
      "pet_count": 2,
      "pet_names": [],
      "pickup_area": "Baner",
      "pickup_required": false,
      "raw_date_text": "friday",
      "raw_duration_text": null,
      "request_kind": "availability",
      "service_area": "Baner",
      "special_needs": []
    },
    "priority": "normal",
    "reason": "boarding workflow is ready for an availability check",
    "requires_admin_review": true,
    "source_workflow": "boarding",
    "status": "needs_admin_review",
    "user_visible": false
  }
]
Conversation Before And After
{
  "active_state_machine": null,
  "active_workflow": null,
  "current_state": null,
  "entities": {},
  "messages": [],
  "phone": "919900000101",
  "service_actions": [],
  "started_at": "2026-03-16T22:31:46.502793+00:00",
  "triage_state": null,
  "updated_at": "2026-03-16T22:31:46.502796+00:00"
}
{
  "active_state_machine": null,
  "active_workflow": {
    "last_question_key": null,
    "missing_fields": [],
    "next_question": null,
    "stage": "ready_for_availability_check",
    "started_at": "2026-03-16T22:31:46.510851+00:00",
    "state_payload": {
      "check_in_date": "2026-03-20",
      "check_in_time_window": null,
      "check_out_date": null,
      "check_out_time_window": null,
      "duration_nights": null,
      "last_question_key": null,
      "medical_flags": [],
      "pet_count": 2,
      "pet_names": [],
      "pickup_area": "Baner",
      "pickup_required": false,
      "raw_date_text": "friday",
      "raw_duration_text": null,
      "request_kind": "availability",
      "service_area": "Baner",
      "special_needs": [],
      "stage": "ready_for_availability_check"
    },
    "status": "ready",
    "summary": "Aisha Scenario: 2 cats, 2026-03-20, Baner",
    "superseded_by": null,
    "updated_at": "2026-03-16T22:31:46.510853+00:00",
    "version": 1,
    "workflow_name": "boarding"
  },
  "current_state": "READY_FOR_AVAILABILITY_CHECK",
  "entities": {
    "area": "Baner",
    "cat_count": 2,
    "check_in_date": "2026-03-20",
    "date_phrase": "friday",
    "last_non_medical_domain": "boarding",
    "pickup_required": false,
    "request_kind": "availability"
  },
  "messages": [
    {
      "role": "user",
      "source": null,
      "text": "Need boarding for 2 cats from Friday to Monday in Baner no pickup",
      "timestamp": "2026-03-16T22:31:46.510890+00:00"
    },
    {
      "role": "assistant",
      "source": "B",
      "text": "Got it. I have the dates, cat count, and area for the boarding stay. I’ll have the team confirm availability and get back to you.",
      "timestamp": "2026-03-16T22:31:46.510892+00:00"
    }
  ],
  "phone": "919900000101",
  "service_actions": [],
  "started_at": "2026-03-16T22:31:46.510887+00:00",
  "triage_state": null,
  "updated_at": "2026-03-16T22:31:46.510913+00:00"
}
Memory And Trace
{
  "active_state_machine": null,
  "backend": "inmemory",
  "conversation_key_used": "919900000101",
  "conversation_keys": [
    "919900000101",
    "9900000101"
  ],
  "current_state": null,
  "loaded": true,
  "ping_ok": null,
  "redis_enabled": false,
  "thread_message_count": 0,
  "ttl_seconds_remaining": null
}
{
  "active_state_machine": null,
  "backend": "inmemory",
  "conversation_key_used": "919900000101",
  "conversation_keys": [
    "919900000101",
    "9900000101"
  ],
  "current_state": "READY_FOR_AVAILABILITY_CHECK",
  "loaded": true,
  "ping_ok": null,
  "redis_enabled": false,
  "thread_message_count": 2,
  "ttl_seconds_remaining": null
}
[
  {
    "component": "brain",
    "payload": {
      "channel": "scenario_harness",
      "conversation_key": "919900000101",
      "message_text": "Need boarding for 2 cats from Friday to Monday in Baner no pickup",
      "normalized_phone": "919900000101",
      "phone": "919900000101"
    },
    "stage": "input",
    "summary": "Received normalized message envelope",
    "timestamp": "2026-03-16T22:31:46.510275+00:00"
  },
  {
    "component": "memory_store",
    "payload": {
      "active_state_machine": null,
      "backend": "inmemory",
      "current_state": null,
      "loaded": true,
      "message_count": 0,
      "storage_key": "919900000101"
    },
    "stage": "memory",
    "summary": "Loaded conversation memory",
    "timestamp": "2026-03-16T22:31:46.510280+00:00"
  },
  {
    "component": "brain",
    "payload": {
      "has_prior_triage_state": false,
      "prior_state_error": null
    },
    "stage": "state",
    "summary": "Parsed prior working state",
    "timestamp": "2026-03-16T22:31:46.510281+00:00"
  },
  {
    "component": "brain",
    "payload": {
      "compact_payload_keys": [
        "customer",
        "incoming_message"
      ],
      "has_conversation": true,
      "has_customer": true,
      "has_icp": false,
      "has_profile": false,
      "recent_import_count": 0,
      "storage_key": "919900000101"
    },
    "stage": "context",
    "summary": "Assembled SessionContext for the turn",
    "timestamp": "2026-03-16T22:31:46.510285+00:00"
  },
  {
    "component": "contact_resolver",
    "payload": {
      "confidence": 1.0,
      "customer_id": 7,
      "display_name": "Aisha Scenario",
      "matched_phone": "919900000101",
      "status": "KNOWN"
    },
    "stage": "decision",
    "summary": "Resolved sender contact status",
    "timestamp": "2026-03-16T22:31:46.510291+00:00"
  },
  {
    "component": "turn_interpretation",
    "payload": {
      "confidence": 0.9,
      "contact_status": "KNOWN",
      "entities": {
        "area": "baner",
        "cat_count": 2,
        "city": "pune",
        "date_phrase": "friday",
        "drop_area": "Monday In Baner No Pickup",
        "pickup_area": "Friday",
        "pickup_required": false,
        "zone": "west"
      },
      "is_vague": false,
      "primary_domain": "transport",
      "reason": "clear transport request",
      "secondary_domains": [
        "boarding"
      ],
      "should_continue_active_workflow": false,
      "should_preempt_active_workflow": false,
      "urgency_signal": "none"
    },
    "stage": "decision",
    "summary": "Resolved turn interpretation deterministically",
    "timestamp": "2026-03-16T22:31:46.510474+00:00"
  },
  {
    "component": "profile_context",
    "payload": {
      "customer_id": 7,
      "customer_name": "Aisha Scenario",
      "has_latest_icp": false,
      "has_latest_profile": false,
      "recent_import_count": 0
    },
    "stage": "context",
    "summary": "Loaded customer intelligence context",
    "timestamp": "2026-03-16T22:31:46.510482+00:00"
  },
  {
    "component": "entry_policy",
    "payload": {
      "allow_identity_question": false,
      "bypass_onboarding": true,
      "defer_existing_workflow": false,
      "preempt_active_workflow": false,
      "reason": "known contact with a clear request should route directly",
      "run_welcome_orientation": false,
      "selected_posture": "known_direct_route"
    },
    "stage": "decision",
    "summary": "Determined entry posture for this turn",
    "timestamp": "2026-03-16T22:31:46.510484+00:00"
  },
  {
    "component": "intent_parser",
    "payload": {
      "continue_active_workflow": false,
      "primary_intent": "boarding_request",
      "reason": "matched_keyword_rules",
      "resolved_state_machine": "boarding",
      "workflow_source": "intent_match"
    },
    "stage": "decision",
    "summary": "Resolved primary intent and state machine",
    "timestamp": "2026-03-16T22:31:46.510524+00:00"
  },
  {
    "component": "context_builder",
    "payload": {
      "active_workflow": "boarding",
      "background_fact_count": 0,
      "current_step": null,
      "foreground_fact_count": 6,
      "prompt_family": "general",
      "purpose": "workflow_response"
    },
    "stage": "context",
    "summary": "Built workflow-response context slice for prompt assembly",
    "timestamp": "2026-03-16T22:31:46.510562+00:00"
  },
  {
    "component": "workflow",
    "payload": {
      "action_intents": [
        {
          "action_type": "collect_boarding_request",
          "idempotency_key": "a14d99c92dac49f8",
          "metadata": {
            "missing_fields": [],
            "normalized_slots": {
              "check_in_date": "2026-03-20",
              "check_in_time_window": null,
              "check_out_date": null,
              "check_out_time_window": null,
              "duration_nights": null,
              "medical_flags": [],
              "pet_count": 2,
              "pet_names": [],
              "pickup_area": "Baner",
              "pickup_required": false,
              "raw_date_text": "friday",
              "raw_duration_text": null,
              "request_kind": "availability",
              "service_area": "Baner",
              "special_needs": []
            },
            "snapshot_version": 1,
            "workflow_name": "boarding",
            "workflow_stage": "ready_for_availability_check"
          },
          "payload": {
            "check_in_date": "2026-03-20",
            "check_in_time_window": null,
            "check_out_date": null,
            "check_out_time_window": null,
            "duration_nights": null,
            "medical_flags": [],
            "pet_count": 2,
            "pet_names": [],
            "pickup_area": "Baner",
            "pickup_required": false,
            "raw_date_text": "friday",
            "raw_duration_text": null,
            "request_kind": "availability",
            "service_area": "Baner",
            "special_needs": []
          },
          "priority": "normal",
          "reason": "boarding workflow has enough structured detail for ops handling",
          "requires_admin_review": false,
          "source_workflow": "boarding",
          "status": "ready",
          "user_visible": false
        },
        {
          "action_type": "check_boarding_inventory",
          "idempotency_key": "417491c728be77b5",
          "metadata": {
            "missing_fields": [],
            "normalized_slots": {
              "check_in_date": "2026-03-20",
              "check_in_time_window": null,
              "check_out_date": null,
              "check_out_time_window": null,
              "duration_nights": null,
              "medical_flags": [],
              "pet_count": 2,
              "pet_names": [],
              "pickup_area": "Baner",
              "pickup_required": false,
              "raw_date_text": "friday",
              "raw_duration_text": null,
              "request_kind": "availability",
              "service_area": "Baner",
              "special_needs": []
            },
            "snapshot_version": 1,
            "workflow_name": "boarding",
            "workflow_stage": "ready_for_availability_check"
          },
          "payload": {
            "check_in_date": "2026-03-20",
            "check_in_time_window": null,
            "check_out_date": null,
            "check_out_time_window": null,
            "duration_nights": null,
            "medical_flags": [],
            "pet_count": 2,
            "pet_names": [],
            "pickup_area": "Baner",
            "pickup_required": false,
            "raw_date_text": "friday",
            "raw_duration_text": null,
            "request_kind": "availability",
            "service_area": "Baner",
            "special_needs": []
          },
          "priority": "normal",
          "reason": "boarding workflow is ready for an availability check",
          "requires_admin_review": false,
          "source_workflow": "boarding",
          "status": "ready",
          "user_visible": false
        },
        {
          "action_type": "request_boarding_admin_review",
          "idempotency_key": "1eb2a75d8bc89ec6",
          "metadata": {
            "missing_fields": [],
            "normalized_slots": {
              "check_in_date": "2026-03-20",
              "check_in_time_window": null,
              "check_out_date": null,
              "check_out_time_window": null,
              "duration_nights": null,
              "medical_flags": [],
              "pet_count": 2,
              "pet_names": [],
              "pickup_area": "Baner",
              "pickup_required": false,
              "raw_date_text": "friday",
              "raw_duration_text": null,
              "request_kind": "availability",
              "service_area": "Baner",
              "special_needs": []
            },
            "snapshot_version": 1,
            "workflow_name": "boarding",
            "workflow_stage": "ready_for_availability_check"
          },
          "payload": {
            "check_in_date": "2026-03-20",
            "check_in_time_window": null,
            "check_out_date": null,
            "check_out_time_window": null,
            "duration_nights": null,
            "medical_flags": [],
            "pet_count": 2,
            "pet_names": [],
            "pickup_area": "Baner",
            "pickup_required": false,
            "raw_date_text": "friday",
            "raw_duration_text": null,
            "request_kind": "availability",
            "service_area": "Baner",
            "special_needs": []
          },
          "priority": "normal",
          "reason": "boarding workflow is complete enough for team confirmation",
          "requires_admin_review": true,
          "source_workflow": "boarding",
          "status": "needs_admin_review",
          "user_visible": false
        },
        {
          "action_type": "request_availability_check",
          "idempotency_key": "a857490d8d8acfee",
          "metadata": {
            "missing_fields": [],
            "normalized_slots": {
              "check_in_date": "2026-03-20",
              "check_in_time_window": null,
              "check_out_date": null,
              "check_out_time_window": null,
              "duration_nights": null,
              "medical_flags": [],
              "pet_count": 2,
              "pet_names": [],
              "pickup_area": "Baner",
              "pickup_required": false,
              "raw_date_text": "friday",
              "raw_duration_text": null,
              "request_kind": "availability",
              "service_area": "Baner",
              "special_needs": []
            },
            "snapshot_version": 1,
            "workflow_name": "boarding",
            "workflow_stage": "ready_for_availability_check"
          },
          "payload": {
            "check_in_date": "2026-03-20",
            "check_in_time_window": null,
            "check_out_date": null,
            "check_out_time_window": null,
            "duration_nights": null,
            "medical_flags": [],
            "pet_count": 2,
            "pet_names": [],
            "pickup_area": "Baner",
            "pickup_required": false,
            "raw_date_text": "friday",
            "raw_duration_text": null,
            "request_kind": "availability",
            "service_area": "Baner",
            "special_needs": []
          },
          "priority": "normal",
          "reason": "boarding workflow is ready for an availability check",
          "requires_admin_review": true,
          "source_workflow": "boarding",
          "status": "needs_admin_review",
          "user_visible": false
        }
      ],
      "missing_fields": [],
      "next_question": null,
      "stage": "ready_for_availability_check",
      "status": "ready",
      "summary": "Aisha Scenario: 2 cats, 2026-03-20, Baner",
      "workflow_name": "boarding"
    },
    "stage": "decision",
    "summary": "Executed deterministic workflow handler",
    "timestamp": "2026-03-16T22:31:46.510872+00:00"
  },
  {
    "component": "memory_store",
    "payload": {
      "active_state_machine": null,
      "current_state": "READY_FOR_AVAILABILITY_CHECK",
      "message_count_after": 2,
      "storage_key": "919900000101"
    },
    "stage": "mutation",
    "summary": "Persisted updated conversation memory",
    "timestamp": "2026-03-16T22:31:46.511360+00:00"
  }
]