Guide: Using One AI Agent to Test Another AI Agent

Prerequisites

• Ensure you have two distinct Caller IDs.
• You will need access to both AI agents and the ability to configure agent settings.

Steps to Configure the Tester AI Agent

1. Write Your Tester Agent with the Target Audience in Mind

When creating your tester agent, it is important to craft its personality, tone, and types of queries with the target audience of your AI agent in mind. This will ensure realistic and meaningful interactions, reflecting real-world scenarios as closely as possible.

• Example: If the target audience of your primary agent is customer support, then your tester agent should ask questions a typical customer might ask.

2. Use the [] Statement for Variability

Incorporate the [] statement within your tester agent to make its responses or queries more variable. This helps simulate a diverse range of conversations, making testing more robust.

3. Ensure at Least Two Caller IDs

For testing to be successful, you need to configure at least two unique Caller IDs. This is crucial, as an AI agent cannot effectively interact with itself using the same Caller ID, leading to potential errors or failed tests.

Important Note: If there are not at least two different Caller IDs, the testing process will fail, as the agent would effectively be trying to call itself.

4. Create an Agent Group for Multiple Tester Personas

If you want to create more dynamic and extensive testing, consider creating an agent group. This allows you to simulate multiple tester personas interacting with the target AI agent.

Benefits of an Agent Group:

Diverse input to simulate different user demographics or behaviors.
The ability to vary tone, context, and testing scenarios.
Example Configuration:

Agent Group: Tester Personas
Tester 1: Casual User
Tester 2: Technical Expert
Tester 3: Frustrated Customer

5. Map the Tester Agent (or Group) to a Test Number

To initiate testing, you need to map your tester agent or agent group to a tester number. This allows you to use a specific number for testing purposes, ensuring a structured interaction with the target AI agent.

Mapping Example:
Tester Agent → Test Number: +1234567890
Target Agent → Test Number: +0987654321

6. Role-Playing Using Two Different Numbers
   To simulate an interaction where one AI agent calls the other, use two distinct numbers. You can do this by passing a second "taalk" number to initiate a call between the agents.

Role-Playing Setup:

Assign two separate "taalk" numbers to each agent.
Initiate a call from the tester agent to the target agent using these distinct numbers.
Example:

Tester Agent Number: +1112223333
Target Agent Number: +4445556666
Here, the tester agent can act like a typical user, asking questions and evaluating the responses provided by the target agent in a real conversational manner.

Best Practices
Script Realistic Interactions: Ensure the scenarios used for testing are reflective of real user conversations.
Test Edge Cases: Use the [] statement to introduce unexpected or complex queries that might reveal potential weaknesses in the target AI agent.
Rotate Caller IDs Regularly: This helps in minimizing redundancy and avoiding any blocked interactions due to repeated testing from the same Caller ID.
Troubleshooting Common Issues
Failed Test Initiation: Ensure there are two distinct Caller IDs. Agents with the same Caller ID cannot effectively communicate with each other.
Variable Responses Not Triggering: Double-check the syntax of the [] statement for errors, and make sure each option within it is valid and appropriately formatted.