Test Mode for Agent Builder Bob
Agent Builder Bob..... Bob the BUILDER.... can he fix it? YES HE CAN. BOB now has the ability to test the agent that he is building (with / for the user) when the new "Test" mode option is enabled for that conversation (and then evaluate, and fix / adjust).
When Test mode is enabled, Bob has additional instructions to test the Agent after he has gone through all the building steps with the user, including testing any tools, custom actions, subagents, etc that have been set up for that Agent. He'll also give the user an evaluation of the Agent's output against what its set of instructions was. We're still working on ironing this part out, so over the next week or so, you may see the behavior of his testing and evaluation change. You may then instruct him to make necessary adjustments to the agent based on his evaluation. Test out the 'Test' mode and provide us with any feedback!