Your Agent Hasn't Faced Adversity Yet!

Join us for an insightful session with FJ Collins from NYC as we explore how Intuit prepares their agents for real-world challenges.

Abstract

Every coach knows that a perfect play on a whiteboard can crumble under pressure. Why should we expect AI agents to perform any differently? In controlled environments, your agent faces no real opposition; in the real world, it encounters unexpected challenges. This talk will cover three proven strategies to transition your AI from being "meeting room ready" to "game day proven."

1. Scout Team Approach: Deploy adversarial "confused user" agents to test your product against unexpected scenarios before your customers do.
2. Watch the Film: Systematically calibrate AI judges against human ground truth (using Cohen's κ) to ensure the machine can make accurate decisions unsupervised.
3. Head Coach Role: While agents execute plays, a human must always have the final say on critical decisions.

These strategies are not mere drills; they are the foundation behind the agents powering Intuit's Expert Network of 31,000 experts. The key takeaway is clear: an AI earns trust not by performing well in practice, but by overcoming challenges it wasn't designed to face.

Location

This event will be held at Teamworking by TechNexus. Upon arrival, please head to the 12th floor where our reception team will greet you and guide you to the event room.

Parking & Transportation

The Civic Opera Building does not offer dedicated parking. Limited metered parking is available nearby. We recommend using iParkit or SpotHero for discounted parking options. The nearest parking garage is the CME Building (10 S. Wacker), with several others within a two-block radius.

The venue is highly walkable and conveniently located near multiple CTA train lines and bus stops, making public transportation a great option.

Agenda

• 6:00 - 6:30 Networking and Bites
• 6:30 - 6:45 Rising Star Speaker
• 6:50 - 7:30 Presentation
• 7:30 - 7:40 Q&A
• 7:40 - 8:00+ Networking and Wrap Up

Sponsors

• Food and Beverage: Focused, an exclusive LangChain partner and boutique consultancy dedicated to building production-ready AI systems.
• Venue: Teamworking by TechNexus

Continue the conversation between gatherings! Join our Discord.