AI Con USA 2026 - Test Automation Engineer
Customize your AI Con USA 2026 experience with sessions covering test automation for engineers.
Monday, June 8
A Quality Engineering Introduction to AI and Machine Learning
Although there are several controversies and misunderstandings surrounding AI and machine learning, one thing is apparent — people have quality concerns about the safety, reliability, and trustworthiness of these types of systems. Not only are ML-based systems shrouded in mystery due to their largely black-box nature, they also tend to be unpredictable since they can adapt and learn new things at runtime. Validating ML systems is challenging and requires a cross-section of knowledge, skills, and experience from areas such as mathematics, data science, software engineering, cyber-security,...
Tuesday, June 9
Prompt Engineering for Software Practitioners
With the sudden rise of ChatGPT and large language models (LLMs), practitioners are using these tools for all aspects of engineering. This includes leveraging LLMs for creating software artifacts such as requirements documents, source code, and tests; reviewing them for issues and making corrective suggestions, and analyzing or summarizing results or outcomes. However, if LLM's are not fed good prompts describing the task that the AI is supposed to perform, their responses can be inaccurate and unreliable. Join Tariq King as he teaches you how to craft high-quality AI prompts and...
AI-Enabled Building: Let the Robot Do the Work
NewTheory is great, but what about getting your hands dirty with some real problem-solving? Lets build your own AI Operating System that you'll take home and use immediately. Join Melissa Benua and Ryan Lee for a hands-on session where you'll construct a personalized AI toolkit that solves YOUR specific testing problems, regardless of your coding background. We'll start by deconstructing the modern software development lifecycle used by all tech companies to safely ship software solutions to their customers, and show you exactly where AI accelerates each phase. Then we'll prove a critical...
Strategies for Testing Autonomous AI and Multi-Agent Architectures
NewTesting Artificial Intelligence (AI) agents presents a paradigm shift from traditional software quality assurance. Unlike deterministic, rule-based applications, AI agents exhibit emergent behaviors, learn from their environments, and make autonomous decisions, making conventional test case design and execution insufficient. This tutorial will provide a comprehensive understanding of the unique challenges and advanced strategies required to effectively test single and multi-agent AI systems. Participants will learn how testing agents differ significantly from testing traditional software....
Wednesday, June 10
Why Your Agentic PR Never Gets Approved—Going from Vibe Coding to Agentic Engineering
You can write 100% of your code with AI, and only be 15% more productive. Want to know why? Solving the problem of moving faster as an engineer is about way more than code. You design, you problem solve, you discuss and communicate, you test, you shepherd the PR through review, you deploy, and you observe. So why are you being told you should be 10x faster now that AI can write code? David will discuss practical solutions for safely accelerating your entire workflow with AI. He will look at how to collaborate with PM, how to use AI planning, how to ensure validations are solid and builds...
Thursday, June 11
Beyond the Chatbot: Building and Orchestrating Autonomous Security Agents
The next generation of security automation isn’t found in a chat interface—it’s found in Agents. While basic AI assistants can provide security advice and even remediate vulnerabilities, the real breakthrough for security teams lies in using an Agentic Workflow for security testing: the ability to build, customize, and orchestrate specialized agents that take ownership of the testing and remediation lifecycle. In this session, Jeffery Payne demonstrates how to move beyond conversational AI to create autonomous security agents using standardized formats compatible across tools like GitHub...