AI Con USA 2024 - Big Data, Analytics, AI/Machine Learning for Testing

Monday, June 3

Tariq King
Test IO

A Quality Engineering Introduction to AI and Machine Learning

Monday, June 3, 2024 - 8:30am to 12:00pm

Although there are several controversies and misunderstandings surrounding AI and machine learning, one thing is apparent — people have quality concerns about the safety, reliability, and trustworthiness of these types of systems. Not only are ML-based systems shrouded in mystery due to their largely black-box nature, they also tend to be unpredictable since they can adapt and learn new things at runtime. Validating ML systems is challenging and requires a cross-section of knowledge, skills, and experience from areas such as mathematics, data science, software engineering, cyber-security,...


Evaluating and Testing Generative AI: Insights and Strategies

Monday, June 3, 2024 - 8:30am to 12:00pm

Generative AI (GenAI), exemplified by groundbreaking systems like ChatGPT and LLAMA, is revolutionizing the software landscape. These advanced technologies represent some of the most sophisticated software ever devised, capable of navigating an unprecedented range of prompts and questions, many of which have never been posed in human history. Their ability to generate varied responses to the same query and even fabricate answers when uncertain poses unique challenges in verification and testing. This talk delves into the intricacies of validating such systems and identifies areas needing...

Matt Payne

A Full Technical Breakdown of Data Generation with AI Models

Monday, June 3, 2024 - 1:00pm to 4:30pm

All successful AI projects start and end with the data. The problem? Not everyone has the data required to build AI models in a production setting. Dataset generation has grown significantly with the rise of generative AI, making it easy for anyone to get started with training models no matter how much of your own data you bring to the table. While this sounds great, there are a ton of variables that go into this process of successfully generating data for training. How much data is needed? What models should be used to generate data? How to prompt models to generate high-variance datasets...

Tariq King
Test IO

Leveraging Generative AI for Software Productivity

Monday, June 3, 2024 - 1:00pm to 4:30pm

Executive leaders across the globe have been asking a relatively simple yet profound question: Can we leverage generative AI to transform our business, enterprise, or industry? For software-based companies, focus has either been on differentiating their product and service offerings using this new technology. But how about leveraging generative AI to improve team productivity and efficiency? This may be possible but how do you measure its success? What are some of the key use cases within business analysis, development, and testing that software teams can use? Are there any pitfalls...

Tuesday, June 4

Phil LaFrance

Supercharge Your Workflow: To GitHub and Beyond

Tuesday, June 4, 2024 - 8:30am to 4:30pm

Whether you are new or experienced with GitHub this class is for you! Supercharging your workflow caters to anyone who wants to enhance their Agile and DevOps process with the capabilities of GitHub. GitHub has long been the premier site for open-source projects and is now turning a pivotal corner into becoming the predominant platform for all aspects of the development lifecycle. Some examples of this include; protecting company code through various GitHub Products or curating marketplace actions and workflows prior to use. This tutorial will look at how to leverage GitHub Actions (CI/CD...

Jeff Payne

MLOps: DevOps for Machine Learning

Tuesday, June 4, 2024 - 8:30am to 12:00pm

Much attention is given to machine learning model training and testing in the industry. While these activities are essential for producing a production-ready machine learning model, organizations face some critical business challenges that must be addressed when building and testing machine learning models. Things like the reproducibility of results, accuracy of predictions, reusability of components, and trackability of experimentation are all vital to the success of any application.  The term MLOps has emerged as a method for applying DevOps practices and automation to the machine...

Tariq King
Test IO

Prompt Engineering for Software Practitioners

Tuesday, June 4, 2024 - 8:30am to 12:00pm

With the sudden rise of ChatGPT and large language models (LLMs), practitioners are using these tools for all aspects of engineering. This includes leveraging LLMs for creating software artifacts such as requirements documents, source code, and tests; reviewing them for issues and making corrective suggestions, and analyzing or summarizing results or outcomes. However, if LLM's are not fed good prompts describing the task that the AI is supposed to perform, their responses can be inaccurate and unreliable. Join Tariq King as he teaches you how to craft high-quality AI prompts and...


Harnessing Generative AI in Software Testing: A Real-World Guide

Tuesday, June 4, 2024 - 1:00pm to 4:30pm

The advent of Generative AI (GenAI), including Large Language Models (LLMs) and tools like ChatGPT, is not just another technological shift—it's a paradigm change, particularly in the realm of software testing. Unlike the transitions to mobile or cloud computing, GenAI introduces both unparalleled utility and disruption in software quality assurance. This session is dedicated to demystifying GenAI in software testing, distinguishing hype from reality, and providing practical tools and techniques to enhance your team's software quality while also highlighting potential pitfalls and...

Wednesday, June 5

Dmitriy Gumeniuk
EPAM Systems

The Rise of the Virtual QA Engineer: Harnessing GenAI for a Productivity Boost—A Production Case Study

Wednesday, June 5, 2024 - 1:00pm to 1:30pm

In this talk, we will delve into the transformative journey of integrating GenAI into the core of our testing and development processes. This integration has not only enhanced our productivity by 15% but also yielded a 20% time savings and a significant cost reduction per test case. Want to know how? We'll explore the strategic implementation of GenAI, overcoming security challenges, leveraging diverse (LLMs), and the meticulous design of prompts that culminated in a prompt library. Our tailored extensions for the code editors and corporate chats exemplify the seamless fusion of AI with...

Ethan Ferguson
BOK Financial

Postman and AI: Transforming Manual QA to Quality Engineers

Wednesday, June 5, 2024 - 1:40pm to 2:10pm

Facing the dual challenge of enhancing deployment quality without extending regression testing time, Ethan Ferguson's team turned to automation. The team consisted mainly of manual QA professionals with a background in UI testing, not automation engineering. The question was how to leverage the existing team's skills to test services layers and develop stable release automation scripts. Utilizing prior experience in building Postman automation frameworks, they aimed to empower the team. Concurrent company changes included adopting Postman as the primary API testing tool and integrating...

Thursday, June 6

Jeff Carollo

Adventures in AI

Thursday, June 6, 2024 - 9:25am to 10:05am

Jeff will share select war stories from his career working on various AI projects, along with crucial mistakes made and lessons learned. The talk will be as informative as it will be entertaining.


Realizing the Potential of AI Tools for Software Development

Thursday, June 6, 2024 - 10:30am to 11:20am

In this keynote, we explore the transformative impact of AI tool adoption in software development, focusing on measuring the tangible benefits, implementing effective dashboarding for real-time insights, and linking time savings to strategic business outcomes. We delve into best practices for quantifying efficiency gains and how these advancements not only enhance immediate development processes but also contribute significantly to broader organizational goals. This discussion aims to equip attendees with actionable strategies for leveraging AI tools to achieve competitive advantage, drive...


Fully Autonomous Software Testing with GenAI

Thursday, June 6, 2024 - 11:30am to 12:00pm

For decades, the concept of software autonomously testing itself has been a tantalizing dream. The traditional approach to software development involves extensive human effort in clicking through applications, writing API and UI test scripts, and a multitude of manual tasks before releasing a new version. However, the rise of Generative AI (GenAI) is heralding a transformative era in software testing, enabling a future where machines can undertake the bulk of these testing tasks. GenAI's capabilities extend beyond creating music, images, and even product code—it now encompasses the...

Randy Hesse

How Gen AI and Prompt Engineering Turns Testers into Superheroes!

Thursday, June 6, 2024 - 1:40pm to 2:10pm

Envision a testing realm infused with AI-driven superpowers, where a reliable AI companion will revolutionize how we approach testing. This companion doesn't just assist; it transforms the adventure of creating test cases that span the full spectrum of possibilities and pinpointing bugs in the most unexpected places. This is the essence of AI-augmented testing, a paradigm where AI elevates testers to maestros, orchestrating a symphony of enhanced augmented test intelligence. Jonathan Wright will go beyond merely discussing the technological underpinnings (e.g., GNN, RAG, RGA, NLU). It's a...

Rob Nicoletti
HALO Strategies

Embrace AI Holistically and Unlock Your Growth Potential

Thursday, June 6, 2024 - 3:20pm to 4:00pm

In today's rapidly evolving business landscape, AI and machine learning are revolutionizing our operations, promising innovation and efficiency at every turn. But beyond the surface-level benefits lies a deeper transformation—the liberation of our most valuable resources: time, money, and clarity. Join HALO's Founder, Rob Nicoletti in this dynamic keynote as he shares the transformative power of embracing AI holistically. Discover how AI can propel us beyond mundane tasks, freeing us to make meaningful contributions in our work, lives, and in the world. Far from diminishing our humanity,...