Conference Schedule

Sunday, June 2

Registration—7:30am–5:00pm
7:30 am to 5:00 pm
Breakfast—7:30am–8:30am
7:30 am to 8:30 am
Multi-Day Training Classes Begin—8:30am–5:00pm
8:30 am to 5:00 pm
AI for Testers
Jonathan Miller Kauffman
8:30 am to 5:00 pm

This hands-on course helps testers understand the role of Artificial Intelligence (AI) and Machine Learning (ML) in testing and software quality assurance.

MLOps: DevOps for Machine Learning
Tom Stiehm
8:30 am to 5:00 pm

Learn how to apply DevOps knowledge to the machine learning and AI development, test, delivery, and operations process.

GitHub Copilot for Developers
Phil LaFrance
8:30 am to 5:00 pm

This hands-on course helps software developers understand how to effectively incorporate Copilot into their software developer workflow.

Getting Started with Machine Learning
Jeffery Payne
8:30 am to 5:00 pm

Unravel the complexities of machine learning and AI in an approachable way in this course designed for any role or background.

Lunch—12:00pm–1:00pm
12:00 pm to 1:00 pm
Training Classes Continue—1:00pm–5:00pm
1:00 pm to 5:00 pm

Monday, June 3

Registration—7:00am–5:00pm
7:00 am to 5:00 pm
Breakfast—7:30am–8:30am
7:30 am to 8:30 am
Multi-Day Training Classes Continue—8:30am–5:00pm
8:30 am to 5:00 pm
Full & Half-Day Tutorials—8:30am–12:00pm
8:30 am to 12:00 pm
Tutorial Getting Started with AI and Machine Learning
Dionny Santiago
8:30 am to 12:00 pm

Are you a software professional who would like to learn to use AI and machine learning (ML), but don't know how to get started? One of the best ways to get into ML is by designing and completing small projects. Although you will ultimately need to understand the fundamentals of AI/ML, there's no reason why you can't learn foundational terms, concepts and principles as you put them into practice. Join Dionny Santiago as he introduces you to the world of applied machine learning. Dionny will guide you through a series of ML projects end-to-end, enabling you to gain experience with creating...Read more

Tutorial A Quality Engineering Introduction to AI and Machine Learning
Tariq King
8:30 am to 12:00 pm

Although there are several controversies and misunderstandings surrounding AI and machine learning, one thing is apparent — people have quality concerns about the safety, reliability, and trustworthiness of these types of systems. Not only are ML-based systems shrouded in mystery due to their largely black-box nature, they also tend to be unpredictable since they can adapt and learn new things at runtime. Validating ML systems is challenging and requires a cross-section of knowledge, skills, and experience from areas such as mathematics, data science, software engineering, cyber-security...Read more

Tutorial Evaluating and Testing Generative AI: Insights and Strategies
Jason Arbon
8:30 am to 12:00 pm

Generative AI (GenAI), exemplified by groundbreaking systems like ChatGPT and LLAMA, is revolutionizing the software landscape. These advanced technologies represent some of the most sophisticated software ever devised, capable of navigating an unprecedented range of prompts and questions, many of which have never been posed in human history. Their ability to generate varied responses to the same query and even fabricate answers when uncertain poses unique challenges in verification and testing. This talk delves into the intricacies of validating such systems and identifies areas needing...Read more

Lunch—12:00pm–1:00pm
12:00 pm to 1:00 pm
Full & Half-Day Tutorials Continue—1:00pm–4:30pm
1:00 pm to 4:30 pm
Tutorial A Full Technical Breakdown of Data Generation with AI Models
Matt Payne
1:00 pm to 4:30 pm

All successful AI projects start and end with the data. The problem? Not everyone has the data required to build AI models in a production setting. Dataset generation has grown significantly with the rise of generative AI, making it easy for anyone to get started with training models no matter how much of your own data you bring to the table. While this sounds great, there are a ton of variables that go into this process of successfully generating data for training. How much data is needed? What models should be used to generate data? How to prompt models to generate high-variance datasets...Read more

Tutorial Leveraging Generative AI for Software Productivity
Tariq King
1:00 pm to 4:30 pm

Executive leaders across the globe have been asking a relatively simple yet profound question: Can we leverage generative AI to transform our business, enterprise, or industry? For software-based companies, focus has either been on differentiating their product and service offerings using this new technology. But how about leveraging generative AI to improve team productivity and efficiency? This may be possible but how do you measure its success? What are some of the key use cases within business analysis, development, and testing that software teams can use? Are there any pitfalls that...Read more

Tutorial Get Your Data Ready for AI/ML
Joshua Powers
1:00 pm to 4:30 pm

Understanding the readiness of your source data before you launch an expensive AI/ML project lets you take corrective data engineering measures that will streamline the project and give you the best probability of a successful outcome. Artificial Intelligence (AI) and Machine Learning (ML) projects can provide significant returns on investment when they are applied to narrow but difficult business problems and are supported by adequate amounts of relevant, quality data. Many such projects start with high hopes but get derailed due to fundamental problems with source data, which were...Read more

Tutorial Augmenting AI Applications with Semantic Kernel and AI Orchestration
Matt Eland
1:00 pm to 4:30 pm

Chatting with large language models has been all the rage the past year and a half, but ChatGPT and its brethren have their limits. First, their data is only as current as when they were trained. Secondly, they struggle to interact with your data and your systems. Third, AI systems can be hard to ground against hallucinations and safely extend. In this talk, Matt will look at Semantic Kernel, Microsoft's new open-source AI Orchestration framework, and see how it supports retrieval augmentation generation and AI Orchestration workflows to address these concerns. He will cover the basics of...Read more

Speed Networking—5:15pm–6:00pm
5:15 pm to 6:00 pm

Tuesday, June 4

Breakfast—7:30am–8:30am
7:30 am to 8:30 am
Registration—7:30am–5:00pm
7:30 am to 5:00 pm
Full & Half-Day Tutorials—8:30am–12:00pm
8:30 am to 12:00 pm
Tutorial Supercharge Your Workflow: To GitHub and Beyond
Dalton Forbes, Phil LaFrance
8:30 am to 4:30 pm

Whether you are new or experienced with GitHub this class is for you! Supercharging your workflow caters to anyone who wants to enhance their Agile and DevOps process with the capabilities of GitHub. GitHub has long been the premier site for open-source projects and is now turning a pivotal corner into becoming the predominant platform for all aspects of the development lifecycle. Some examples of this include; protecting company code through various GitHub Products or curating marketplace actions and workflows prior to use. This tutorial will look at how to leverage GitHub Actions (CI/CD...Read more

Tutorial MLOps: DevOps for Machine Learning
Jeffery Payne
8:30 am to 12:00 pm

Much attention is given to machine learning model training and testing in the industry. While these activities are essential for producing a production-ready machine learning model, organizations face some critical business challenges that must be addressed when building and testing machine learning models. Things like the reproducibility of results, accuracy of predictions, reusability of components, and trackability of experimentation are all vital to the success of any application. The term MLOps has emerged as a method for applying DevOps practices and automation to the machine...Read more

Tutorial Prompt Engineering for Software Practitioners
Tariq King
8:30 am to 12:00 pm

With the sudden rise of ChatGPT and large language models (LLMs), practitioners are using these tools for all aspects of engineering. This includes leveraging LLMs for creating software artifacts such as requirements documents, source code, and tests; reviewing them for issues and making corrective suggestions, and analyzing or summarizing results or outcomes. However, if LLM's are not fed good prompts describing the task that the AI is supposed to perform, their responses can be inaccurate and unreliable. Join Tariq King as he teaches you how to craft high-quality AI prompts and...Read more

Lunch—12:00pm–1:00pm
12:00 pm to 1:00 pm
Full & Half-Day Tutorials Continue—1:00pm–4:30pm
1:00 pm to 4:30 pm
Tutorial Harnessing Generative AI in Software Testing: A Real-World Guide
Jason Arbon
1:00 pm to 4:30 pm

The advent of Generative AI (GenAI), including Large Language Models (LLMs) and tools like ChatGPT, is not just another technological shift—it's a paradigm change, particularly in the realm of software testing. Unlike the transitions to mobile or cloud computing, GenAI introduces both unparalleled utility and disruption in software quality assurance. This session is dedicated to demystifying GenAI in software testing, distinguishing hype from reality, and providing practical tools and techniques to enhance your team's software quality while also highlighting potential pitfalls and...Read more

Tutorial Image Classification using LLMs and Transfer Learning
Jeffery Payne
1:00 pm to 4:30 pm

Large language models, like Generative Pre-trained Transformers (GPTs) to create textual content in ChatBots and other Generative AI applications, have garnered much attention recently. However, not all data is textual. Another important use of LLMs is for image processing to address real-world problems such as: real-time object recognition, classification of images, and generation of modern art. Jeffery Payne will explore how large language models for images (also known as visual language models - VLMs) can be used for image classification, object detection, image capture generation, and...Read more

Tutorial Beginning Data Analysis and Machine Learning with Jupyter Notebooks
Matt Eland
1:00 pm to 4:30 pm

In this beginner-friendly workshop you'll see how you can get started with data analytics and data science using Jupyter Notebooks. Matt will start with the basics of notebooks and then move on to using Python, Pandas, and NumPy to perform basic exploratory data analysis. See how you can use Plotly Express to create interactive charts and visuals with only a minimal amount of code. Once you've grasped the basics of understanding and visualizing the data Matt will move on to machine learning with SciKit-Learn as you train and evaluate predictive regression and classification models. The...Read more

Wednesday, June 5

Registration—7:00am–4:00pm
7:00 am to 4:00 pm
Breakfast—7:30am–8:30am
7:30 am to 8:30 am
Keynote I Got 99 Problems, but AI Ain't One
Dona Sarkar, Microsoft
8:30 am to 9:25 am

How many of you have heard that AI is here to take your job? Yeah, exactly. Us too. Apparently, AI is here to take ALL the jobs. Yet, here we are, employed and busier than EVER. Did you know that every large tech company has announced AI products this year with the promise to transform your business? Join Dona to learn: What in this latest AI craze is hype, and what is real? What are successful companies actually doing with AI these days? What are three things that you ABSOLUTELY should be doing in the next six months to get your business ready to implement AI in a secure and responsible...Read more

Keynote AI/ML Adoption Strategies for Enterprises
Hien Luu, DoorDash
9:25 am to 10:05 am

It is evident that AI/ML is significantly impacting how businesses operate, transforming the enterprise landscape in various ways, enhancing customer experience, improving efficiency, and reducing costs. The desire to incorporate AI/ML is there, but enterprises often struggle with where to start or how to do it in a repeatable and sustainable manner. Hien will discuss the key challenges to AI/ML adoption and share practical strategies for overcoming them. He will explore the critical factors that drive successful implementation, including data readiness, organizational culture, and...Read more

Keynote The Unseen Engine of AI: How 5 Innovation-Minded Companies Optimized for Operational Efficiency
Nevra Ledwon, DecisionBrain
10:05 am to 10:45 am

Why does one of the AI domains with the highest ROI frequently go unnoticed in mainstream discussions about AI? Could it be that Mathematical Optimization, with its equations and complex algorithms, is too often seen as the exclusive domain of PhDs in operations research or industrial engineering? Thankfully, optimization tools and techniques are now more accessible than ever. In this session, we will explore how mathematical optimization is transforming operational decision-making. We will detail how five innovation-minded companies across diverse sectors are applying optimization...Read more

Visit the Expo—10:30am–7pm
10:30 am to 7:00 pm
Networking Break in the Expo—10:45am–11:25am
10:45 am to 11:25 am
Concurrent Sessions—11:25am–11:55am
11:25 am to 11:55 am
Concurrent Session A Time Traveler's Playbook for Prompting GitHub Copilot
Rizel Scarlett, TBD
11:25 am to 11:55 am

Generative AI coding assistants are changing how we code, but it can feel frustrating when these tools produce irrelevant or absent suggestions. Like any emerging tech, the new tools have a learning curve. Join GitHub Copilot–enthusiast Rizel Scarlett as she shares proven strategies and expert tips to transform your random prompts into intentional ones, unlocking a world of game-changing suggestions. Get inspired, get creative, and get ready to embrace the future of coding!Read more

Concurrent Session AI Risk and Safety: Proactive Monitoring for the Future of Humanity and Business
Jason Arbon, Checkie.AI
11:25 am to 11:55 am

In an era where AI's capabilities are rapidly advancing, the question of safety and risk management becomes paramount. While AI currently serves as a beneficial tool, its potential evolution poses significant risks. The possibility of AI surpassing human intelligence, outperforming human capabilities, or developing biases misaligned with human values raises concerns about existential risks comparable to, or potentially exceeding, those of nuclear warfare. High-level attention, including inquiries from Congress and presidential directives, underscores the gravity of these concerns. Some...Read more

Lunch in the Expo—12:00pm–1:00pm
12:00 pm to 1:00 pm
Concurrent Sessions—1:00pm–1:30pm
1:00 pm to 1:30 pm
Concurrent Session The Rise of the Virtual QA Engineer: Harnessing GenAI for a Productivity Boost—A Production Case Study
Dmitriy Gumeniuk, EPAM Systems
1:00 pm to 1:30 pm

In this talk, we will delve into the transformative journey of integrating GenAI into the core of our testing and development processes. This integration has not only enhanced our productivity by 15% but also yielded a 20% time savings and a significant cost reduction per test case. Want to know how? We'll explore the strategic implementation of GenAI, overcoming security challenges, leveraging diverse (LLMs), and the meticulous design of prompts that culminated in a prompt library. Our tailored extensions for the code editors and corporate chats exemplify the seamless fusion of AI with...Read more

Concurrent Session Troubleshooting and Resolving Common LLM Issues In Production
Amber Roberts, Arize AI
1:00 pm to 1:30 pm

According to a recent survey, 61.7% of enterprise engineering teams now have or are planning to have a generative AI application within a year—and 14.1% are already in production. As enterprises race to deploy generative AI into their businesses, the need to ensure that LLMs are deployed reliably and responsibly is paramount. But how can enterprises and AI engineers evaluate and troubleshoot models in real time? In this session, Amber Roberts, a data scientist and machine learning engineer at Arize AI, will cover emerging best practices from direct work advising enterprises with real...Read more

Concurrent Sessions—1:40pm–2:10pm
1:40 pm to 2:10 pm
Concurrent Session Production Level Prompting & Techniques for LLMs
Matt Payne, Width.ai
1:40 pm to 2:10 pm

Let’s dive into what goes into creating expert-level prompts for ChatGPT and other LLMs. We will focus on the key ideas to take into account when prompting for any use case and how to better understand the results you get back. We’ll look at prompting 101, think about language, and explore advanced prompting frameworks. Some of the challenges we will address include: how to improve your results, how to process large text, why ChatGPT doesn't do what you want, what your prompt should look like, and many more!Read more

Concurrent Session Postman and AI: Transforming Manual QA to Quality Engineers
Ethan Ferguson, BOK Financial
1:40 pm to 2:10 pm

Facing the dual challenge of enhancing deployment quality without extending regression testing time, Ethan Ferguson's team turned to automation. The team consisted mainly of manual QA professionals with a background in UI testing, not automation engineering. The question was how to leverage the existing team's skills to test services layers and develop stable release automation scripts. Utilizing prior experience in building Postman automation frameworks, they aimed to empower the team. Concurrent company changes included adopting Postman as the primary API testing tool and integrating...Read more

Concurrent Sessions—2:20pm–2:50pm
2:20 pm to 2:50 pm
Concurrent Session Prompt Engineering for Mere Mortals
Tom Stiehm, Coveros
2:20 pm to 2:50 pm

Prompt Engineering is a skill that anyone can develop, even mere mortals. While Generative AI can produce amazing results, it isn’t magic. You don’t need to be an AI Wizard to learn to craft effective prompts that help you leverage Generative AI in a way that helps you complete your tasks and achieve your goals and objectives. Tom will break down the terms and use everyday examples to illustrate Prompt Engineering best practices so that you can more easily navigate the nuances of Generative AI. In this session, you will learn what Prompt Engineering is and how to use it to get the best...Read more

Concurrent Session Mad Data Science: Using AI to Build Ridiculous Things
Matt Eland, Leading EDJE
2:20 pm to 2:50 pm

Have you ever gotten into an argument on whether or not Die Hard is a Christmas movie and thought "If only machine learning could help" or "What could I do to automate my dog's daily routine and make his life easier" or "Is it possible to spend 3 months time to determine if I can sleep in 5 minutes tomorrow morning"? If so, you might get along with Matt Eland. Come join this lighthearted talk as he tours you through some ridiculous uses of AI and Machine Learning with topics ranging from large language models to reinforcement learning to simple regression algorithms. You'll get a brief...Read more

Networking Break in the Expo—2:50pm–3:30pm
2:50 pm to 3:30 pm
Keynote Operationalizing Disruptive Technologies: A Strategic Framework for Harnessing the Power of GenAI
Mary Thorn, S&P Global Ratings
3:30 pm to 4:10 pm

The advent of disruptive technologies, particularly in artificial intelligence, has ushered in a new era of possibilities and challenges. Join Mary as she proposes a comprehensive framework for operationalizing disruptive technologies, specifically focusing on the transformative potential of Generative Artificial Intelligence (GenAI). As organizations grapple with integrating GenAI into their operations, there is a pressing need for a structured approach that addresses technical, ethical, and organizational considerations. Mary will delve into a strategic framework designed to guide...Read more

Keynote AI: A Moderated Panel Discussion
Dionny Santiago, Indeed
4:10 pm to 5:10 pm

Description Coming Soon.Read more

Expo Reception—5:00pm–7:00pm
5:00 pm to 7:00 pm

Thursday, June 6

Breakfast—7:30am–8:30am
7:30 am to 8:30 am
Registration—8:00am–3:00pm
8:00 am to 3:00 pm
Keynote Humanizing AI
Tariq King, Test IO
8:30 am to 9:25 am

AI is becoming human—more human in the way it communicates, responding based on context, and matching the tone that we articulate.

AI is becoming human—quite human in what it generates, expressing itself through creative works and the solutions it quickly formulates.

AI is becoming human—which is evidenced by how well it imitates, deceiving us with convincing content even though we know it hallucinates.

AI is becoming human—is this something we'll appreciate? Or will humanizing AI be the end of us? The trigger to an apocalyptic human fate.

But if AI is...Read more

Keynote—Details Coming Soon
9:25 am to 10:05 am
Expo Open—10:00am–3:00pm
10:00 am to 3:00 pm
Networking Break in the Expo—10:05am–10:30am
10:05 am to 10:30 am
Keynote—Details Coming Soon
10:30 am to 11:20 am
Concurrent Sessions—11:30am–12:00pm
11:30 am to 12:00 pm
Concurrent Session Prototype at the Speed of Thought: How AI is Changing the Game for Creators
Rolf Mistelbacher, Fresh van Root
11:30 am to 12:00 pm

Most product ideas die on the backlog because we can't find the time, lack the skills, or fail to get others excited about them. But thanks to AI, that no longer has to be the case. Product Builders, Project Managers, DevOps Managers, and simply creators of all kinds can turn a napkin sketch into a clickable prototype within hours. Rolf Mistelbacher shares why AI is turbocharging prototyping and how the arrival of new AI-powered creator tools is driving that change. He shows how you can transform your idea into a clickable prototype without writing code—creating wireframes and a user...Read more

Concurrent Session Fully Autonomous Software Testing with GenAI
Jason Arbon, Checkie.AI
11:30 am to 12:00 pm

For decades, the concept of software autonomously testing itself has been a tantalizing dream. The traditional approach to software development involves extensive human effort in clicking through applications, writing API and UI test scripts, and a multitude of manual tasks before releasing a new version. However, the rise of Generative AI (GenAI) is heralding a transformative era in software testing, enabling a future where machines can undertake the bulk of these testing tasks. GenAI's capabilities extend beyond creating music, images, and even product code—it now encompasses the...Read more

Lunch in the Expo—12:00pm–1:00pm
12:00 pm to 1:00 pm
Concurrent Sessions—1:00pm–1:30pm
1:00 pm to 1:30 pm
Concurrent Session Game Over—AI Steals Data, Is Biased, and Produces Deep Fakes
Kevin Pyles, O.C. Tanner
1:00 pm to 1:30 pm

It has been two years, and ChatGPT and other Generative AI tools have taken the world by storm. We all still have jobs. Phew! However, AI is still wreaking havoc in our world. Join Kevin as he takes you on an adventure through bias, deep fakes, and privacy concerns. This rollercoaster of a presentation will be fun, scary, and hopefully…well…maybe you will have hope by the end—either way, you won’t want to miss this lively presentation full of controversy, intrigue, and mystery. Wait, is this Clue or a presentation? Guess you will have to join us to find out!Read more

Concurrent Sessions—1:40pm–2:10pm
1:40 pm to 2:10 pm
Networking Break in the Expo—2:10pm–2:40pm
2:10 pm to 2:40 pm
Concurrent Sessions—2:40pm–3:10pm
2:40 pm to 3:10 pm
Keynote—Details Coming Soon
3:20 pm to 4:00 pm
Conference Wrap Up—4:00pm–4:30pm
4:00 pm to 4:30 pm

Friday, June 7

Breakfast—7:30am–8:30am
7:30 am to 8:30 am
Registration—7:30am–3:00pm
7:30 am to 3:00 pm
AI Leadership Summit
8:00 am to 3:30 pm
AI Leadership: Navigating Transformational Change Thursday, June 6 (evening) and Friday, June 7 (all day)

As artificial intelligence (AI) continues to revolutionize industries, leaders must explore the impact AI has on their business strategies and direction. From setting strategic visions for AI adoption to fostering ethical and responsible AI practices, strong leadership is essential for successful AI adoption and implementation. But like any transformational change, some challenges and pitfalls must be overcome to make AI successful. Join in the conversation with your peers as...Read more

Lunch—12:00pm–1:00pm
12:00 pm to 1:00 pm