AI Con USA 2024 - Tester

Monday, June 3

MA

Getting Started with AI and Machine Learning

Monday, June 3, 2024 - 8:30am to 12:00pm

Are you a software professional who would like to learn to use AI and machine learning (ML), but don't know how to get started? One of the best ways to get into ML is by designing and completing small projects. Although you will ultimately need to understand the fundamentals of AI/ML, there's no reason why you can't learn foundational terms, concepts and principles as you put them into practice.  Join Dionny Santiago as he introduces you to the world of applied machine learning. Dionny will guide you through a series of ML projects end-to-end, enabling you to gain experience with creating...

Jason_Arbon
Checkie.AI
MC

Evaluating and Testing Generative AI: Insights and Strategies

Monday, June 3, 2024 - 8:30am to 12:00pm

Generative AI (GenAI), exemplified by groundbreaking systems like ChatGPT and LLAMA, is revolutionizing the software landscape. These advanced technologies represent some of the most sophisticated software ever devised, capable of navigating an unprecedented range of prompts and questions, many of which have never been posed in human history. Their ability to generate varied responses to the same query and even fabricate answers when uncertain poses unique challenges in verification and testing. This talk delves into the intricacies of validating such systems and identifies areas needing...

Tuesday, June 4

Phil LaFrance
Coveros
TA

Supercharge Your Workflow: To GitHub and Beyond

Tuesday, June 4, 2024 - 8:30am to 4:30pm

Whether you are new or experienced with GitHub this class is for you! Supercharging your workflow caters to anyone who wants to enhance their Agile and DevOps process with the capabilities of GitHub. GitHub has long been the premier site for open-source projects and is now turning a pivotal corner into becoming the predominant platform for all aspects of the development lifecycle. Some examples of this include; protecting company code through various GitHub Products or curating marketplace actions and workflows prior to use. This tutorial will look at how to leverage GitHub Actions (CI/CD...

Tariq King
Test IO
TC

Prompt Engineering for Software Practitioners

Tuesday, June 4, 2024 - 8:30am to 12:00pm

With the sudden rise of ChatGPT and large language models (LLMs), practitioners are using these tools for all aspects of engineering. This includes leveraging LLMs for creating software artifacts such as requirements documents, source code, and tests; reviewing them for issues and making corrective suggestions, and analyzing or summarizing results or outcomes. However, if LLM's are not fed good prompts describing the task that the AI is supposed to perform, their responses can be inaccurate and unreliable. Join Tariq King as he teaches you how to craft high-quality AI prompts and...

Jason_Arbon
Checkie.AI
TD

Harnessing Generative AI in Software Testing: A Real-World Guide

Tuesday, June 4, 2024 - 1:00pm to 4:30pm

The advent of Generative AI (GenAI), including Large Language Models (LLMs) and tools like ChatGPT, is not just another technological shift—it's a paradigm change, particularly in the realm of software testing. Unlike the transitions to mobile or cloud computing, GenAI introduces both unparalleled utility and disruption in software quality assurance. This session is dedicated to demystifying GenAI in software testing, distinguishing hype from reality, and providing practical tools and techniques to enhance your team's software quality while also highlighting potential pitfalls and...

Wednesday, June 5

W1

How NOT to Use GitHub Copilot: The Time Traveler's Playbook for Coding with AI

Wednesday, June 5, 2024 - 11:25am to 11:55am

"Does GitHub Copilot stunt learning, and why doesn't it always produce relevant suggestions?" These concerns echo the anxiety surrounding using AI to code, often rooted in the steep learning curve associated with adopting new technology. What if you were told that you might be using GitHub Copilot wrong? Through 2000s nostalgia and interactive storytelling, Rizel will provide attendees with a practical framework for effectively using GitHub Copilot, so you can write code that elevates your career and learn new programming languages. Audience members will leave with strategies for using AI...

Jason_Arbon
Checkie.AI
W2

AI Risk and Safety: Proactive Monitoring for the Future of Humanity and Business

Wednesday, June 5, 2024 - 11:25am to 11:55am

In an era where AI's capabilities are rapidly advancing, the question of safety and risk management becomes paramount. While AI currently serves as a beneficial tool, its potential evolution poses significant risks. The possibility of AI surpassing human intelligence, outperforming human capabilities, or developing biases misaligned with human values raises concerns about existential risks comparable to, or potentially exceeding, those of nuclear warfare. High-level attention, including inquiries from Congress and presidential directives, underscores the gravity of these concerns. Some...

Dmitriy Gumeniuk
EPAM Systems
W4

The Rise of the Virtual QA Engineer: Harnessing GenAI for a Productivity Boost—A Production Case Study

Wednesday, June 5, 2024 - 1:00pm to 1:30pm

In this talk, we will delve into the transformative journey of integrating GenAI into the core of our testing and development processes. This integration has not only enhanced our productivity by 15% but also yielded a 20% time savings and a significant cost reduction per test case. Want to know how? We'll explore the strategic implementation of GenAI, overcoming security challenges, leveraging diverse (LLMs), and the meticulous design of prompts that culminated in a prompt library. Our tailored extensions for the code editors and corporate chats exemplify the seamless fusion of AI with...

Matt Payne
Width.ai
W5

Production Level Prompting & Techniques for LLMs

Wednesday, June 5, 2024 - 1:40pm to 2:10pm

Let’s dive into what goes into creating expert-level prompts for ChatGPT and other LLMs. We will focus on the key ideas to take into account when prompting for any use case and how to better understand the results you get back. We’ll look at prompting 101, think about language, and explore advanced prompting frameworks. Some of the challenges we will address include: how to improve your results, how to process large text, why ChatGPT doesn't do what you want, what your prompt should look like, and many more!

Ethan Ferguson
BOK Financial
W6

Postman and AI: Transforming Manual QA to Quality Engineers

Wednesday, June 5, 2024 - 1:40pm to 2:10pm

Facing the dual challenge of enhancing deployment quality without extending regression testing time, Ethan Ferguson's team turned to automation. The team consisted mainly of manual QA professionals with a background in UI testing, not automation engineering. The question was how to leverage the existing team's skills to test services layers and develop stable release automation scripts. Utilizing prior experience in building Postman automation frameworks, they aimed to empower the team. Concurrent company changes included adopting Postman as the primary API testing tool and integrating...

Cloudflare
W7

Exploit Grandma: Prompt Better with Cloudflare AI

Wednesday, June 5, 2024 - 2:20pm to 2:50pm

Want to get better output from Large Language Models (LLMs)? Give it better input! This beginner-friendly talk will go over techniques to help you be a better prompt engineer and how to develop innovative chat-based applications primarily using English, highlighting the importance of prompting.

Matt Eland
Leading EDJE
W8

Mad Data Science: Using AI to Build Ridiculous Things

Preview
Wednesday, June 5, 2024 - 2:20pm to 2:50pm

Have you ever gotten into an argument on whether or not Die Hard is a Christmas movie and thought "If only machine learning could help" or "What could I do to automate my dog's daily routine and make his life easier" or "Is it possible to spend 3 months time to determine if I can sleep in 5 minutes tomorrow morning"? If so, you might get along with Matt Eland. Come join this lighthearted talk as he tours you through some ridiculous uses of AI and Machine Learning with topics ranging from large language models to reinforcement learning to simple regression algorithms. You'll get a...

K5

AI: A Moderated Panel Discussion

Wednesday, June 5, 2024 - 4:10pm to 5:10pm

Artificial intelligence is transforming both society and industry at an exceedingly rapid pace, raising questions about the implications. How will AI shape our future? What ethical and safety considerations should guide its development? What is Artificial General Intelligence (AGI)? How close are we to AGI, and should we be concerned? Join us for a panel discussion moderated by Dionny Santiago and take the opportunity to ask industry leaders the most pressing questions in AI.

Thursday, June 6

Tariq King
Test IO
K6

Humanizing AI

Thursday, June 6, 2024 - 8:30am to 9:25am

AI is becoming human—more human in the way it communicates, responding based on context, and matching the tone that we articulate.

AI is becoming human—quite human in what it generates, expressing itself through creative works and the solutions it quickly formulates.

AI is becoming human—which is evidenced by how well it imitates, deceiving us with convincing content even though we know it hallucinates.

AI is becoming human—is this something we'll appreciate? Or will humanizing AI be the end of us? The trigger to an apocalyptic human fate.

But if AI is...

Jeff Carollo
Apple
K7

Adventures in AI

Thursday, June 6, 2024 - 9:25am to 10:05am

Jeff will share select war stories from his career working on various AI projects, along with crucial mistakes made and lessons learned. The talk will be as informative as it will be entertaining.

K8

Realizing the Potential of AI Tools for Software Development

Thursday, June 6, 2024 - 10:30am to 11:20am

In this keynote, we explore the transformative impact of AI tool adoption in software development, focusing on measuring the tangible benefits, implementing effective dashboarding for real-time insights, and linking time savings to strategic business outcomes. We delve into best practices for quantifying efficiency gains and how these advancements not only enhance immediate development processes but also contribute significantly to broader organizational goals. This discussion aims to equip attendees with actionable strategies for leveraging AI tools to achieve competitive advantage, drive...

Jason_Arbon
Checkie.AI
T1

Fully Autonomous Software Testing with GenAI

Thursday, June 6, 2024 - 11:30am to 12:00pm

For decades, the concept of software autonomously testing itself has been a tantalizing dream. The traditional approach to software development involves extensive human effort in clicking through applications, writing API and UI test scripts, and a multitude of manual tasks before releasing a new version. However, the rise of Generative AI (GenAI) is heralding a transformative era in software testing, enabling a future where machines can undertake the bulk of these testing tasks. GenAI's capabilities extend beyond creating music, images, and even product code—it now encompasses the...

Kevin Pyles
O.C. Tanner
T4

Game Over—AI Steals Data, Is Biased, and Produces Deep Fakes

Thursday, June 6, 2024 - 1:00pm to 1:30pm

It has been two years, and ChatGPT and other Generative AI tools have taken the world by storm. We all still have jobs. Phew! However, AI is still wreaking havoc in our world. Join Kevin as he takes you on an adventure through bias, deep fakes, and privacy concerns. This rollercoaster of a presentation will be fun, scary, and hopefully…well…maybe you will have hope by the end—either way, you won’t want to miss this lively presentation full of controversy, intrigue, and mystery. Wait, is this Clue or a presentation? Guess you will have to join us to find out!

Randy Hesse
Keysight
T5

How Gen AI and Prompt Engineering Turns Testers into Superheroes!

Thursday, June 6, 2024 - 1:40pm to 2:10pm

Envision a testing realm infused with AI-driven superpowers, where a reliable AI companion will revolutionize how we approach testing. This companion doesn't just assist; it transforms the adventure of creating test cases that span the full spectrum of possibilities and pinpointing bugs in the most unexpected places. This is the essence of AI-augmented testing, a paradigm where AI elevates testers to maestros, orchestrating a symphony of enhanced augmented test intelligence. Jonathan Wright will go beyond merely discussing the technological underpinnings (e.g., GNN, RAG, RGA, NLU). It's a...

Carlos Kidman
Qualiti
T6

Tips for Building LLM Apps

Thursday, June 6, 2024 - 1:40pm to 2:10pm

The barrier to entry for AI, specifically Large Language Models (LLM), is low and we can take advantage of them in our own tools, projects, and apps. In this session, we’ll build a simple app that uses an LLM which will help us cover: The steps to using AI in a program. LLM Basics. Pick the right LLM. Data Preparation. Evals and Testing. Insights and issues to consider. Tips that you can use as you build your own. Join us for a hands-on session that will help you build your first LLM app or level up your current project!

Tom-Stiehm
Coveros
T7

Prompt Engineering for Mere Mortals

Thursday, June 6, 2024 - 2:40pm to 3:10pm

Prompt Engineering is a skill that anyone can develop, even mere mortals. While Generative AI can produce amazing results, it isn’t magic. You don’t need to be an AI Wizard to learn to craft effective prompts that help you leverage Generative AI in a way that helps you complete your tasks and achieve your goals and objectives. Tom will break down the terms and use everyday examples to illustrate Prompt Engineering best practices so that you can more easily navigate the nuances of Generative AI. In this session, you will learn what Prompt Engineering is and how to use it to get the best...

Rob Nicoletti
HALO Strategies
K9

Embrace AI Holistically and Unlock Your Growth Potential

Thursday, June 6, 2024 - 3:20pm to 4:00pm

In today's rapidly evolving business landscape, AI and machine learning are revolutionizing our operations, promising innovation and efficiency at every turn. But beyond the surface-level benefits lies a deeper transformation—the liberation of our most valuable resources: time, money, and clarity. Join HALO's Founder, Rob Nicoletti in this dynamic keynote as he shares the transformative power of embracing AI holistically. Discover how AI can propel us beyond mundane tasks, freeing us to make meaningful contributions in our work, lives, and in the world. Far from diminishing our humanity,...