This hands-on course helps testers understand how to verify Artificial Intelligence (AI)-based systems and use AI during testing and software quality assurance activities.
Conference Schedule
Sunday, June 2
Unravel the complexities of machine learning and AI. Attendees will be awarded the ICAgile Professional- Foundations of AI (ICP-FAI) designation.
Monday, June 3
Are you a software professional who would like to learn to use AI and machine learning (ML), but don't know how to get started? One of the best ways to get into ML is by designing and completing small projects. Although you will ultimately need to understand the fundamentals of AI/ML, there's no reason why you can't learn foundational terms, concepts and principles as you put them into practice. Join Dionny Santiago as he introduces you to the world of applied machine learning. Dionny will guide you through a series of ML projects end-to-end, enabling you to gain experience with creating...Read more
Although there are several controversies and misunderstandings surrounding AI and machine learning, one thing is apparent — people have quality concerns about the safety, reliability, and trustworthiness of these types of systems. Not only are ML-based systems shrouded in mystery due to their largely black-box nature, they also tend to be unpredictable since they can adapt and learn new things at runtime. Validating ML systems is challenging and requires a cross-section of knowledge, skills, and experience from areas such as mathematics, data science, software engineering, cyber-security...Read more
Generative AI (GenAI), exemplified by groundbreaking systems like ChatGPT and LLAMA, is revolutionizing the software landscape. These advanced technologies represent some of the most sophisticated software ever devised, capable of navigating an unprecedented range of prompts and questions, many of which have never been posed in human history. Their ability to generate varied responses to the same query and even fabricate answers when uncertain poses unique challenges in verification and testing. This talk delves into the intricacies of validating such systems and identifies areas needing...Read more
All successful AI projects start and end with the data. The problem? Not everyone has the data required to build AI models in a production setting. Dataset generation has grown significantly with the rise of generative AI, making it easy for anyone to get started with training models no matter how much of your own data you bring to the table. While this sounds great, there are a ton of variables that go into this process of successfully generating data for training. How much data is needed? What models should be used to generate data? How to prompt models to generate high-variance datasets...Read more
Executive leaders across the globe have been asking a relatively simple yet profound question: Can we leverage generative AI to transform our business, enterprise, or industry? For software-based companies, focus has either been on differentiating their product and service offerings using this new technology. But how about leveraging generative AI to improve team productivity and efficiency? This may be possible but how do you measure its success? What are some of the key use cases within business analysis, development, and testing that software teams can use? Are there any pitfalls that...Read more
Understanding the readiness of your source data before you launch an expensive AI/ML project lets you take corrective data engineering measures that will streamline the project and give you the best probability of a successful outcome. Artificial Intelligence (AI) and Machine Learning (ML) projects can provide significant returns on investment when they are applied to narrow but difficult business problems and are supported by adequate amounts of relevant, quality data. Many such projects start with high hopes but get derailed due to fundamental problems with source data, which were...Read more
Tuesday, June 4
Whether you are new or experienced with GitHub this class is for you! Supercharging your workflow caters to anyone who wants to enhance their Agile and DevOps process with the capabilities of GitHub. GitHub has long been the premier site for open-source projects and is now turning a pivotal corner into becoming the predominant platform for all aspects of the development lifecycle. Some examples of this include; protecting company code through various GitHub Products or curating marketplace actions and workflows prior to use. This tutorial will look at how to leverage GitHub Actions (CI/CD...Read more
Much attention is given to machine learning model training and testing in the industry. While these activities are essential for producing a production-ready machine learning model, organizations face some critical business challenges that must be addressed when building and testing machine learning models. Things like the reproducibility of results, accuracy of predictions, reusability of components, and trackability of experimentation are all vital to the success of any application. The term MLOps has emerged as a method for applying DevOps practices and automation to the machine...Read more
With the sudden rise of ChatGPT and large language models (LLMs), practitioners are using these tools for all aspects of engineering. This includes leveraging LLMs for creating software artifacts such as requirements documents, source code, and tests; reviewing them for issues and making corrective suggestions, and analyzing or summarizing results or outcomes. However, if LLM's are not fed good prompts describing the task that the AI is supposed to perform, their responses can be inaccurate and unreliable. Join Tariq King as he teaches you how to craft high-quality AI prompts and...Read more
The advent of Generative AI (GenAI), including Large Language Models (LLMs) and tools like ChatGPT, is not just another technological shift—it's a paradigm change, particularly in the realm of software testing. Unlike the transitions to mobile or cloud computing, GenAI introduces both unparalleled utility and disruption in software quality assurance. This session is dedicated to demystifying GenAI in software testing, distinguishing hype from reality, and providing practical tools and techniques to enhance your team's software quality while also highlighting potential pitfalls and...Read more
Large language models, like Generative Pre-trained Transformers (GPTs) to create textual content in ChatBots and other Generative AI applications, have garnered much attention recently. However, not all data is textual. Another important use of LLMs is for image processing to address real-world problems such as: real-time object recognition, classification of images, and generation of modern art. Jeffery Payne will explore how large language models for images (also known as visual language models - VLMs) can be used for image classification, object detection, image capture generation, and...Read more
In this beginner-friendly workshop you'll see how you can get started with data analytics and data science using Jupyter Notebooks. Matt will start with the basics of notebooks and then move on to using Python, Pandas, and NumPy to perform basic exploratory data analysis. See how you can use Plotly Express to create interactive charts and visuals with only a minimal amount of code. Once you've grasped the basics of understanding and visualizing the data Matt will move on to machine learning with SciKit-Learn as you train and evaluate predictive regression and classification models...Read more
In an era of artificial intelligence (AI), many leaders have become concerned with the potential consequences of using AI in their products. Scott Peterson has met with many organizations about Artificial Intelligence. Their common question is, “ Is AI safe to use within our organization?” and “How do we begin implementing a plan around how we can benefit from it?” AI is not only shaping the future of technology but it’s also redefining the ethical landscape of innovation, the "RAI Revolution" session at AICon stands as a beacon for professionals seeking to harmonize technical prowess with...Read more
Wednesday, June 5
How many of you have heard that AI is here to take your job? Yeah, exactly. Us too. Apparently, AI is here to take ALL the jobs. Yet, here we are, employed and busier than EVER. Did you know that every large tech company has announced AI products this year with the promise to transform your business? Join Dona to learn: What in this latest AI craze is hype, and what is real? What are successful companies actually doing with AI these days? What are three things that you ABSOLUTELY should be doing in the next six months to get your business ready to implement AI in a secure and responsible...Read more
It is evident that AI/ML is significantly impacting how businesses operate, transforming the enterprise landscape in various ways, enhancing customer experience, improving efficiency, and reducing costs. The desire to incorporate AI/ML is there, but enterprises often struggle with where to start or how to do it in a repeatable and sustainable manner. Hien will discuss the key challenges to AI/ML adoption and share practical strategies for overcoming them. He will explore the critical factors that drive successful implementation, including data readiness, organizational culture, and...Read more
Why does one of the AI domains with the highest ROI frequently go unnoticed in mainstream discussions about AI? Could it be that Mathematical Optimization, with its equations and complex algorithms, is too often seen as the exclusive domain of PhDs in operations research or industrial engineering? Thankfully, optimization tools and techniques are now more accessible than ever. In this session, we will explore how mathematical optimization is transforming operational decision-making. We will detail how five innovation-minded companies across diverse sectors are applying optimization...Read more
"Does GitHub Copilot stunt learning, and why doesn't it always produce relevant suggestions?" These concerns echo the anxiety surrounding using AI to code, often rooted in the steep learning curve associated with adopting new technology. What if you were told that you might be using GitHub Copilot wrong? Through 2000s nostalgia and interactive storytelling, Rizel will provide attendees with a practical framework for effectively using GitHub Copilot, so you can write code that elevates your career and learn new programming languages. Audience members will leave with strategies for using AI...Read more
In an era where AI's capabilities are rapidly advancing, the question of safety and risk management becomes paramount. While AI currently serves as a beneficial tool, its potential evolution poses significant risks. The possibility of AI surpassing human intelligence, outperforming human capabilities, or developing biases misaligned with human values raises concerns about existential risks comparable to, or potentially exceeding, those of nuclear warfare. High-level attention, including inquiries from Congress and presidential directives, underscores the gravity of these concerns. Some...Read more
According to a recent survey, 61.7% of enterprise engineering teams now have or are planning to have a generative AI application within a year—and 14.1% are already in production. As enterprises race to deploy generative AI into their businesses, the need to ensure that LLMs are deployed reliably and responsibly is paramount. But how can enterprises and AI engineers evaluate and troubleshoot models in real time? In this session, Greg Chase, a data scientist and machine learning engineer at Arize AI, will cover emerging best practices from direct work advising enterprises with real issues....Read more
In this talk, we will delve into the transformative journey of integrating GenAI into the core of our testing and development processes. This integration has not only enhanced our productivity by 15% but also yielded a 20% time savings and a significant cost reduction per test case. Want to know how? We'll explore the strategic implementation of GenAI, overcoming security challenges, leveraging diverse (LLMs), and the meticulous design of prompts that culminated in a prompt library. Our tailored extensions for the code editors and corporate chats exemplify the seamless fusion of AI with...Read more
Let’s dive into what goes into creating expert-level prompts for ChatGPT and other LLMs. We will focus on the key ideas to take into account when prompting for any use case and how to better understand the results you get back. We’ll look at prompting 101, think about language, and explore advanced prompting frameworks. Some of the challenges we will address include: how to improve your results, how to process large text, why ChatGPT doesn't do what you want, what your prompt should look like, and many more!Read more
Facing the dual challenge of enhancing deployment quality without extending regression testing time, Ethan Ferguson's team turned to automation. The team consisted mainly of manual QA professionals with a background in UI testing, not automation engineering. The question was how to leverage the existing team's skills to test services layers and develop stable release automation scripts. Utilizing prior experience in building Postman automation frameworks, they aimed to empower the team. Concurrent company changes included adopting Postman as the primary API testing tool and integrating...Read more
Want to get better output from Large Language Models (LLMs)? Give it better input! This beginner-friendly talk will go over techniques to help you be a better prompt engineer and how to develop innovative chat-based applications primarily using English, highlighting the importance of prompting.Read more
Have you ever gotten into an argument on whether or not Die Hard is a Christmas movie and thought "If only machine learning could help" or "What could I do to automate my dog's daily routine and make his life easier" or "Is it possible to spend 3 months time to determine if I can sleep in 5 minutes tomorrow morning"? If so, you might get along with Matt Eland. Come join this lighthearted talk as he tours you through some ridiculous uses of AI and Machine Learning with topics ranging from large language models to reinforcement learning to simple regression algorithms. You'll get a...Read more
From decades-long development of technologies like machine learning to OpenAI’s watershed moment with ChatGPT, companies of all sizes are looking to find and execute on new opportunities and capture the transformative potential of Artificial Intelligence. How can one decide what AI technologies have the best fit for their business? How can one successfully drive value for customers?” Join Sudeep as he proposes a human-focused approach to AI, capitalizing on humans’ ability to innovate, learn, communicate, and share and AI’s ability to process and evaluate huge swaths of data swiftly to...Read more
Artificial intelligence is transforming both society and industry at an exceedingly rapid pace, raising questions about the implications. How will AI shape our future? What ethical and safety considerations should guide its development? What is Artificial General Intelligence (AGI)? How close are we to AGI, and should we be concerned? Join us for a panel discussion moderated by Dionny Santiago and take the opportunity to ask industry leaders the most pressing questions in AI.Read more
Thursday, June 6
AI is becoming human—more human in the way it communicates, responding based on context, and matching the tone that we articulate.
AI is becoming human—quite human in what it generates, expressing itself through creative works and the solutions it quickly formulates.
AI is becoming human—which is evidenced by how well it imitates, deceiving us with convincing content even though we know it hallucinates.
AI is becoming human—is this something we'll appreciate? Or will humanizing AI be the end of us? The trigger to an apocalyptic human fate.
But if AI is...Read more
Jeff will share select war stories from his career working on various AI projects, along with crucial mistakes made and lessons learned. The talk will be as informative as it will be entertaining.Read more
In this keynote, we explore the transformative impact of AI tool adoption in software development, focusing on measuring the tangible benefits, implementing effective dashboarding for real-time insights, and linking time savings to strategic business outcomes. We delve into best practices for quantifying efficiency gains and how these advancements not only enhance immediate development processes but also contribute significantly to broader organizational goals. This discussion aims to equip attendees with actionable strategies for leveraging AI tools to achieve competitive advantage, drive...Read more
For decades, the concept of software autonomously testing itself has been a tantalizing dream. The traditional approach to software development involves extensive human effort in clicking through applications, writing API and UI test scripts, and a multitude of manual tasks before releasing a new version. However, the rise of Generative AI (GenAI) is heralding a transformative era in software testing, enabling a future where machines can undertake the bulk of these testing tasks. GenAI's capabilities extend beyond creating music, images, and even product code—it now encompasses the...Read more
Most product ideas die on the backlog because we can't find the time, lack the skills, or fail to get others excited about them. But thanks to AI, that no longer has to be the case. Product Builders, Project Managers, DevOps Managers, and simply creators of all kinds can turn a napkin sketch into a clickable prototype within hours. Rolf Mistelbacher shares why AI is turbocharging prototyping and how the arrival of new AI-powered creator tools is driving that change. He shows how you can transform your idea into a clickable prototype without writing code—creating wireframes and a user...Read more
The advent of AI Agents heralds a new era in computing, introducing a paradigm shift from conventional application-specific interactions to a holistic orchestration of digital workflows across various platforms and industries. This presentation will explore the concept of AI Agents as a pivotal innovation in artificial intelligence, capable of transforming user experiences by enabling seamless integration and management of tasks across multiple applications. Unlike their predecessors, AI Agents excel in providing a personalized, context-aware interface, learning from user interactions to...Read more
It has been two years, and ChatGPT and other Generative AI tools have taken the world by storm. We all still have jobs. Phew! However, AI is still wreaking havoc in our world. Join Kevin as he takes you on an adventure through bias, deep fakes, and privacy concerns. This rollercoaster of a presentation will be fun, scary, and hopefully…well…maybe you will have hope by the end—either way, you won’t want to miss this lively presentation full of controversy, intrigue, and mystery. Wait, is this Clue or a presentation? Guess you will have to join us to find out!Read more
Envision a testing realm infused with AI-driven superpowers, where a reliable AI companion will revolutionize how we approach testing. This companion doesn't just assist; it transforms the adventure of creating test cases that span the full spectrum of possibilities and pinpointing bugs in the most unexpected places. This is the essence of AI-augmented testing, a paradigm where AI elevates testers to maestros, orchestrating a symphony of enhanced augmented test intelligence. Jonathan Wright will go beyond merely discussing the technological underpinnings (e.g., GNN, RAG, RGA, NLU). It's a...Read more
The barrier to entry for AI, specifically Large Language Models (LLM), is low and we can take advantage of them in our own tools, projects, and apps. In this session, we’ll build a simple app that uses an LLM which will help us cover: The steps to using AI in a program. LLM Basics. Pick the right LLM. Data Preparation. Evals and Testing. Insights and issues to consider. Tips that you can use as you build your own. Join us for a hands-on session that will help you build your first LLM app or level up your current project!Read more
Prompt Engineering is a skill that anyone can develop, even mere mortals. While Generative AI can produce amazing results, it isn’t magic. You don’t need to be an AI Wizard to learn to craft effective prompts that help you leverage Generative AI in a way that helps you complete your tasks and achieve your goals and objectives. Tom will break down the terms and use everyday examples to illustrate Prompt Engineering best practices so that you can more easily navigate the nuances of Generative AI. In this session, you will learn what Prompt Engineering is and how to use it to get the best...Read more
In today's rapidly evolving business landscape, AI and machine learning are revolutionizing our operations, promising innovation and efficiency at every turn. But beyond the surface-level benefits lies a deeper transformation—the liberation of our most valuable resources: time, money, and clarity. Join HALO's Founder, Rob Nicoletti in this dynamic keynote as he shares the transformative power of embracing AI holistically. Discover how AI can propel us beyond mundane tasks, freeing us to make meaningful contributions in our work, lives, and in the world. Far from diminishing our humanity,...Read more
Friday, June 7
As artificial intelligence (AI) continues to revolutionize industries, leaders must explore the impact AI has on their business strategies and direction. From setting strategic visions for AI adoption to fostering ethical and responsible AI practices, strong leadership is essential for successful AI adoption and implementation. But like any transformational change, some challenges and pitfalls must be overcome to make AI successful. Join in the conversation with your peers as...Read more