AI Con USA 2026 - Green AI

Artificial Intelligence is driving innovation across industries, but its growing energy demands pose critical challenges around cost, scalability, and sustainability. In this talk, Bhanu will share practical strategies for designing energy-efficient AI systems, focusing on: dynamic batching & KV caching for reducing inference overhead, sparse neural networks & structured pruning for lightweight models, carbon-aware scheduling to align compute with renewable energy, federated learning & edge deployments to reduce data transfer energy, and a sustainability maturity model for...