Powering Next-Gen AI Software