Sovereign LLM Inference at scale

In this talk, Xuan-Son Nguyen will share the technical challenges of scaling generative AI within BNP Paribas with the deployment of a hybrid sovereign platform and an LLM as a Service product for more than 150 generative AI use cases across the group.