Data Privacy Challenges in Real World LLM Applications

Do you and your business want to make use of the power LLMs have to offer, but are hesitant about exposing your data or business information to an LLM provider? Then this talk’s for you!We’ll discuss the challenges surrounding data privacy when dealing with LLMs. The first challenge: reading through the privacy policies....Listen along, while we take you through the process of building our internal LLM application, an LLM-powered Slackbot can search our company’s Confluence pages. We’ll discuss how we made sure users can only access the correct pages, how we made sure the data sent to the LLM is completely anonymised and contains no personal identifiable information, and more!