Part II - Using AI Safely: a Technical Approach

It does not make much difference if you are using a LLM on a public platform like OpenAI’s ChatGPT or Google Bard, or are running open and freely available LLM models locally. Simple queries trigger a text completion operation and the completed text is a function of what text was used to train the model.

A more reliable way to use LLMs is to provide context text and then ask a query about the context text. We will see examples for doing this in your own Python scripts.

Another way to get better results is to use fine tuning to modify an open LLM by means of additional text from your PDF documents, web sites, emails, etc. We address this technique in the chapter Fine Tuning.