Skip to content

Handle follow up questions (chat context)

https://towardsdatascience.com/how-to-train-a-chatbot-using-rag-and-custom-data/

By querying a response from the LLM the way we just did above, you are able to easily access information from the documents you loaded. However, if you ask a follow up question, like “Which one has the least?” without context, the model won’t remember what your original question was. This is because we haven’t programmed it to keep track of the chat history.