Update on my capstone project in the #llmzoomcamp @DataTalksClub:

For any RAG system worth its salt, a follow-up question should not return a 'NOT IN CONTEXT' to the user.

For this I plan a mechanism to determine whether a question is a follow-up question. If it is, we should execute Query Re-writing with a sperate call to the LLM with
a. the user's last question
b. LLM's last response
c. user's current follow-up query

The re-rewritten query is now used to fetch chunks from Qdrant database.