Hello there,
I’m a student and me and my team have the assignment to make a chatbot for our university. We need to make a chatbot that can help other students find information about their course. We will get our data from manuals of multiple universtity websites (as pdf). This data will be turned into Q&A data using ChatGPT 4.
However, we are struggling to find a pre-trained LLM that fits our assignment. We’ve researched T5, BERT and GPT-2 but our teacher was surprised those were the models we researched, since there are more popular and newer models. Our chatbot must be in Dutch, but we can translate so the LLM doesn’t need to be trained on Dutch data. The LLM can’t be too big, because we don’t have the hardware for very large models.
My question is: is LLaMa a good LLM for making a chatbot?
llama i not good for a chatbot, because is a base model meant to be fine-tuned.
There are countless versions of llama fine-tuned to be a chatbot for example vicuna but there are more base models that you can look.
A popular one is OpenHermes-2.5-Mistral-7B-GGUF, which can be run on anything.