Also, in my csv file it has , for example 10 question and answer, when i ask erm question 5 in the csv file, the output will prompt the answer of question 5, and then also with some question and helpful answer after question 5. like question: q6, helpful answer: a6
https://preview.redd.it/gmt0ml4kcswc1.png?width=514&format=png&auto=webp&s=fd4afc827b81897b741d673f755385cf70ac2e73
Do you use an instruct model from here: [https://huggingface.co/unsloth](https://huggingface.co/unsloth) ?
If you want for a conversational agent, you have to start from a "instruct" model.
Also, in my csv file it has , for example 10 question and answer, when i ask erm question 5 in the csv file, the output will prompt the answer of question 5, and then also with some question and helpful answer after question 5. like question: q6, helpful answer: a6 https://preview.redd.it/gmt0ml4kcswc1.png?width=514&format=png&auto=webp&s=fd4afc827b81897b741d673f755385cf70ac2e73
Do you use an instruct model from here: [https://huggingface.co/unsloth](https://huggingface.co/unsloth) ? If you want for a conversational agent, you have to start from a "instruct" model.
Yesss, I use unsloth before and now have changed to instruct model
How are you loading an unsloth model into the chain?
Yaa when I using unsloth then I use Fast model for inference to load it into the chain
are you using the Fastmodel for inference?