LLM-based Smart Chatbot Design Using LangChain Framework
Loading...
Date
2024
Authors
Колодяжна, Дарія
Journal Title
Journal ISSN
Volume Title
Publisher
Abstract
This work presents the development of a smart chatbot called "Legislative Assistant" that assists Ukrainian lawyers and citizens in navigating legislative acts. The chatbot utilizes large language models (LLMs), specifically the Mistral-7B-Instruct-Ukrainian model, integrated with the LangChain framework and retrieval-augmented generation (RAG) techniques. By creating embeddings from a corpus of Ukrainian legislative acts and optimizing retrieval using RAG, the chatbot provides accurate and up-to-date responses to queries related to legislation. This work covers theoretical aspects such as the evolution of language models, transformer architectures like Mistral 7B and the concept of retrieval-augmented generation (RAG) for incorporating external data into language model responses.
Description
Keywords
chatbots, large language models, Ukrainian legislation, retrieval-augmented generation, LangChain, Mistral 7B, attention mechanism, bachelor thesis