Hey Revo! Yes it is exciting, this whole field is of course..
Sooo.. to answer your question.. YES absolutely.. i think just about anything is possible these days.. the question is, has someone written some decent code and are they willing to share it? the answer is YES!
Here is a link to the code you need!
https://github.com/aleeor/research-gpt.git
THis is vERY NICE CODE! it will sandbox GPT ONLY on your local data OR a URL such as your wiki.. Ask it anything else it doesn't know.. also it provides sources and links at the end of its answers which is super cool!
ENJOY! anyone with basic server experience should be able to install it for you..
KnowMyDoc is a GPT3.5 powered Python-based conversational AI tool that enables users to build a reference enabled chatbot by utilizing advanced machine learning techniques and natural language processing (NLP) algorithms. The utility is fully containerized and API-driven, which allows for a seamless and rapid chatbot creation experience.
KnowMyDoc leverages the LangChain library for LLM prompt engineering and conversation chaining. Users can easily customize the chatbot's prompts and personalize its responses based on the context and tone of the conversation. KnowMyDoc's LLM-based approach ensures that the chatbot can maintain a consistent and coherent conversation even when dealing with large amounts of data and provide relevant sources per response. The chatbots also remain in the confines of provided knowledge.
In addition, KnowMyDoc utilizes the Chroma vector similarity search engine to enable fast and efficient lookup of relevant data. By creating embeddings of users' documents and web pages, KnowMyDoc can quickly identify and retrieve the most relevant information for the user's queries.
Other features of KnowMyDoc include:
Support for loading documents from local data sources and web urls
Support for persona and message tone
AI qa limited to knowledge sources
Text splitting to optimize indexing and similarity search
NLTK support for text processing and tokenization Support for OpenAI embeddings and vector stores, including Chroma
Logging support for troubleshooting and analysis
Awesome, thanks eco-alex!