i presume you want to create a conversation witht the chatbot about the content of a particular web page.
for this you need insert a Conversational Reteival Chain to which you link:
- (Required) a chat model, like ChatOpenAI (you need an AI-Key)
- (Required) a Vector Store Retreiver, for example In-Memory Vector Store
- (Optional) a memory to help the bot maintain the flow of the conversation (i use Buffer Memory)
Now to feed the Vectore Store with the knowledge from the website you need to link it to:
- Embeddings Model, for example OpenAIEmbeddings (you need an AI-Key)
- the Cheerio Web Scraper, you connect it with the Vectore Store at the document input
- Then connect the Cheerio Web Scraper to a text splitter (like Markdown text splitter, or Recursive Charatchter Text Splitter)
Now you need to build the Vector Database, by:
- save the model
- a new green button will appear, so press on it to "UPSERT" the vector Database.
- Save your model again.
and start asking question to your bot about the web page you have provided
Be