Fetching URL in convex-ai-chat
In the repo, https://github.com/get-convex/convex-ai-chat/ I am confused on where the fetchSingle() function inside of load.ts is called.
In other words, where do I set the URL to be fetched?
I see that we need to scrape the URL and chunk the document text, but not sure where to set the URL so this process happens. Thanks
GitHub
GitHub - get-convex/convex-ai-chat
Contribute to get-convex/convex-ai-chat development by creating an account on GitHub.
1 Reply
fetchSingle
is called by scrapeSite
, which takes in a sitemap URL.
You can use fetchSingle
to test individual URLs, from your Convex dashboard for example.