metadata
title: url-surfer
emoji: 🔗🏄♂️
sdk: docker
app_port: 3000
🔗 url-surfer 🏄♂️
Simple API to navigate to a URL from a prompt, returning relevant context from the prompt using a vector store.
How it works
- Navigate (parse url/fetch/mime-type check)
- Extract text (jsdom/puppeteer/pdf-parse)
- Create vector store (transformers.js)
- Return vector results in prompt (langchain)
Ideas
- Configuration: Vector search size, token counting
- OpenAI functions integration