Methods
| Method | Stage | Description |
|---|---|---|
setup_url(browser) | Ingestion | Install Playwright browser for URL ingestion |
scrape(url, ...) | Ingestion | Scrape URLs into document dicts |
parse(files, folder, ...) | Ingestion | Parse local documents into document dicts |
fetch(url, apis, ...) | Ingestion | Fetch REST API responses into document dicts |
chunk(markdown, ...) | Chunking | Split documents into chunk dicts |
embedder(provider, model, ...) | Embedding | Create an embedder object |
embed(chunks, embedder, ...) | Embedding | Generate embedding vectors for chunks |
store(embedded_chunks, ...) | Storing | Upsert embedded chunks into a vector DB |
edit(chunks, embedder, ...) | Storing | Re-embed and replace chunks by ID |
delete(ids, ...) | Storing | Delete chunks by ID |
reranker(provider, model, ...) | Retrieval | Create a reranker object |
retrieve(query, embedder, ...) | Retrieval | Embed a query and retrieve relevant chunks |
llm(provider, model, ...) | Chat | Create an LLM object |
chat(query, llm, embedder, ...) | Chat | Run a stateless RAG chat turn |
ingest(docs, urls, ...) | Pipeline | Run ingestion → chunk → embed → store |
query(query, embedding, ...) | Pipeline | Run embed query → retrieve |
Pages
Ingestion
scrape, parse, fetch
Chunking
chunk
Embedding
embedder, embed
Storing
store, edit, delete
Retrieval
reranker, retrieve
Chat
llm, chat
Pipeline
ingest, query