@user Thanks, that makes sense. I agree connectors themselves seem straightforward to add in Archestra.
When I said “more advanced pipeline”, I wasn’t referring only to missing connectors. I meant the full
enterprise/legal RAG stack behind retrieval:
- larger connector catalog and mature connector sync/permission-sync behavior;
- OpenSearch/BM25 + vector hybrid search at scale;
- query expansion and reranking;
- contextual retrieval, e.g. document-level summary + chunk-level context added during indexing;
- multipass indexing / multiple chunk granularities;
- document sets / vault-style scoped search;
- image/OCR/vision processing for PDFs and document images;
- stronger citation mapping, so answers can be tied back to exact source chunks;
- context expansion around retrieved chunks;
- observability and controls around indexing/search quality.
For our use case, Archestra would remain the agentic runtime, chat, tools and UI. We are evaluating whether a
headless RAG engine, potentially Onyx-backed, should sit behind Archestra as a retrieval tool.
The fastest path may be exactly what Pavel described: expose the RAG engine as a standalone MCP server and
connect it to Archestra. Longer term, we may also want a native integration/provider so connector management,
document sets, permissions and search results can be surfaced directly inside our UI.
Does Archestra’s built-in Knowledge pipeline currently support things like contextual RAG, multipass indexing,
OpenSearch-style hybrid search, document-level permission sync, image/OCR/vision indexing and citation-level
source mapping? If not, is the intended extension point MCP/custom tools, or would you prefer these
capabilities to be contributed into the native Knowledge system?