Tech Article
Vartik GPT: Enterprise Secure LLM Chat
Vartik GPT is a secure enterprise chat solution that
supports multiple LLMs, vector databases, chunking strategies, caching, and routing.
It authenticates users via Azure AD and allows the ingestion of unstructured
documents (PDFs, PPTs, DOCX, CSVs, emails) into department-specific indexes,
preventing unauthorized access to sensitive data.
The system features configurable caching for query
responses, allowing cached replies for similar queries, and query routing to direct
simple queries to cost-effective or open-source LLMs, while complex queries are sent
to advanced models like GPT-4o.
Solution Components:
Vartik GPT uses a modular approach with the following
components:
Data Ingestion Pipeline: A secure, scalable
pipeline that ingests data from private knowledge bases. It supports various
chunking strategies and vector databases like Pinecone, Qdrant, and Azure AI Search.
The pipeline handles multiple data formats, including PDF, DOCX, PPT, emails, CSV,
and Markdown, and allows the use of both open-source and other LLMs for text
embedding.
It has following features:
- Multi LLM Support
- Multi Vector DB Support
- Multi Chunking Support
- Supports PDF, Docx, PPT, mails, CSV, MD and many
more.
- Secure and Scalable

Vartik GPT: It is LLM based Chat that uses
Data Ingestion pipeline to ingest unstructured and semi-structured data, chunk using
multi chunking strategies like Recursive, Semantic and store in Vector database. It
provides support for open source embedding framework to embed text besides
commercial Embedding LLMs.
It supports using multiple LLMs including open source,
caching, chat history, routing for cost optimization. It can be extended to domains
across verticals in Healthcare, Finance, Manufacturing, Legal, Insurance, Telecom,
Media through configurable Prompts and separate Vector database indexes.
It has following features:
- Cache Enabled
- Routing for cost optimization
- Multi LLM Support
- Multi Vector DB Support
- Multi Chunking Support
- Supports PDF, Docx, PPT, mails, CSV, MD and many
more.
- Secure and Scalable
|