Python-based Q&A bot using OpenAI's LLM and LangChain's Vector Index Database for text extraction and processing. Features include PDF data extraction, tokenization, efficient data management, Open…

Invoice data processing with Llama2 13B LLM RAG on Local CPU

Call all LLM APIs using the OpenAI format. Use Bedrock, Azure, OpenAI, Cohere, Anthropic, Ollama, Sagemaker, HuggingFace, Replicate (100+ LLMs)

Providing enterprise-grade LLM-based development framework, tools, and fine-tuned models.

Querying local documents, powered by LLM

Prototype sample code demonstrating how we can leverage CodeLlama locally and connect it to MySQL using LangChain

Examples and recipes for Llama 2 model

Inference code for LLaMA models

Running Llama 2 and other Open-Source LLMs on CPU Inference Locally for Document Q&A

FastAPI Best Practices and Conventions we used at our startup

HyDE: Precise Zero-Shot Dense Retrieval without Relevance Labels

Scrapes Memory and GPU utilization metrics using NVML and exposes them to Prometheus through a simple HTTP server and/or a push gateway.