Personal engineering portfolio showcasing CUDA + C++ + LLM inference projects. Features production-grade distributed systems, empirical performance research, and on-device AI optimization. Built wi…

CUDA-accelerated LLM inference for Python with automatic server management. Zero-configuration setup, JupyterLab-ready, production-grade performance. Just install and start inferencing!

Pre-built llama.cpp CUDA binary for Ubuntu 22.04. No compilation required - download, extract, and run! Works with llcuda Python package for JupyterLab integration. Tested on GeForce 940M to RTX 4090.

Production-grade C++20/CUDA distributed LLM inference system with TCP networking, MPI scheduling, and content-addressed storage. Features comprehensive benchmarking (p50/p95/p99 latencies), epoll a…

Custom CUDA implementation for LLM inference with MPI-based distributed computing. Memory-efficient layer offloading, multi-rank coordination, and GPU optimization for constrained hardware (1GB VRAM).

High-performance TCP inference gateway with epoll async I/O for CUDA-accelerated LLM serving. Binary protocol, connection pooling, streaming responses. Zero dependencies beyond POSIX and CUDA.

CUDA-aware OpenMPI integration for GPU-accelerated distributed computing. Multi-GPU LLM inference with MPI communication, performance benchmarking, and collective operations testing.

Content-addressed LLM model distribution with SHA256 verification and SeaweedFS integration. Distributed storage, manifest management, LRU caching, and integrity checking for GGUF models.

Distributed MPI scheduler with work-stealing algorithm for LLM inference. Percentile latency analysis (p50/p95/p99), throughput benchmarking, multi-rank load balancing, and empirical performance me…

Kaggle-Dropbox-HuggingFace

Qt-style CMake superbuild demo: FetchContent deps, feature flags, install/export targets, CI matrix, tests, and CPack packaging.

MCP stdio server for Windsurf that routes tool calls to a local llama.cpp llama-server (GGUF), optimized for low-VRAM GPUs.

This is a sample project to use wolfram with llama.cpp

electron-win10-rewrite

This is a git tutorial in windows using Git Bash.

llama.cpp executable for ubuntu cuda-dedicated

This is my git and github tutorials repo.

the coding train git and github tutorial