I'm a software engineer and researcher focused on AI reliability, distributed systems, and functional programming. I build infrastructure for LLM research on the Elixir/BEAM platform.
I'm the creator of the Crucible Framework, a platform for conducting reproducible experiments on large language model reliability, built on Elixir/OTP.
Key Goal: Building towards 99%+ LLM reliability through ensemble voting and request hedging, with comprehensive statistical testing and transparent causal reasoning chains.
All published under the @North-Shore-AI organization:
Library | Description |
---|---|
crucible_framework | Documentation hub & research framework |
crucible_bench | Statistical testing & analysis (15+ tests, effect sizes, power analysis) |
crucible_ensemble | Multi-model voting strategies for improved reliability |
crucible_hedging | Request hedging for latency reduction |
crucible_trace | Causal reasoning chain logging for LLM transparency |
crucible_datasets | Unified interface to benchmark datasets (MMLU, HumanEval, GSM8K) |
crucible_telemetry | Research-grade instrumentation & metrics collection |
crucible_harness | Automated experiment orchestration & reporting |
Library | Description |
---|---|
crucible_adversary | Adversarial testing & robustness evaluation framework |
crucible_xai | Explainable AI tools (LIME, SHAP, feature attribution) |
ExDataCheck | Data validation & quality library for ML pipelines |
ExFairness | Fairness & bias detection library for AI/ML systems |
LLMGuard | AI firewall & guardrails for LLM-based applications |
Tech Stack: Elixir, OTP, BEAM VM, Telemetry Research Areas: LLM reliability, ensemble methods, tail latency optimization, statistical testing Status: Active development, v0.1.0 released
- synapse ⭐ 20 - Synapse: Elixir-powered AI agent orchestration, built on the battle-teste…
- ds_ex ⭐ 14 - DSPEx - Declarative Self-improving Elixir | A BEAM-Native AI Program O…
- DSPex ⭐ 8 - Declarative Self Improving Elixir - DSPy Orchestration in Elixir
- mabeam ⭐ 4 - Multi Agent BEAM
- AutoElixir ⭐ 3 - AI Multi Agent Swarms in Elixir
- ALTAR ⭐ 4 - The Agent & Tool Arbitration Protocol
- gemini_ex ⭐ 16 - Elixir Interface / Adapter for Google Gemini LLM, for both AI Studio a…
- claude_agent_sdk ⭐ 7 - Elixir SDK for Claude AI Agent API - Renamed from claude_code_sdk_elix…
- codex_sdk ⭐ 0 - OpenAI Codex SDK written in Elixir
- jules_ex ⭐ 0 - Elixir client SDK for the Jules API - orchestrate AI coding sessions
- pipeline_ex ⭐ 6 - Claude Code + Gemini AI collaboration orchestration tools
- weaviate_ex ⭐ 0 - Modern Elixir client for Weaviate vector database with health checks…
- json_remedy ⭐ 20 - A practical, multi-layered JSON repair library for Elixir that intelli…
- snakepit ⭐ 8 - High-performance, generalized process pooler and session manager for e…
- sinter ⭐ 8 - Unified schema definition, validation, and JSON generation for Elixir
- exdantic ⭐ 8 - A powerful, flexible schema definition and validation library for Elix…
- perimeter ⭐ 6 - Elixir Typing Mechanism
- ex_dbg ⭐ 9 - State-of-the-Art Introspection and Debugging System for Elixir/Phoenix…
- elixir_scope ⭐ 4 - Revolutionary AST-based debugging and code intelligence platform for E…
- ElixirScope ⭐ 3 - AI-Powered Execution Cinema Debugger for Elixir/BEAM
- superlearner ⭐ 6 - OTP Supervisor Educational Platform
- apex ⭐ 3 - Core Apex framework for OTP supervision and monitoring
- apex_ui ⭐ 3 - Web UI for Apex OTP supervision and monitoring tools
- arsenal ⭐ 3 - Metaprogramming framework for automatic REST API generation from OTP o…
- arsenal_plug ⭐ 2 - Phoenix/Plug adapter for Apex Arsenal framework
- supertester ⭐ 3 - A battle-hardened testing toolkit for building robust and resilient El…
- sandbox ⭐ 3 - Isolated OTP application management system for Elixir/Erlang
- cluster_test ⭐ 3 - Distributed Erlang/Elixir test cluster management via Mix tasks
- foundation ⭐ 10 - Elixir infrastructure and Observability Library
- AITrace ⭐ 0 - The unified observability layer for the AI Control Plane
- Assessor ⭐ 0 - The definitive CI/CD platform for AI Quality.
- Citadel ⭐ 0 - The command and control layer for the AI-powered enterprise
- cf_ex ⭐ 3 - Elixir libraries for Cloudflare edge computing services. Battle-tested…
- ex_cloudflare_phoenix ⭐ 0 - Cloudflare Durable Objects and Calls for Phoenix Framework
- playwriter ⭐ 6 - Elixir WSL-to-Windows browser integration
- youtube_audio_dl ⭐ 0 - Download high-quality audio from YouTube as MP3 files using Elixir. Fe…
- tools ⭐ 0 - Elixir repository
Languages: Elixir, Erlang, Python, JavaScript/TypeScript, Rust
Frameworks: Phoenix, OTP, FastAPI, React
Specialties:
- Distributed systems & fault tolerance
- AI/LLM infrastructure & reliability
- Functional programming & metaprogramming
- Statistical analysis & experimental design
- Developer tools & productivity
Platforms: BEAM VM, AWS, GCP, Cloudflare Workers, Edge Computing
Research: LLM reliability through ensemble methods and statistical testing
Building: AI infrastructure on Elixir/OTP
Learning: Advanced OTP patterns, distributed systems optimization
Growing: The Crucible framework ecosystem
- GitHub: @nshkrdotcom
- Organization: @North-Shore-AI
"Build infrastructure that researchers and engineers actually want to use. Make reliability measurable. Make experiments reproducible. Make the BEAM shine for AI workloads."
Collaboration on Elixir AI tooling
Consulting for distributed systems & AI infrastructure
Speaking about LLM reliability, Elixir/OTP, or functional programming
Research partnerships in AI reliability & distributed systems
Open source contributions - PRs welcome on any project!
Last updated: 2025-10-18