⚠️ UNDER ACTIVE DEVELOPMENT This project is currently in early development and is not yet functional. Features are incomplete, APIs will change, and many systems are still being implemented. Please check the ROADMAP.md for current progress.
Vibe Coder 3D is an AI-first game engine that combines modern 3D rendering with conversational AI. Build 3D games by describing what you want in natural language, powered by React Three Fiber and a high-performance Rust native engine.
"Create a bouncing ball" → Complete physics simulation "Add a medieval castle" → 3D model sourced and placed "Make the player jump on spacebar" → Controller script generated
📍 View Full Roadmap - Feature roadmap, implementation status, and detailed progress tracking
- Dual Architecture: TypeScript/React editor + Rust native engine for best of both worlds
- Entity Component System (ECS): Data-oriented design with bitECS for high performance
- Physics Simulation: Full Rapier3D integration with collision detection and rigid bodies
- Scripting System: TypeScript-based with 14 global APIs and full lifecycle support
- Material System: PBR materials with texture support and live preview
- Prefab System: Unity-like prefabs with nesting and override capabilities
- Input Management: Action-based input mapping for keyboard, mouse, and gamepad
- Asset Pipeline: Automatic optimization with LOD generation and compression
- Visual Scene Editor: Drag-and-drop 3D scene creation
- Component Inspector: Real-time property editing
- Material Editor: Visual material creation with PBR support
- Prefab Browser: Asset management and instantiation
- Debug Tools: Performance monitoring, FPS counter, entity inspector
- Scene Serialization: Dual format (.tsx + .json) for editor and engine
- High-Performance Rendering: PBR rendering with three-d library
- Cross-Platform: Windows, Linux, and macOS support
- Lua Scripting: Full mlua runtime integration
- Debug Mode: Orbital camera, collider visualization, GPU profiling
- Screenshot System: Visual regression testing support
- Modular Architecture: Workspace crates for maintainability
- Node.js >= 20.0.0
- Yarn 1.22+
- Rust 1.75+ (for native engine)
# Clone the repository
git clone https://github.com/jonit-dev/vibe-coder-3d.git
cd vibe-coder-3d
# Install dependencies
yarn install
# Start the development server
yarn devThe editor will be available at http://localhost:5173
# Run a test scene
yarn rust:engine --scene testphysics
# Run with debug mode (colliders, FPS, grid)
yarn rust:engine --scene testphysics --debug
# Custom window size
yarn rust:engine --scene testphysics --width 1920 --height 1080- Start the editor:
yarn dev - Use the Add Object menu (Ctrl+N) to create entities
- Configure components in the Inspector panel
- Save your scene with Ctrl+S
- Test in Rust engine:
yarn rust:engine --scene yourscene
Comprehensive documentation is available in the docs/ directory:
- Documentation Navigation - Complete documentation map and reading guide
- Core Abstractions - Engine foundation and architecture
- ECS System - Entity Component System details
- Physics System - Physics integration guide
- Scripting System - Script APIs and lifecycle
- Material System - Material creation and management
- Prefabs System - Prefab workflow and patterns
- Rust Engine README - Native engine documentation
For a complete list of 50+ documentation files, see docs/0-navigation.md.
Practical guides for common tasks:
- Script API Quick Reference - Most commonly used script APIs
- Input Actions Quick Start - Setting up player controls
- Adding Components - Creating custom components
- 3D Asset Optimization - Optimizing models for performance
# Development
yarn dev # Start TypeScript editor
yarn dev:nosync # Start without asset sync
# Testing
yarn test # Run tests
yarn test:coverage # Generate coverage report
yarn typecheck # Type checking
yarn lint # Lint code
yarn lint:fix # Fix linting issues
# Rust Engine
yarn rust:engine --scene <name> # Run native engine
yarn rust:build # Build Rust engine
yarn rust:test # Run Rust tests
yarn rust:screenshot # Capture screenshot
# Build
yarn build # Production build
yarn preview # Preview production buildTypeScript Editor:
- Status bar with FPS, memory, entity count
- Inspector panel for component details
- Browser DevTools for full logging
Rust Engine Debug Mode:
yarn rust:engine --scene testphysics --debug- F1: Toggle HUD (FPS, frame time, physics stats)
- F2: Toggle collider gizmos
- F3: Toggle debug camera (orbital controller)
- F4: Toggle GPU profiler
- React 19 - UI framework
- React Three Fiber - Declarative 3D rendering
- Three.js - WebGL 3D library
- TypeScript - Type-safe development
- Vite - Ultra-fast build tool
- TailwindCSS - Utility-first styling
- bitECS - High-performance ECS
- Rapier - Physics engine (WebAssembly)
- Zustand - State management
- Zod - Runtime type validation
- Howler.js - Audio system
- Rust - Systems programming language
- three-d - 3D rendering library
- rapier3d - Physics simulation
- mlua - Lua scripting integration
- winit - Window management
vibe-coder-3d/
├── src/
│ ├── core/ # Core engine (ECS, systems, components)
│ ├── editor/ # Editor UI and tools
│ └── game/ # Game-specific code (scenes, scripts, assets)
├── rust/
│ ├── engine/ # Rust native engine
│ └── game/ # Rust game runtime (scenes, scripts)
├── docs/ # Comprehensive documentation
├── scripts/ # Build and utility scripts
└── public/ # Public web assets
Phase: Foundation Complete → Next: AI Integration
- ✅ Core engine infrastructure established
- ✅ Editor with scene manipulation capabilities
- ✅ ECS system with physics integration
- ✅ TypeScript scripting with 14 APIs
- ✅ Material and prefab systems
- ✅ Rust native engine with feature parity
- 🚧 AI Copilot system development beginning
- ⏳ Natural language command processing
For detailed feature roadmap and progress tracking, see ROADMAP.md
We welcome contributions! Start with CONTRIBUTING.md for complete guidelines.
Quick links:
- CONTRIBUTING.md - Contribution guidelines, coding standards, and testing requirements
- ROADMAP.md - Feature roadmap, implementation status, and sprint planning
- WORKFLOW.md - Git Flow branching model, PR process, and release workflow
- CODE_OF_CONDUCT.md - Community standards and expectations
- Fork the repository
- Create a feature branch (
git checkout -b feature/amazing-feature) - Make your changes
- Run tests and linting (
yarn verify) - Commit with conventional commits (
feat: add amazing feature) - Push to your fork
- Open a Pull Request
For detailed workflow instructions, including release and hotfix processes, see WORKFLOW.md.
- Join the Discussion: Discord
- GitHub Issues: Report bugs or request features
- GitHub Discussions: Ask questions and share ideas
This project is licensed under the MIT License - see the LICENSE file for details.
Built with amazing open source technologies:
- React Three Fiber - React renderer for Three.js
- bitECS - High-performance ECS
- Rapier - Fast 2D and 3D physics engine
- three-d - Rust 3D rendering library