Skip to content

crufter/singulatron

 
 

Repository files navigation

Singulatron

AI management and development platform.

backend build frontend build

Singulatron enables you to self-host AI models, build apps that leverage those models in any language, and utilize a microservices-based communal backend designed to support a diverse range of projects.

Primary Use Cases

Run AI Models [x]

Run open-source AI models privately on your own infrastructure, ensuring that your data and operations remain fully under your control.

Quickly Build Backendless AI Apps [x]

Build backendless application by using Singulatron as a database and AI prompting API. Like Firebase, but with a focus on AI.

Develop Microservices-Based AI Applications [ ]

Build your own backend services around Singulatron, which itself is built on a microservices architecture. Run these services outside or inside the Singulatron platform.

Deploy Third-Party AI Apps Easily [ ]

Singulatron is designed to make deploying third-party AI applications straightforward. With its focus on virtualization and containers (primarily Docker) and a microservices, API-first approach (using OpenAPI), Singulatron seamlessly integrates other applications into its ecosystem.

Run On Your Servers

See this page to help you get started.

Main Services

https://superplatform.ai/docs/category/singulatron-api

Prompt Svc

Sync or async, streamed or request/response prompting. Dump tens of thousands of prompts into the system and let the prompt queue process it.

Download Svc

Start, pause, restart large file downloads to enable you to manage your AI models.

Chat Svc

Manage threads, messages, assets (generated images etc.).

User Svc

Role-based access control, JWT, fine tuned permissions and a unique ownership model that lets you build microservices based AI apps.

Node Svc

Get information about your nodes and GPUs like temperature, VRAM usage etc.

Dynamic svc

A dynamically typed (schema-free) datastore service that lets you piggyback on Singulatron's database. Lets you build backendless applications on top of Singulatorn. Think Firebase but for AI.

Run On Your Laptop/PC

We have temporarily discontinued the distribution of binaries. Please refer to this page for alternative methods to run the software.

Stack

It is an Electron application, with Angular on the frontend and Go on the backend. It becomes a simple web app without electron when hosted over the network.

License

Singulatron is licensed under AGPL-3.0.

Status

Fairly early phase but there are quite a few installations chugging along nicely already. Why don't you join them?

About

AI management and development platform. Self-host AI models and build apps with them.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • MDX 36.0%
  • TypeScript 34.5%
  • Go 25.6%
  • HTML 2.0%
  • SCSS 1.0%
  • JavaScript 0.4%
  • Other 0.5%