A high-throughput and memory-efficient inference and serving engine for LLMs

Demo applications showcasing DJL

An Engine-Agnostic Deep Learning Framework in Java

A library for training and deploying machine learning models on Amazon SageMaker

AWS Deep Learning Containers (DLCs) are a set of Docker images for training and serving models in TensorFlow, TensorFlow 2, PyTorch, and MXNet.

The Java implementation of Dive into Deep Learning (D2L.ai)

A framework for few-shot evaluation of language models.

Reference implementation of Mistral AI 7B v0.1 model.

DJL Spring Boot Starter Demo apps

DJL Spring Boot Starter

Example 📓 Jupyter notebooks that demonstrate how to build, train, and deploy machine learning models using 🧠 Amazon SageMaker.

Large Language Model Text Generation Inference

Accelerating new GitHub Actions workflows

Implementation of JSR381's API using DJL.

🍻 Default formulae for the missing package manager for macOS (or Linux)