Tensors and Dynamic neural networks in Python with strong GPU acceleration

SYCL based CUTLASS implementation for Intel GPUs

SGLang is a fast serving framework for large language models and vision language models.

A high-throughput and memory-efficient inference and serving engine for LLMs

HiBench is a big data benchmark suite.

Dynolog is a telemetry daemon for performance monitoring and tracing. It exports metrics from different components in the system like the linux kernel, CPU, disks, Intel PT, GPUs etc. Dynolog also …

RayDP: Distributed data processing library on Ray by running popular big data frameworks like Apache Spark on Ray. RayDP seamlessly integrates with other Ray libraries to make it simple to build E2…

Distributed Tensorflow, Keras and PyTorch on Apache Spark/Flink & Ray

Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.

Step-by-step Deep Leaning Tutorials on Apache Spark using BigDL

Mirror of Apache Spark

Performance Analysis Tool

SparkMeasure is a tool for performance troubleshooting of Apache Spark workloads. It simplifies the collection and analysis of Spark task metrics data.

Optimized Analytics Package for Spark Platform

MPI-oriented extension of the Spark computational model

TPC-DS benchmark kit with some modifications/fixes

BigDL: Distributed Deep learning Library for Apache Spark

Drizzle integration with Apache Spark

A Reliable Memory Centric Distributed Storage System

Sparrow scheduling platform (U.C. Berkeley).