🚀🚀 「大模型」2小时完全从0训练26M的小参数GPT！🌏 Train a 26M-parameter GPT from scratch in just 2h!

these are custom recipes of nvidia nsight system post collection analysis.

Tile primitives for speedy kernels

The official repo of Qwen-7B (通义千问-7B) chat & pretrained large language model proposed by Alibaba Cloud.

Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more

A set of examples around pytorch in Vision, Text, Reinforcement Learning, etc.

KungFu: An Easy, Fast and Adaptive Distributed Training Library

《动手学深度学习》：面向中文读者、能运行、可讨论。英文版即伯克利“深度学习导论”教材。

Homepage for STAT 157 at UC Berkeley

Deep Learning introduction and its application in various fields

Systems for ML/AI & ML/AI for Systems paper reading list: A curated reading list of computer science research for work at the intersection of machine learning and systems. PR are welcome.

Computation using data flow graphs for scalable machine learning

Efficiently computes derivatives of numpy code.

Distributed TensorFlow basics and examples of training algorithms

repository to host {OpenGrok docker files

Optimized primitives for collective multi-GPU communication

TensorFlow & Deep Learning Tutorial

This repository contains Deep Learning based articles , paper and repositories for Recommender Systems

Deep Learning NLP Pipeline implemented on Tensorflow

Deep Scalable Sparse Tensor Network Engine (DSSTNE) is an Amazon developed library for building Deep Learning (DL) machine learning (ML) models

Lightweight, Portable, Flexible Distributed/Mobile Deep Learning with Dynamic, Mutation-aware Dataflow Dep Scheduler; for Python, R, Julia, Scala, Go, Javascript and more

Machine Learning、Deep Learning、PostgreSQL、Distributed System、Node.Js、Golang

Simple tutorials using Google's TensorFlow Framework

Parameter server framework for distributed machine learning