Highlights:

• mx.fast subpackage
• Custom mx.fast.rope up to 20x faster

Core

• Support metadata with safetensors
• Up to 5x faster scatter and 30% faster gather
• 40% faster bfloat16 quantizated matrix-vector multiplies
• mx.fast subpackage with a fast RoPE
• Context manager mx.stream to set the default device

NN

• Average and Max pooling layers for 1D and 2D inputs

Optimizers

• Support schedulers for e.g. learning rates
• A few basic schedulers:
  • optimizers.step_decay
  • optimizers.cosine_decay
  • opimtizers.exponential_decay

Bugfixes

• Fix bug in remainder with negative numerators and integers
• Fix bug with slicing into softmax
• Fix quantized matmuls with non 32 multiples