Databricks framework to validate Data Quality of pySpark DataFrames

SWE-agent takes a GitHub issue and tries to automatically fix it, using your LM of choice. It can also be employed for offensive cybersecurity or competitive coding challenges. [NeurIPS 2024]

llama3 implementation one matrix multiplication at a time

📚 Learn to write an embedded OS in Rust 🦀

Open, Multi-modal Catalog for Data & AI

Code examples and resources for DBRX, a large language model developed by Databricks

This is a Databricks Cybersecurity demo for building linked detection, investigation and response jobs in Databricks

Databricks CLI

Generate relevant synthetic data quickly for your projects. The Databricks Labs synthetic data generator (aka `dbldatagen`) may be used to generate large simulated / synthetic data sets for test, P…

A Quality Spark DQ and transformation Library

A curated list of resources about detecting threats and defending Kubernetes systems.

An incremental parsing system for programming tools

A native Rust library for Delta Lake, with bindings into Python

Terraform provider for Azure Resource Manager

Databricks Terraform Provider

A cluster computing framework for processing large-scale geospatial data

GeoMesa is a suite of tools for working with big geo-spatial data in a distributed fashion.

4mc - splittable lz4 and zstd in hadoop/spark/flink

Send code blocks (Python, SQL, Scala, R) to a Databricks cluster

Web-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Scala and more.

Concurrent Radix and Suffix Trees for Java

A List of Recommender Systems and Resources

Bartosz Milewski's 'Category Theory for Programmers' unofficial PDF and LaTeX source

Logback appender for Apache Kafka

Companion webpage to the book "Mathematics For Machine Learning"

This note presents in a technical though hopefully pedagogical way the three most common forms of neural network architectures: Feedforward, Convolutional and Recurrent.

Practical Gremlin - An Apache TinkerPop Tutorial

Dynamic Tensor Graph library in Clojure (think PyTorch, DynNet, etc.)

PlantUML sprites, macros, and other includes for AWS components.