Metadata driven Spark Declarative Pipelines framework for bronze/silver pipelines

⚡ Fastest SQL ETL pipeline in a single C++ binary, built for stream processing, observability, analytics and AI/ML

Train machine learning models within a 🐳 Docker container using 🧠 Amazon SageMaker.

Serve machine learning models within a 🐳 Docker container using 🧠 Amazon SageMaker.

A Lightweight Recommendation System

Zstandard - Fast real-time compression algorithm

Extremely Fast Compression algorithm

A curated list of awesome things related to FastAPI

Projeto de ingestão, organização e processamento de dados de genoma

This repository provides Code examples written in Python,Spark-Scala using primarily boto3 SDK API methods and aws cli examples for majority of the AWS Big Data services. There are also nicley writ…

A curated collection of publicly available resources on how technology and tech-savvy organizations around the world use Amazon Web Services (AWS)

Example of AWS Glue Jobs and workflow deployment with terraform in monorepo style. Code here supports the miniseries of articles about AWS Glue and python.

Unofficial AWS Glue Ray.io packaging tool. Pure python or cross platform.

VSCode Dev Container template for AWS Glue jobs development

PyIceberg

💻 A fully functional local AWS cloud stack. Develop and test your cloud & Serverless apps offline

Data Engineering Zoomcamp is a free 9-week course on building production-ready data pipelines. The next cohort starts in January 2026. Join the course here 👇🏼

Analysing the bias in BBC reporting on Palestine.

Converts woff files to otf files

Codespace with Airflow and the Astro CLI

Python Serverless Microframework for AWS

Image Super-Resolution for Anime-Style Art

A High-Quality Real Time Upscaler for Anime Video

Capture deep metrics on one or all assets within a Databricks workspace