temporary repo / maybe permanent for CalITP data infrastructure
airflowcontains the local dev setup and source code for Airflow DAGs (ie, ETLs)airflow/dagscontains source code for ETLs, scripts, more.catalogscontains intake catalogs for semi-static / version data access.jupyterhubcontains the image and commands for setting up ETLs to run
This repository uses black and pre-commit hooks to format code. To install locally, run
pip install pre-commit & pre-commit install in the root of the repo.
See airflow/README.md
- Follow the Conventional Commits standard for all commits
- Use Conventional Commit format for PR titles
- Use GitHub's draft status to indicate PRs that are not ready for review/merging
- Do not use GitHub's "update branch" button or merge the
mainbranch back into a PR branch to update it. Instead, rebase PR branches to update them and resolve any merge conflicts.