Watchr Is a file watching service for importing records into a Postgres database.

Watchr is organized through the usage of Pydantic models to govern the behavior of how a file get processed, the actions around its artifact cleanup, and other configuration.

This project is still rough and narrowly focused for my own personal use cases at the moment but in the future i may put forth more intention in making this more general and accessible to others.

• Watchr
  • Table of Contents
  • Features
  • Requirements
    • Recommended
  • Installation
    • Users
    • Contributors
  • Usage
    • Example
  • Documentation
  • Resources
  • Development
    • Security
    • Future
    • History
    • Community
  • Credits
  • License

Return To Top

<++>

Return To Top

<++>

Return To Top

<++>

Return To Top

<++>

Return To Top

<++>

See Usage

Return To Top

See CONTRIBUTING

Return To Top

<++>

Return To Top

Pull image from ghcr.io

docker pull ghcr.io/bryan-jenks-home-lab/etl_strong_app:main

Run image

docker run -d \
    -e DB_CONNECTION_STRING='postgresql+psycopg2://<USER>:<PASSWORD>@<SERVER>:<PORT>/<DATABASE>' \
    -e EXPECTED_FILE=strong.csv \
    -e TARGET_TABLE=<DATABASE>.<SCHEMA>.<TABLE_NAME> \
    -e WATCH_PATH=/data/inbound \
    -e STAGING_PATH=/data/outbound \
    -e PROCESSED_PATH=/data/processed \
    -v /<PATH_ON_YOUR_MACHINE>/strong_app_import/inbound:/data/inbound \
    -v /<PATH_ON_YOUR_MACHINE>/strong_app_import/outbound:/data/outbound \
    -v /<PATH_ON_YOUR_MACHINE>/strong_app_import/processed:/data/processed \
    ghcr.io/bryan-jenks-home-lab/etl_strong_app:main

Return To Top

<++>

Return To Top

<++>

Return To Top

1. python -m pip install poetry python-dotenv pre-commit
2. pre-commit install
3. pre-commit autoupdate

See Road Map

Return To Top

See SECURITY

Return To Top

See ROADMAP

Return To Top

See RELEASES

Return To Top

<++>

See CODE OF CONDUCT

Return To Top

See AUTHORS

Return To Top

See LICENSE