Olympia is a storage-only open catalog format for big data analytics, ML & AI. See olympiaformat.org for full documentation.
Olympia Java SDK is built using Gradle and supports Java 11, 17, 21, or 23.
To build and run tests:
./gradlew build
To build without running tests:
./gradlew build -x test
All Java and Scala code is linted using checkstyle and spotless. To fix code style, run:
./gradlew spotlessApply
When making changes to the local files and test them out, you can build the image locally:
./gradlew :olympia-spark:olympia-spark-runtime-3.5_2.12:shadowJar
docker image rm -f olympia/olympia-gravitino-irc
docker build -t olympia/olympia-gravitino-irc -f docker/gravitino/Dockerfile .
Run the Docker container:
docker run -d -p 9001:9001 --name olympia-gravitino-irc \
olympia/olympia-gravitino-irc
The website is built using mkdocs-material. The easiest way to setup is to create a Python virtual environment and install the necessary dependencies:
python3 -m venv .env
source .env/bin/activate
pip install mkdocs-material
pip install mkdocs-awesome-pages-plugin
Then you can start the server at http://localhost:8000
by:
source .env/bin/activate
mkdocs serve