Skip to content

hsiang-c/olympia

 
 

Repository files navigation

Olympia Format

Olympia Logo

Olympia is a storage-only open catalog format for big data analytics, ML & AI. See olympiaformat.org for full documentation.

Development Setup

Java

Olympia Java SDK is built using Gradle and supports Java 11, 17, 21, or 23.

To build and run tests:

./gradlew build

To build without running tests:

./gradlew build -x test

All Java and Scala code is linted using checkstyle and spotless. To fix code style, run:

./gradlew spotlessApply

Docker

When making changes to the local files and test them out, you can build the image locally:

./gradlew :olympia-spark:olympia-spark-runtime-3.5_2.12:shadowJar
docker image rm -f olympia/olympia-gravitino-irc
docker build -t olympia/olympia-gravitino-irc -f docker/gravitino/Dockerfile .

Run the Docker container:

docker run -d -p 9001:9001 --name olympia-gravitino-irc \
olympia/olympia-gravitino-irc

Website

The website is built using mkdocs-material. The easiest way to setup is to create a Python virtual environment and install the necessary dependencies:

python3 -m venv .env
source .env/bin/activate
pip install mkdocs-material
pip install mkdocs-awesome-pages-plugin

Then you can start the server at http://localhost:8000 by:

source .env/bin/activate
mkdocs serve

About

Olympia is a storage-only open catalog format for big data analytics, ML & AI.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Java 95.0%
  • Scala 4.4%
  • Other 0.6%