Skip to content

fangbo/lance-spark

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

45 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Apache Spark Connector for Lance

The Apache Spark Connector for Lance allows Apache Spark to efficiently read datasets stored in Lance format. By using the Apache Spark Connector for Lance, you can leverage Apache Spark's powerful data processing, SQL querying, and machine learning training capabilities on the AI data lake powered by Lance.

For more details, please visit the documentation website.

For development setup and contribution guidelines, please see CONTRIBUTING.md.

About

Spark integrations for working with Lance datasets

Resources

License

Contributing

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Java 81.7%
  • Scala 11.2%
  • Python 2.8%
  • Jupyter Notebook 2.5%
  • Dockerfile 1.0%
  • Makefile 0.7%
  • Shell 0.1%