Apache Doris is an easy-to-use, high performance and unified analytics database.

🧙 Build, run, and manage data pipelines for integrating and transforming data.

Apache Celeborn is an elastic and high-performance service for shuffle and spilled data.

Apache DataFusion Comet Spark Accelerator

Spark RAPIDS plugin - accelerate Apache Spark with GPUs

Apache Spark Connect Client for Rust

Apache Spark - A unified analytics engine for large-scale data processing

Quill for Scala 3

Compile-time Language Integrated Queries for Scala

Know your data better！Datavines is Next-gen Data Observability Platform, support metadata manage and data quality.

Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.

Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.

Prime Number Generator using PySpark

An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs

🏆 Spark4You Design patterns

Uniffle is a high performance, general purpose Remote Shuffle Service.

Implementation of "Colossal Trajectory Mining: A Unifying Approach to Mine Behavioral Mobility Patterns." Expert Systems with Applications.

H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.

This construct builds some elements for you to quickly launch an EMR Serverless application. After submitting the Emr Serverless job, you could also launch an EMR notebook via cluster template to check the outcome from the EMR Serverless application.

Extensible Python SDK for developing Flyte tasks and workflows. Simple to get started and learn and highly extensible.