Skip to content

Pixels 0.1.0

Latest

Choose a tag to compare

@bianhq bianhq released this 04 Aug 09:40
· 353 commits to master since this release
e5342d7

Main Features

  • Optimized columnar storage on HDFS, S3, MinIO, local FS, GCS, and Redis. Significantly outperforms Parquet and ORC.
  • A distributed in-memory columnar cache that further improves I/O performance for data analytics.
  • External query engine integrations for Trino, Presto, Hive, and DuckDB. Significantly improves query performance in these query engines.
  • Metadata (database schema and data catalog) management for data lakes and warehouses.
  • Internal query accelerator (Pixels-Turbo) in serverless computing environments, including AWS Lambda and vHive (K8S+Knative+Firecracker).
  • REST query API that exposes Pixels as a serverless analytics service for external users.

Release Notes

What's Changed

New Contributors

  • @bianhq and @ray6080 were the first two authors of the project. They co-authored the basic framework of Pixels
  • @taoyouxian made contributions to the Presto and Hive integrations of Pixels
  • @mzp0514 made contributions to the initial implementation of data upserts in Pixels
  • @xxchan made contributions to the Trino integration of Pixels and the initial implementation of snapshot query execution
  • @TiannanSha made contributions to serverless query acceleration in AWS Lambda
  • @josephhany made contributions to exploring query cost estimation solutions
  • @Yeeef made contributions to extending in-memory columnar cache to SSDs
  • @yuly16 made contributions to the implementation of the C++ reader and DuckDB integration of Pixels, and improved the query performance on SSDs
  • @voidforall made contributions to the query service implementation and the hybrid query execution in DuckDB
  • @zhaoshihan made contributions to serverless query execution and performance profiling in vHive
  • @jasha64 made contributions to SSD performance benchmarking and serverless query execution in vHive

Full Changelog: https://github.com/pixelsdb/pixels/commits/v0.1.0