Skip to content

Commit 402a150

Browse files
authored
feat(encoding): Add Parquet encoding support (#39)
* feat(encoding): Add Parquet encoding support This commit introduces Parquet encoding support to the Prolly Tree library. Changes include: - Added the `parquet` crate as a dependency. - Updated the `EncodingType` enum to include `Parquet`. - Implemented the `encode_parquet` function. - Added a test case for Parquet encoding and made tests order-agnostic. - Bumped the version to `0.2.0-alpha.1. * style: rustfmt * refactor(encoding): Remove unwrap() calls and propagate errors * style: rustfmt * docs: Mark Parquet/Avro encoding as finished in roadmap
1 parent 197d1db commit 402a150

File tree

4 files changed

+223
-70
lines changed

4 files changed

+223
-70
lines changed

Cargo.toml

Lines changed: 4 additions & 9 deletions
Original file line numberDiff line numberDiff line change
@@ -2,7 +2,7 @@
22
name = "prollytree"
33
description = "A prolly (probabilistic) tree for efficient storage, retrieval, and modification of ordered data."
44
authors = ["Feng Zhang <[email protected]>"]
5-
version = "0.1.0-beta.1"
5+
version = "0.2.0-alpha.1"
66
edition = "2021"
77

88
license = "Apache-2.0"
@@ -17,22 +17,17 @@ base64 = { version = "0.22.0", optional = true }
1717
sha2 = "0.10"
1818
tracing = { version = "0.1.37", optional = true }
1919
rand = "0.9.0"
20-
lazy_static = "1.4.0"
2120
serde = { version = "1.0", features = ["derive"] }
22-
hex = "0.4.3"
2321
bincode = "1.3.3"
24-
thiserror = "2.0.3"
22+
thiserror = "1.0"
2523
twox-hash = "2.0"
2624
serde_json = "1.0.117"
2725
arrow = "54.2.1"
2826
schemars = "0.8"
27+
parquet = { version = "54.0.0", features = ["arrow"] }
2928

3029
[dev-dependencies]
31-
assert_matches = "1.5.0"
32-
criterion = "0.5.1"
33-
insta = "1.31.0"
34-
paste = "1.0.14"
35-
proptest = "1.2.0"
30+
bytes = "1.10.1"
3631
tracing = "0.1.37"
3732
tracing-subscriber = { version = "0.3.17", features = ["env-filter"] }
3833

README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -185,7 +185,7 @@ The following features are for Prolly tree library for Version 0.1.0:
185185

186186
The following features are for Prolly tree library for Version 0.2.0:
187187
- [X] Arrow block encoding and decoding
188-
- [ ] Parquet/Avro block encoding and decoding
188+
- [X] Parquet/Avro block encoding and decoding
189189
- [ ] Advanced probabilistic tree balancing
190190

191191
## Contributing

0 commit comments

Comments
 (0)