|
21 | 21 |
|
22 | 22 | Native Rust implementation of [Apache Iceberg](https://iceberg.apache.org/).
|
23 | 23 |
|
| 24 | +## Roadmap |
| 25 | + |
| 26 | +### Catalog |
| 27 | + |
| 28 | +| Catalog Type | Status | |
| 29 | +|--------------|-------------| |
| 30 | +| Rest | Done | |
| 31 | +| Hive | In Progress | |
| 32 | +| Sql | Not Started | |
| 33 | +| Glue | Not Started | |
| 34 | +| DynamoDB | Not Started | |
| 35 | + |
| 36 | +### FileIO |
| 37 | + |
| 38 | +| FileIO Type | Status | |
| 39 | +|-------------|-------------| |
| 40 | +| S3 | Done | |
| 41 | +| Local File | Done | |
| 42 | +| GCS | Not Started | |
| 43 | +| HDFS | Not Started | |
| 44 | + |
| 45 | +Our `FileIO` is powered by [Apache OpenDAL](https://github.com/apache/incubator-opendal), so it would be quite easy to |
| 46 | +expand to other service. |
| 47 | + |
| 48 | +### Table API |
| 49 | + |
| 50 | +#### Reader |
| 51 | + |
| 52 | +| Feature | Status | |
| 53 | +|------------------------------------------------------------|-------------| |
| 54 | +| File based task planning | In progress | |
| 55 | +| Size based task planning | Not started | |
| 56 | +| Filter pushdown(manifest evaluation, partition prunning) | Not started | |
| 57 | +| Apply deletions, including equality and position deletions | Not started | |
| 58 | +| Read into arrow record batch | Not started | |
| 59 | +| Parquet file support | Not started | |
| 60 | +| ORC file support | Not started | |
| 61 | + |
| 62 | +#### Writer |
| 63 | + |
| 64 | +| Feature | Status | |
| 65 | +|--------------------------|-------------| |
| 66 | +| Data writer | Not started | |
| 67 | +| Equality deletion writer | Not started | |
| 68 | +| Position deletion writer | Not started | |
| 69 | +| Partitioned writer | Not started | |
| 70 | +| Upsert writer | Not started | |
| 71 | +| Parquet file support | Not started | |
| 72 | +| ORC file support | Not started | |
| 73 | + |
| 74 | +#### Transaction |
| 75 | + |
| 76 | +| Feature | Status | |
| 77 | +|-----------------------|-------------| |
| 78 | +| Schema evolution | Not started | |
| 79 | +| Update partition spec | Not started | |
| 80 | +| Update properties | Not started | |
| 81 | +| Replace sort order | Not started | |
| 82 | +| Update location | Not started | |
| 83 | +| Append files | Not started | |
| 84 | +| Rewrite files | Not started | |
| 85 | +| Rewrite manifests | Not started | |
| 86 | +| Overwrite files | Not started | |
| 87 | +| Row level updates | Not started | |
| 88 | +| Replace partitions | Not started | |
| 89 | +| Snapshot management | Not started | |
| 90 | + |
| 91 | +### Integrations |
| 92 | + |
| 93 | +We will add integrations with other rust based data systems, such as polars, datafusion, etc. |
| 94 | + |
24 | 95 | ## Contribute
|
25 | 96 |
|
26 | 97 | Iceberg is an active open-source project. We are always open to people who want to use it or contribute to it. Here are some ways to go.
|
|
0 commit comments