-
-
Notifications
You must be signed in to change notification settings - Fork 330
Doc/v3 migration guide #2102
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Doc/v3 migration guide #2102
Changes from all commits
File filter
Filter by extension
Conversations
Jump to
Diff view
Diff view
There are no files selected for viewing
Original file line number | Diff line number | Diff line change |
---|---|---|
|
@@ -9,6 +9,7 @@ Zarr-Python | |
:hidden: | ||
|
||
getting_started | ||
migration | ||
tutorial | ||
api/index | ||
spec | ||
|
Original file line number | Diff line number | Diff line change | ||||
---|---|---|---|---|---|---|
@@ -0,0 +1,91 @@ | ||||||
Zarr-Python 3 Migration Guide | ||||||
============================= | ||||||
|
||||||
Zarr-Python 3 introduces a number of changes to the API, including a number | ||||||
of significant breaking changes and pending deprecations. | ||||||
|
||||||
This page provides a guide highlighting the most notable changes to help you | ||||||
migrate your code from version 2 to version 3. | ||||||
|
||||||
Compatibility target | ||||||
-------------------- | ||||||
|
||||||
Zarr-Python 3 represents a major refactor of the Zarr-Python codebase. Some of the goals motivating this refactor included: | ||||||
|
||||||
- adding support for the Zarr V3 specification (alongside the Zarr V2 specification) | ||||||
- cleaning up internal and user facing APIs | ||||||
- improving performance (particularly in high latency storage environments like cloud object store) | ||||||
|
||||||
These goals necessitated some breaking changes to the API (hence the major version update), but we have tried to maintain | ||||||
backwards compatibility in the most widely used parts of the API including the `Array` and `Group` classes and the top-level | ||||||
API (e.g. `zarr.open_array` and `zarr.open_group`). | ||||||
|
||||||
Getting ready for 3.0 | ||||||
--------------------- | ||||||
|
||||||
Ahead of the 3.0 release, we suggest projects that depend on Zarr-Python take the following actions: | ||||||
|
||||||
1. Pin the supported Zarr-Python version to ``zarr>=2,<3``. This is a best practice and will protect your users from any incompatibilities that may arise during the release of Zarr-Python 3.0. | ||||||
2. Limit your imports from the Zarr-Python package. Most of the primary API ``zarr.*`` will be compatible in 3.0. However, the following breaking API changes are planned: | ||||||
|
||||||
- ``numcodecs.*`` will no longer be available in ``zarr.*``. (Suggested action: transition to importing codecs from ``numcodecs`` directly.) | ||||||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
Suggested change
We should be doing more than "suggesting", we should be providing concrete fixes/code updates! There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Even if there isn't a reasonable way to deprecate the imports, as a minimum this migration guide should provide a complete list of all imports that are disappearing and how to replace them. |
||||||
- The ``zarr.v3_api_available`` feature flag is being removed. In zarr-python v3 the v3 API is always available, so you shouldn't need to use this flag. | ||||||
- The following internal modules are being removed or significantly changed. If your application relies on imports from any of the below modules, you will need to either a) modify your application to no longer rely on these imports or b) vendor the parts of the specific modules that you need. | ||||||
|
||||||
- ``zarr.attrs`` | ||||||
- ``zarr.codecs`` | ||||||
- ``zarr.context`` | ||||||
- ``zarr.core`` | ||||||
- ``zarr.hierarchy`` | ||||||
- ``zarr.indexing`` | ||||||
- ``zarr.meta`` | ||||||
- ``zarr.meta_v1`` | ||||||
- ``zarr.storage`` | ||||||
- ``zarr.sync`` | ||||||
- ``zarr.types`` | ||||||
- ``zarr.util`` | ||||||
- ``zarr.n5`` | ||||||
|
||||||
jhamman marked this conversation as resolved.
Show resolved
Hide resolved
|
||||||
3. Test that your package works with v3. You can start testing against version 3 now (pre-releases are being published to PyPI weekly). | ||||||
4. Update the pin to zarr >=3 | ||||||
|
||||||
Continue using Zarr-Python 2 | ||||||
jhamman marked this conversation as resolved.
Show resolved
Hide resolved
|
||||||
---------------------------- | ||||||
|
||||||
Zarr-Python 2.x is still available, though we recommend migrating to Zarr-Python 3 for its improvements and new features. | ||||||
Security and bug fixes will be made to the 2.x series for at least 6 months following the first Zarr-Python 3 release. | ||||||
|
||||||
If you need to use the latest Zarr-Python 2 release, you can install it with: | ||||||
|
||||||
$ pip install "zarr==2.*" | ||||||
jhamman marked this conversation as resolved.
Show resolved
Hide resolved
|
||||||
|
||||||
|
||||||
Migration Guide | ||||||
--------------- | ||||||
|
||||||
The following sections provide details on the most important changes in Zarr-Python 3. | ||||||
|
||||||
Changes to the Array class | ||||||
~~~~~~~~~~~~~~~~~~~~~~~~~~ | ||||||
|
||||||
1. Disallow direct construction | ||||||
|
||||||
Changes to the Group class | ||||||
~~~~~~~~~~~~~~~~~~~~~~~~~~ | ||||||
|
||||||
1. Disallow direct construction | ||||||
|
||||||
Changes to the Store class | ||||||
~~~~~~~~~~~~~~~~~~~~~~~~~~ | ||||||
|
||||||
Some of the biggest changes in Zarr-Python 3 are found in the `Store` class. The most notable changes to the Store API are: | ||||||
|
||||||
1. Dropped the ``MutableMapping`` base class in favor of a custom abstract base class (``zarr.abc.store.Store``). | ||||||
2. Switched to a primarily Async interface. | ||||||
|
||||||
TODO | ||||||
|
||||||
Miscellaneous changes | ||||||
~~~~~~~~~~~~~~~~~~~~~ | ||||||
|
||||||
TODO |
Uh oh!
There was an error while loading. Please reload this page.