Skip to content

This extension doesn't scale well #9

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
m-mohr opened this issue Apr 17, 2025 · 2 comments · May be fixed by #11
Open

This extension doesn't scale well #9

m-mohr opened this issue Apr 17, 2025 · 2 comments · May be fixed by #11

Comments

@m-mohr
Copy link
Contributor

m-mohr commented Apr 17, 2025

Binding specific language-specific implementation details to the metadata, seems like a bad idea.
If we would have extensions for R, C, Java, Julia, JS, whatever, the metadata would explode.
If at some point xarray changes, you'd need to update your whole metadata, too.
I think this extension should either be generalized to work for various languages and environments or just go away (sorry, hot take, I know.)

@TomAugspurger
Copy link
Collaborator

I'm not too worried about that.

@TomAugspurger
Copy link
Collaborator

One thing that has changed since this was started is xpystac exists now. But that will use information in xarray-assets to load the data.

If I were starting from scratch, it'd be better to put some bits of information (like the storage account of some dataset) in a separate azure-blob-storage extension, chunking information in some other extension, and then have a library like xpystac collect all that necessary information to open the asset. But oh well.

Still, it's worth linking to xpystac from the readme.

TomAugspurger added a commit that referenced this issue May 2, 2025
This deprecates the xarray-assets extension.

The deprecation notice includes recommendations to use some other extensions and libraries that would need to exist for us to actually have an alternative (I'm not planning to work on those, but chime in here if you want to).

Closes #9
@TomAugspurger TomAugspurger linked a pull request May 2, 2025 that will close this issue
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants