interpolate/sample array at point #191
Comments
|
Hi Richard, Your question is actually very timely. We don't have any routines yet to do interpolation, although one of my colleagues (not sure if he's on GitHub) was looking into 1-dimensional interpolation last week. A contribution to add interpolation to xray would certainly be very welcome! I would not recommend wrapping the pandas routines -- they just use their own wrapper over scipy and only interpolate in 1D. They also have somewhat unusual API -- they support interpolation only to fill in missing values (marked with Scipy has a wide variety of interpolation options, most of which I have not used. I'm guessing you're most immediately interested in doing something with map_coordinates? What were you thinking for the function signature? As for where to put it, we have two options:
|
|
Stephan, I think that I could contribute some functions to do 'nearest' and linear interpolation in n-dimensions; these should be able to take advantage of the indexing afforded by As far as I can tell, higher-order interpolation (spline, etc.) requires fitting functions to the entirety of the dataset, which is pretty slow/ram-intensive with large datasets, and many of the fuctions require the data to be on a regular grid (I am not sure what the For the function signature, I was thinking about something simple, like:
This could return a Series or DataFrame. But thinking about this a little more, there are kind of two sides to interpolation: What I think of as 'sampling', where we pull values at points from within a grid or structured array (like in |
|
So I would definitely still wrap the scipy functions for any interpolation routines for xray. It's not worth rewriting any of them twice! Scipy is an optional dependency for xray, but it would be fine to require it for the interpolation routines. Yes, there do seems to be a few different interpolation routines in scipy. Naming the function you're thinking of something like In xray, we have DataArray objects (corresponding to a particular variable in a netCDF file along with its coordinates) as well as Datasets (corresponding to entire netCDFs). I think it makes a bit more sense to interpolate individual variables, so I guess you would want this function to have a signature something like the following: You don't need to necessarily handle all the edge cases of possible input to The DataArray constructor isn't in the currently released version of xray but it will be a major feature of the next release (hopefully to be released in a week or two) and it might be worth using here. It should be clearly documented in the docstring of |
|
Actually, I'm thinking now that we could probably (theoretically) fit all interpolation strategies into a single That said... perhaps its better to stick with a simpler function for now and we can figure out the bigger picture later. Looking at all the scipy functions, there are a lot of hypothetical options and I'm not sure which we'd want to keep in the final method. Also, kitchen sink type functions (e.g., |
|
For what its worth, I wrote this today. Its a long way from being useful but I find it's working well enough to fill gaps in data after a reindex() from scipy import interpolate, ndimage
def linterp(data, index, interp_index, order=1):
"""
Parameters
----------
data: nd-array (cube).
index: index (floats) associated with the cube.
interp_index: float interpolation poing.
Returns
-------
interpolated: nd-array
An interpolated field.
"""
# Form a cube of the values, which we will imagine is our function f()
cube = np.array(data, dtype=np.float)
# Form a relationship, and this can be non-linear, between slice indexes and
# the "index".
m = interpolate.interp1d(index, range(len(index)))
# Form a set of coordinates to sample over - x
y, x = np.mgrid[0:data[0].shape[0], 0:data[0].shape[1]]
z = np.ones_like(y) * m(interp_index)
# Perform the sampling f(x), map coordinates is performing a linear
# interpolation of the coordinates in the cube.
return ndimage.map_coordinates(
cube,
[z, y, x],
order=order,
cval=np.nan) |
|
+1 |
|
Hi All, This is indeed an excellent project with great potential! I am wondering if there is any progress on the interpolation issue. I am working with an irregular time series which I would pretty much like to upsample using xray. Thanks for all the effort! Saulo |
|
@saulomeirelles I don't have any progress to share on this issue. If this issue is important to you, contributions would be gratefully accepted! |
|
I've written a wrapper around scipy's It's not exactly fully-featured but scratches the itch I had, which is to pass DataArrays through map_coordinates with support for xarray's coordinates. @shoyer If this seems of use, I could add some tests and perhaps an example, then submit a pull request? |
|
Yes, this like looks useful to me! On Fri, Apr 1, 2016 at 7:32 AM, Stefan Pfenninger [email protected]
|
|
Ok, I'll extend this into a pull request one of these days |
|
I have a dataset that looks like the following: I am trying to do a linear interpolation for each day where the temp is nan. Is there a straightforward way to do this in Xarray? |
|
@fujiisoup could we close this given your recent work |
|
closed via #2104 |
This looks like an excellent project, thanks for all the work.
I am wondering if there is functionality for interpolation or sampling of a Dataset at a point (or sequence of points). The SciPy way of doing this uses scipy.ndimage.map_coordinates and is completely backwards for (geo)spatial data, requiring the point's coordinates to be converted to 'array' coordinates before interpolation.
Does this already have an implementation, given how super common an operation it is? If not, would it be difficult to wrap pandas.Series.interpolate() up? I might write a function to do this, but I don't known the xray internals well enough to know where to stick it.
Thanks,
Richard
The text was updated successfully, but these errors were encountered: