-
Notifications
You must be signed in to change notification settings - Fork 1.9k
DataFrame - add support for vbuffer #5872
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Comments
To give an example. For the following dataset
Using the following IDataView schema type ModelInput = {
[<LoadColumn(0,3)>] Features: float32 array
[<LoadColumn(4)>] Label: string
} Throws the following error when System.NotSupportedException: VBuffer`1 is not a supported column type. |
@ericstj @eerhardt @michaelgsharp |
This is going to need some further investigation to see what it would take. Its in our roadmap but we will be taking a look at it after we get TorchSharp resolved. |
@eerhardt have you thought of this before or are you aware of any discussion with Prasanth about it? If we have an idea of how it would work we could write that up here in case someone else might be interested in helping fix this. |
I really haven't given it deep thought. I know it is a problem, but I'm not sure how exactly to structure a That's about as far as I've gone thinking of this. See also #5721 |
@michaelgsharp or @JakeRadMSFT -- Was this completed with #6409, or is there more to do here still? |
It seems that dataframe API still doesn't support vbuffer, in which case if there's vbuffer type in
IDataView
,ToDataFrame()
will fail.The text was updated successfully, but these errors were encountered: