Skip to content

Add decode_nv12 to allow convert nv12 to rgb #874

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 2 commits into from
Mar 31, 2020

Conversation

yongtang
Copy link
Member

This PR adds support of decode_nv12 decode_nv12 to allow convert nv12 to rgb.
This is useful for Video Capture and MP4 decoding on macOS, as macOS's
default pixel format is NV12 (hardware-accelerated)

This PR is part of #825 (linux needs YUYV which will be done in follow up PRs)

Signed-off-by: Yong Tang [email protected]

@yongtang yongtang force-pushed the nv12 branch 3 times, most recently from a398db6 to 3cd1292 Compare March 28, 2020 19:03
This PR adds support of decode_nv12 decode_nv12 to allow convert nv12 to rgb.
This is useful for Video Capture and MP4 decoding on macOS, as macOS's
default pixel format is NV12 (hardware-accelerated)

This PR fixes 825

Signed-off-by: Yong Tang <[email protected]>
This PR adds support of decode_yuy2 to allow convert yuy2 to rgb.
This is useful for Video Capture in Linux (Video4Linux2) as the default
format is YUYV.

This PR fixes tensorflow#825

Signed-off-by: Yong Tang <[email protected]>
@terrytangyuan terrytangyuan merged commit 3bcdb16 into tensorflow:master Mar 31, 2020
@bhack
Copy link

bhack commented Mar 31, 2020

Do we plan to use GPU operation like https://docs.nvidia.com/cuda/npp/group__nv12torgb.html#details?

@yongtang yongtang deleted the nv12 branch March 31, 2020 21:30
@yongtang
Copy link
Member Author

@bhack Yes it is definitely on the roadmap. In fact in last month's meeting we also discussed about the possible MLIR integration into tensorflow-io. Will need to do some exploration work first, though.

@bhack
Copy link

bhack commented Mar 31, 2020

@bhack Yes it is definitely on the roadmap. In fact in last month's meeting we also discussed about the possible MLIR integration into tensorflow-io. Will need to do some exploration work first, though.

Yes this is super interesting also for other image processing ops that are landing in Addons PRs. Can you share something more about this topic?

i-ony pushed a commit to i-ony/io that referenced this pull request Feb 8, 2021
* Add decode_nv12 to allow convert nv12 to rgb

This PR adds support of decode_nv12 decode_nv12 to allow convert nv12 to rgb.
This is useful for Video Capture and MP4 decoding on macOS, as macOS's
default pixel format is NV12 (hardware-accelerated)

This PR fixes 825

Signed-off-by: Yong Tang <[email protected]>

* Add decode_yuy2 (YUYV/YUY2/YUYV422) support

This PR adds support of decode_yuy2 to allow convert yuy2 to rgb.
This is useful for Video Capture in Linux (Video4Linux2) as the default
format is YUYV.

This PR fixes tensorflow#825

Signed-off-by: Yong Tang <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants