Skip to content

[WIP][Do not merge][video] CSN networks #1524

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 1 commit into from
Closed

[WIP][Do not merge][video] CSN networks #1524

wants to merge 1 commit into from

Conversation

bjuncek
Copy link
Contributor

@bjuncek bjuncek commented Oct 25, 2019

Initial implementation of the Channel Separated ConvNets as described in https://arxiv.org/abs/1904.02811, with belonging code and models.

Please do not merge this PR before 1 and 2 are not merged into their respective masters.

[1] Slightly changes the video model API - this has been tested with and without the changes there and it works, but for the sake of consistency, let's wait until they all look the same.
[2] There is no efficient implementation of the 3D depthwise convolution, and until there is, the FLOPs saved by using depth-wise channel-separated convolutions is meaningless given the inefficiencies in the kernel.


Discussion point:

Which pre-trained model do we want to provide with them kinetics as everywhere else, or a more suitable one such as Sports1M or URU?

@fmassa
Copy link
Member

fmassa commented Oct 28, 2019

@bjuncek

Which pre-trained model do we want to provide with them kinetics as everywhere else, or a more suitable one such as Sports1M or URU?

Let's keep using Kinetics-400, as that's what the other models use already, and it is also referenced in the CSN paper.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants