The goal is to review cudnn implementation of ops and implement miopen version if applicable - affine_channel - sigmoid/tanh - transpose - dropout - **depthwise_3x3_conv**