See https://github.com/pandas-dev/pandas/pull/16951#issuecomment-320971946. Opening this issue to not loose track of this