AttributeError: module 'enum' has no attribute 'IntFlag'

[Casyfill]

python 3.6, dvc 0.40.1

on almost any command throws issue (warning?):

Failed to import the site module
Traceback (most recent call last):
  File "/Users/philippk/anaconda3/envs/py36/lib/python3.6/site.py", line 541, in <module>
    main()
  File "/Users/philippk/anaconda3/envs/py36/lib/python3.6/site.py", line 522, in main
    known_paths = addusersitepackages(known_paths)
  File "/Users/philippk/anaconda3/envs/py36/lib/python3.6/site.py", line 282, in addusersitepackages
    user_site = getusersitepackages()
  File "/Users/philippk/anaconda3/envs/py36/lib/python3.6/site.py", line 258, in getusersitepackages
    user_base = getuserbase() # this will also set USER_BASE
  File "/Users/philippk/anaconda3/envs/py36/lib/python3.6/site.py", line 248, in getuserbase
    USER_BASE = get_config_var('userbase')
  File "/Users/philippk/anaconda3/envs/py36/lib/python3.6/sysconfig.py", line 608, in get_config_var
    return get_config_vars().get(name)
  File "/Users/philippk/anaconda3/envs/py36/lib/python3.6/sysconfig.py", line 587, in get_config_vars
    import _osx_support
  File "/Users/philippk/anaconda3/envs/py36/lib/python3.6/_osx_support.py", line 4, in <module>
    import re
  File "/Users/philippk/anaconda3/envs/py36/lib/python3.6/re.py", line 142, in <module>
    class RegexFlag(enum.IntFlag):
AttributeError: module 'enum' has no attribute 'IntFlag'

[efiop]

Hi @Casyfill !

Do you have enum34 installed by any chance? You can check that with pip freeze | grep enum34. If you do, please remove it, it is known to cause issues in many packages.

[Casyfill]

got it! hm, now I wonder which package requires it as a dependency (given that everything worked fine 3 days ago)

[shcheklein]

@efiop is there a workaround on the DVC side we can implement so that we do not depend on the environment in this case?

[efiop]

@shcheklein As you can see from the traceback, it is not about us per se 🙂 As far as I know, the issue is caused by some old enum34 installed, which breaks the environment basically for everything that is using newer features. @Casyfill Maybe you have enum34 version in your console from the time you've run pip freeze so we could confirm my theory? What we could do is require some newer enum34 version in our setup.py, but, as you know, it won't prevent next installed package from installing old enum34 as a dependency 🙁 We might consider checking it at runtime too, though, but as you can see from the traceback, dvc is not even running yet, so that wouldn't be that useful.

[Casyfill]

I don't have pip freeze per se, but I was able to reproduce it having the conda env below.
Given that it just started to happen, I blame the last lib I installed - halo, but didn't have a chance so far to check if I am correct

name: py37
channels:
  - anaconda
  - conda-forge
dependencies:
  - anaconda:python=3.7.3
  - anaconda:black
  - anaconda:scikit-learn>=0.21.1
  - anaconda:ipython
  - anaconda:jupyter>=1.0.0
  - anaconda:jupyterlab>=0.35.6
  - anaconda:pandas
  - anaconda:pip
  - anaconda:pytest==4.4.0
  - anaconda:pytest-cov
  - anaconda:pytest-pep8
  - anaconda:pytest-benchmark>=3.2.2
  - pymssql
  - pymysql
  - pyyaml
  - conda-forge:fiona>=1.8.6
  - conda-forge:geopandas>=0.5.0
  - conda-forge:s3fs
  - conda-forge:jsonschema=2.6.0
  - conda-forge:luigi
  - conda-forge:sendgrid=5.6.0
  - conda-forge:tqdm
  - conda-forge:xlsxwriter
  - conda-forge:hypothesis  
  - pip:
    - halo
    - envkey
    - dvc
    - snowflake-sqlalchemy
prefix: /Users/philippk/anaconda3/envs/py37

[daskol]

I have the issue as well. Uninstallation of enum34 solved the issue. I am working in virtual environemnt with Python3.7. In my case the dependent is catboost.

$ pip show enum34   
Name: enum34
Version: 1.1.6
Summary: Python 3.4 Enum backported to 3.3, 3.2, 3.1, 2.7, 2.6, 2.5, and 2.4
Home-page: https://bitbucket.org/stoneleaf/enum34
Author: Ethan Furman
Author-email: ethan@stoneleaf.us
License: BSD License
Location: .../.env/lib/python3.7/site-packages
Requires: 
Required-by: catboost

[efiop]

Hi @daskol !

Thanks for reporting this! Looks like catboost shouldn't install enum34 in newer python versions: https://github.com/catboost/catboost/blob/6550fd5ef349acd08d021f8210e322201b169951/catboost/python-package/setup.py#L30 . It should probably be handled similar to how these guys have fixed it donnemartin/saws@f109bc8 . We've looked for some kind of preemptive solution on our side, but looks like it should indeed be handled by projects that are actually using enum34.

[SirPolaris]

Life savers. Thanks.
Was installing a GTFS parser and old tech was being hung up on something I don't even remember installing.

[sunbc0120]

pip uninstall -y enum34

[TheusBoot]

what