Description
Currently when you try to install sasl on Python 3.11, the compilation fails with:
#56 513.0 × Running setup.py install for sasl did not run successfully.
#56 513.0 │ exit code: 1
#56 513.0 ╰─> [31 lines of output]
#56 513.0 running install
#56 513.0 /usr/local/lib/python3.11/site-packages/setuptools/command/install.py:34: SetuptoolsDeprecationWarning: setup.py install is deprecated. Use build and pip and other standards-based tools.
#56 513.0 warnings.warn(
#56 513.0 running build
#56 513.0 running build_py
#56 513.0 creating build
#56 513.0 creating build/lib.linux-x86_64-cpython-311
#56 513.0 creating build/lib.linux-x86_64-cpython-311/sasl
#56 513.0 copying sasl/__init__.py -> build/lib.linux-x86_64-cpython-311/sasl
#56 513.0 running egg_info
#56 513.0 writing sasl.egg-info/PKG-INFO
#56 513.0 writing dependency_links to sasl.egg-info/dependency_links.txt
#56 513.0 writing requirements to sasl.egg-info/requires.txt
#56 513.0 writing top-level names to sasl.egg-info/top_level.txt
#56 513.0 reading manifest file 'sasl.egg-info/SOURCES.txt'
#56 513.0 reading manifest template 'MANIFEST.in'
#56 513.0 adding license file 'LICENSE.txt'
#56 513.0 writing manifest file 'sasl.egg-info/SOURCES.txt'
#56 513.0 copying sasl/saslwrapper.cpp -> build/lib.linux-x86_64-cpython-311/sasl
#56 513.0 copying sasl/saslwrapper.h -> build/lib.linux-x86_64-cpython-311/sasl
#56 513.0 copying sasl/saslwrapper.pyx -> build/lib.linux-x86_64-cpython-311/sasl
#56 513.0 running build_ext
#56 513.0 building 'sasl.saslwrapper' extension
#56 513.0 creating build/temp.linux-x86_64-cpython-311
#56 513.0 creating build/temp.linux-x86_64-cpython-311/sasl
#56 513.0 gcc -pthread -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -fPIC -Isasl -I/usr/local/include/python3.11 -c sasl/saslwrapper.cpp -o build/temp.linux-x86_64-cpython-311/sasl/saslwrapper.o
#56 513.0 sasl/saslwrapper.cpp:196:12: fatal error: longintrepr.h: No such file or directory
#56 513.0 196 | #include "longintrepr.h"
#56 513.0 | ^~~~~~~~~~~~~~~
#56 513.0 compilation terminated.
#56 513.0 error: command '/usr/bin/gcc' failed with exit code 1
#56 513.0 [end of output]
#56 513.0
I know it is eaarly (Python 3.11 has just been released yesterday) but we are hoping in Apache Airflow to a much faster cycle of adding new Python releases - especially that Pyhon 3.11 introduces huge performance improvements (25% is the average number claimed) due to a very focused effort to increase single-threaded Python performance (Specialized interpreter being the core of it but also many other improvements) without actually changing any of the Python code.
I'd appreciate if someone in the cloudera team attempted to fix it. Otherwise we might want to simply skip hive provider from Python 3.11 compatible version of Airflow.
I just opened a PR in Apache Airflow yesterday and plan to keep it open until it gets green :). So far I have to exclude hive provider.
I think it would be fantastic if we could as the open source community migrate to the new Python much faster.
Looking forward to cooperation on that one :)