Skip to content

Python and package upgrades #840

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 74 commits into from
Feb 11, 2025
Merged

Python and package upgrades #840

merged 74 commits into from
Feb 11, 2025

Conversation

priyakasimbeg
Copy link
Contributor

@priyakasimbeg priyakasimbeg commented Feb 10, 2025 •
edited
Loading

Most notably:
Python >= 3.8 -> Python >= 3.11
JAX 0.4.10 -> JAX 0.4.28
PyTorch 2.1.0 -> PyTorch 2.5.1

init-22 and others added 30 commits November 14, 2024 23:31
@init-22
feat: package updates with python311
ce99901
@init-22
fix: absl package version change
21fb3f9
@init-22
fix: pytorch version change
67b9f15
@init-22
fix: tf version to use numpy < 2
78df36f
@init-22
fix: librispeech requirement of tf-text rolled back to v2.17
2584416
@init-22
fix: using the main repo and branch for testing
d603ce9
@init-22
fix: overflow error resolved and PRNGKey to key
be68f8c
@init-22
fix: minor changes in docs
e890c89
@init-22
fix: changing the python versions in workflow to pass the tests
1bc2a7b
@init-22
fix: changing numpy compatible version
7a0fee3
@init-22
adding key_data to check the CI tests
7cdea16
@init-22
fix: updated packge of sacrebleu changed the way it used to work, hen…
7264c3f 
…ce using the corpus_bleu from the main package
@init-22
fix: temporarily commenting tfa
abbdc82
@init-22
fix: explicitly using mask kwarg to use MultiHeadDotProductAttention …
86029a7 
…and also using sacrebleu
@init-22
fix: using flax.core.pop instead of variables.pop, better way to upda…
aca45a2 
…te batch_stats
@init-22
fix: changing the traindiffs_tests branch to main again
2618c5e
@init-22
fix: unfreeze() in test_param_shapes expect FrozenDict also added fla…
8c90625 
…x.core.pop instead of variables.pop
@init-22
fix: formatting changes with yapf
1b587b7
@init-22
fix: running yapf again with 0.32, earlier using 0.43
c65d93e
@init-22
fix: running yapf again with 0.32, earlier using 0.43
3afd1df
@init-22
fix: latest versions of typing dont support Text instead str is recom…
6ff2010 
…mended
@init-22
fix: minor yapf
55bacbd
@priyakasimbeg
Merge branch 'python_upgrades' into python311
cfd5a00
@init-22
fix: going back to sacrebleu v1.3.1
5eac985
@init-22
feat: custom tf_addons support in TF2.18
7867711
@init-22
fix: resolving pylint issues in custom_tf_addons
d6dd2e8
@init-22
resolved pyline and changed the pylint version to current version of …
a0b587a 
…main
@init-22
fix: removing tensorflow addons from setup cfg
9393145
@init-22
fix: adding absolute paths for custom_tf_addons in randaugment
53eff1d
@priyakasimbeg
Merge pull request #811 from init-22/python311
9d1c957 
Moving from Python3.8 to Python 3.11
priyakasimbeg and others added 19 commits January 22, 2025 21:43
@priyakasimbeg
revert to use PRNGKey
5715618
@priyakasimbeg
Merge remote-tracking branch 'refs/remotes/origin/python_upgrades' in…
d57dec3 
…to python_upgrades
@priyakasimbeg
revert changes to submission runner for prng key
3fb722d
@priyakasimbeg
remove extracting key_data
9b7cee4
@priyakasimbeg
cast np.int32 as int for random.Random arg
5775ed1
@init-22
fix: vim installation
1352e70
@priyakasimbeg
use inductor backend to compile deepspeech instead of eager
d7eebf8
@init-22
adding mem_fraction 0.80 for jax workfloads to resolve OOM of certain…
58159c5 
… worklods
@init-22
mem fraction typo
81bc93d
@init-22
env variable for conformer set at the top
f6ca2bc
@priyakasimbeg
set env variables for pytorch before initializing w ddp.
b4ed6cc
@priyakasimbeg
set jax to 0.4.26
ebf0341
@priyakasimbeg
set jax versions
1ce6dea
@priyakasimbeg
switch to pyproject toml
2a0f1c9
@priyakasimbeg
fix pytorch version
082be03
@priyakasimbeg
fix jax versions
39bb876
@init-22
fix: adding wandb under 'full' section
b45a69b
@init-22
fix: wandb version upgrade
b719a6e
@priyakasimbeg
remove wandb from full
1ce3e62
@priyakasimbeg priyakasimbeg requested a review from a team as a code owner February 10, 2025 22:23
@github-actions GitHub Actions
Copy link

github-actions bot commented Feb 10, 2025 •
edited
Loading

MLCommons CLA bot All contributors have signed the MLCommons CLA ✍️ ✅

@priyakasimbeg priyakasimbeg changed the title Python upgrades Python and package upgrades Feb 11, 2025
@priyakasimbeg priyakasimbeg merged commit 4345e8b into dev Feb 11, 2025
31 of 32 checks passed
@github-actions github-actions bot locked and limited conversation to collaborators Feb 11, 2025
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@priyakasimbeg @init-22