Skip to content

Conversation

dependabot[bot]
Copy link
Contributor

@dependabot dependabot bot commented on behalf of github Aug 7, 2025

Bumps torchmetrics from 1.6.0 to 1.8.1.

Release notes

Sourced from torchmetrics's releases.

Minor patch release

[1.8.1] - 2025-08-07

Changed

  • Added reduction='none' to vif metric (#3196)
  • Float input support for segmentation metrics (#3198)

Fixed

  • Fixed unintended sigmoid normalization in BinaryPrecisionRecallCurve (#3182)

Key Contributors

@​iamkulbhushansingh, @​PussyCat0700, @​simonreise

If we forgot someone due to not matching commit email with GitHub account, let us know :]


Full Changelog: Lightning-AI/torchmetrics@v1.8.0...v1.8.1

First video and vertex metrics

The upcoming TorchMetrics v1.8.0 release introduces three flagship metrics, each designed to address critical evaluation needs in real-world applications.

Video Multi-Method Assessment Fusion (VMAF) brings a perceptual video-quality score that closely mirrors human judgment, powering streaming services such as Netflix and YouTube to optimize encoding ladders for consistent viewer experiences and enabling video-restoration labs to quantify improvements achieved by denoising and super-resolution algorithms.

Continuous Ranked Probability Score (CRPS) enables comprehensive evaluation of full predictive distributions rather than point estimates; meteorological centers leverage CRPS to benchmark probabilistic precipitation and temperature forecasts, improving public weather alerts, while energy companies apply it to assess uncertainty in load-demand predictions and refine grid management and trading strategies.

Lip Vertex Error (LVE) measures the discrepancy between predicted and ground-truth lip landmarks to quantify audio-visual synchronization. Localization studios use LVE to validate lip-sync accuracy during film dubbing, while AR/VR developers integrate it into avatar pipelines to ensure natural mouth movements in real-time virtual meetings and social experiences.


[1.8.0] - 2025-07-23

Added

  • Added VMAF metric to new video domain (#2991)
  • Added CRPS in regression domain (#3024)
  • Added aggregation_level argument to DiceScore (#3018)
  • Added support for reduction="none" to LearnedPerceptualImagePatchSimilarity (#3053)
  • Added support single str input for functional interface of bert_score (#3056)
  • Enhance: BERTScore to evaluate hypotheses against multiple references (#3069)
  • Added Lip Vertex Error (LVE) in multimodal domain (#3090)
  • Added antialias argument to FID metric (#3177)
  • Added mixed input format to segmentation metrics (#3176)

... (truncated)

Changelog

Sourced from torchmetrics's changelog.

[1.8.1] - 2025-08-07

Changed

  • Added reduction='none' to vif metric (#3196)
  • Float input support for segmentation metrics (#3198)

Fixed

  • Fixed unintended sigmoid normalization in BinaryPrecisionRecallCurve (#3182)

[1.8.0] - 2025-07-23

Added

  • Added VMAF metric to new video domain (#2991)
  • Added CRPS in regression domain (#3024)
  • Added aggregation_level argument to DiceScore (#3018)
  • Added support for reduction="none" to LearnedPerceptualImagePatchSimilarity (#3053)
  • Added support single str input for functional interface of bert_score (#3056)
  • Enhance: BERTScore to evaluate hypotheses against multiple references (#3069)
  • Added Lip Vertex Error (LVE) in multimodal domain (#3090)
  • Added antialias argument to FID metric (#3177)
  • Added mixed input format to segmentation metrics (#3176)

Changed

  • Changed data_range argument in PSNR metric to be a required argument (#3178)

Removed

  • Removed zero_division argument from DiceScore (#3018)

[1.7.4] - 2025-07-03

Changed

  • Improved numerical stability of pearson's correlation coefficient (#3152)

Fixed

  • Fixed: Ignore zero and negative predictions in retrieval metrics (#3160)
  • Fixed SSIM dist_reduce_fx when reduction=None for distributed training ( #3162, #3166)
  • Fixed attribute error (#3154)
  • Fixed incorrect shape in _pearson_corrcoef_update (#3168)

... (truncated)

Commits
  • e537986 releasing 1.8.1
  • 94e72ff docs: skip link to MultiScaleSSIM
  • 0b41c0e bump: Torch* dependencies to 2.8 and its equivalents (#3214)
  • d7ecad1 docs: fix link to "Error relative global dimensionless synthesis"
  • ace9941 Float input support for segmentation metrics (#3198)
  • b6c0166 enhance: add reduction='none' to vif metric (#3196)
  • ee2c9c2 Remove sigmoid in BinaryPrecisionRecallCurve (#3182)
  • 9283e3f extend docker building for py3.12 (#3151)
  • 8f4c990 docker: build image for latest Torch==2.8 (#3212)
  • 2ba502e docs: fix link to DistributedDataParallel.join
  • Additional commits viewable in compare view

Dependabot compatibility score

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

  • @dependabot rebase will rebase this PR
  • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
  • @dependabot merge will merge this PR after your CI passes on it
  • @dependabot squash and merge will squash and merge this PR after your CI passes on it
  • @dependabot cancel merge will cancel a previously requested merge and block automerging
  • @dependabot reopen will reopen this PR if it is closed
  • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
  • @dependabot show <dependency name> ignore conditions will show all of the ignore conditions of the specified dependency
  • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
  • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
  • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

Bumps [torchmetrics](https://github.com/Lightning-AI/torchmetrics) from 1.6.0 to 1.8.1.
- [Release notes](https://github.com/Lightning-AI/torchmetrics/releases)
- [Changelog](https://github.com/Lightning-AI/torchmetrics/blob/v1.8.1/CHANGELOG.md)
- [Commits](Lightning-AI/torchmetrics@v1.6.0...v1.8.1)

---
updated-dependencies:
- dependency-name: torchmetrics
  dependency-version: 1.8.1
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>
@dependabot dependabot bot added dependabot test-guided-notebooks Run PR check to verify Guided notebooks labels Aug 7, 2025
@openshift-ci openshift-ci bot requested a review from laurafitzgerald August 7, 2025 22:29
@codeflare-machine-account codeflare-machine-account added lgtm Indicates that a PR is ready to be merged. approved Indicates a PR has been approved by an approver from all required OWNERS files. labels Aug 7, 2025
Copy link
Contributor

openshift-ci bot commented Aug 7, 2025

[APPROVALNOTIFIER] This PR is APPROVED

Approval requirements bypassed by manually added approval.

This pull-request has been approved by:

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by an approver from all required OWNERS files. dependabot lgtm Indicates that a PR is ready to be merged. test-guided-notebooks Run PR check to verify Guided notebooks
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant