Skip to content

Conversation

jakebailey
Copy link
Member

Playing around for #54500

@typescript-bot typescript-bot added Author: Team For Uncommitted Bug PR for untriaged, rejected, closed or missing bug labels Jul 9, 2025
@jakebailey
Copy link
Member Author

@typescript-bot test it

@typescript-bot
Copy link
Collaborator

typescript-bot commented Jul 9, 2025

Starting jobs; this comment will be updated as builds start and complete.

Command Status Results
test top400 ✅ Started 👀 Results
user test this ✅ Started ✅ Results
run dt ✅ Started 👀 Results
perf test this faster ✅ Started 👀 Results

@jakebailey jakebailey changed the title Force inclusion of ES6, DOM.iterable Force inclusion of ES6, DOM.Iterable Jul 9, 2025
@typescript-bot
Copy link
Collaborator

Hey @jakebailey, the results of running the DT tests are ready.

There were interesting changes:

Changes are too big to display here, please check the log.

You can check the log here.

@typescript-bot
Copy link
Collaborator

@jakebailey Here are the results of running the user tests with tsc comparing main and refs/pull/62025/merge:

Everything looks good!

@typescript-bot
Copy link
Collaborator

@jakebailey
The results of the perf run you requested are in!

Here they are:

tsc

Comparison Report - baseline..pr
Metric baseline pr Delta Best Worst p-value
Compiler-Unions - node (v18.15.0, x64)
Errors 34 34 ~ ~ ~ p=1.000 n=6
Symbols 62,370 78,849 🔻+16,479 (+26.42%) ~ ~ p=0.001 n=6
Types 50,386 56,396 🔻+6,010 (+11.93%) ~ ~ p=0.001 n=6
Memory used 194,841k (± 1.01%) 206,173k (± 0.95%) 🔻+11,333k (+ 5.82%) 204,375k 207,997k p=0.005 n=6
Parse Time 1.31s (± 0.39%) 1.34s (± 0.38%) +0.04s (+ 2.81%) 1.34s 1.35s p=0.004 n=6
Bind Time 0.73s 0.74s (± 0.55%) +0.01s (+ 1.14%) 0.73s 0.74s p=0.007 n=6
Check Time 9.74s (± 0.38%) 10.29s (± 0.33%) 🔻+0.56s (+ 5.72%) 10.24s 10.34s p=0.005 n=6
Emit Time 2.73s (± 0.36%) 2.75s (± 1.10%) ~ 2.71s 2.79s p=0.462 n=6
Total Time 14.51s (± 0.24%) 15.12s (± 0.31%) 🔻+0.61s (+ 4.23%) 15.07s 15.20s p=0.005 n=6
angular-1 - node (v18.15.0, x64)
Errors 57 57 ~ ~ ~ p=1.000 n=6
Symbols 948,912 948,912 ~ ~ ~ p=1.000 n=6
Types 410,889 410,889 ~ ~ ~ p=1.000 n=6
Memory used 1,226,421k (± 0.00%) 1,226,408k (± 0.00%) ~ 1,226,342k 1,226,467k p=1.000 n=6
Parse Time 6.51s (± 0.91%) 6.51s (± 0.50%) ~ 6.46s 6.55s p=0.423 n=6
Bind Time 1.88s (± 0.29%) 1.88s ~ ~ ~ p=0.071 n=6
Check Time 32.04s (± 0.33%) 32.01s (± 0.24%) ~ 31.91s 32.10s p=0.936 n=6
Emit Time 14.88s (± 0.60%) 14.85s (± 0.71%) ~ 14.74s 15.05s p=0.688 n=6
Total Time 55.30s (± 0.35%) 55.25s (± 0.32%) ~ 55.04s 55.52s p=0.688 n=6
mui-docs - node (v18.15.0, x64)
Errors 0 0 ~ ~ ~ p=1.000 n=6
Symbols 2,510,641 2,510,641 ~ ~ ~ p=1.000 n=6
Types 892,802 892,802 ~ ~ ~ p=1.000 n=6
Memory used 2,805,600k (± 0.00%) 2,805,651k (± 0.00%) ~ 2,805,594k 2,805,683k p=0.065 n=6
Parse Time 8.70s (± 0.50%) 8.71s (± 0.21%) ~ 8.68s 8.73s p=0.567 n=6
Bind Time 2.24s (± 0.34%) 2.24s (± 0.71%) ~ 2.22s 2.26s p=0.801 n=6
Check Time 84.74s (± 0.24%) 84.86s (± 0.38%) ~ 84.32s 85.23s p=0.378 n=6
Emit Time 0.30s 0.30s (± 1.35%) ~ 0.30s 0.31s p=0.405 n=6
Total Time 95.99s (± 0.21%) 96.11s (± 0.32%) ~ 95.59s 96.42s p=0.296 n=6
self-build-src - node (v18.15.0, x64)
Errors 0 0 ~ ~ ~ p=1.000 n=6
Symbols 1,227,048 1,227,053 +5 (+ 0.00%) ~ ~ p=0.001 n=6
Types 267,470 267,471 +1 (+ 0.00%) ~ ~ p=0.001 n=6
Memory used 2,363,209k (± 0.02%) 2,484,866k (±11.99%) ~ 2,362,796k 3,093,893k p=0.689 n=6
Parse Time 5.25s (± 1.18%) 5.26s (± 1.68%) ~ 5.21s 5.44s p=1.000 n=6
Bind Time 1.78s (± 0.83%) 1.78s (± 0.59%) ~ 1.76s 1.79s p=0.413 n=6
Check Time 35.34s (± 0.20%) 35.41s (± 0.36%) ~ 35.20s 35.56s p=0.230 n=6
Emit Time 2.98s (± 1.42%) 3.01s (± 1.87%) ~ 2.96s 3.11s p=0.630 n=6
Total Time 45.36s (± 0.30%) 45.46s (± 0.43%) ~ 45.19s 45.79s p=0.199 n=6
self-build-src-public-api - node (v18.15.0, x64)
Errors 0 0 ~ ~ ~ p=1.000 n=6
Symbols 1,227,048 1,227,053 +5 (+ 0.00%) ~ ~ p=0.001 n=6
Types 267,470 267,471 +1 (+ 0.00%) ~ ~ p=0.001 n=6
Memory used 2,919,572k (±12.87%) 2,919,431k (±12.83%) ~ 2,433,605k 3,162,656k p=0.575 n=6
Parse Time 6.84s (± 1.56%) 6.87s (± 1.63%) ~ 6.72s 7.03s p=0.689 n=6
Bind Time 2.19s (± 0.82%) 2.20s (± 2.38%) ~ 2.12s 2.26s p=0.469 n=6
Check Time 42.98s (± 0.51%) 42.93s (± 0.63%) ~ 42.51s 43.22s p=0.936 n=6
Emit Time 3.52s (± 2.64%) 3.50s (± 2.67%) ~ 3.37s 3.61s p=0.810 n=6
Total Time 55.52s (± 0.69%) 55.49s (± 0.64%) ~ 54.98s 55.88s p=0.810 n=6
self-compiler - node (v18.15.0, x64)
Errors 0 0 ~ ~ ~ p=1.000 n=6
Symbols 262,548 262,553 +5 (+ 0.00%) ~ ~ p=0.001 n=6
Types 107,156 107,157 +1 (+ 0.00%) ~ ~ p=0.001 n=6
Memory used 441,930k (± 0.00%) 441,933k (± 0.02%) ~ 441,827k 442,059k p=0.873 n=6
Parse Time 3.52s (± 1.25%) 3.54s (± 1.32%) ~ 3.47s 3.59s p=0.374 n=6
Bind Time 1.32s (± 1.34%) 1.32s (± 1.00%) ~ 1.31s 1.34s p=0.546 n=6
Check Time 18.91s (± 0.43%) 18.96s (± 0.43%) ~ 18.87s 19.09s p=0.423 n=6
Emit Time 1.52s (± 0.77%) 1.54s (± 1.46%) ~ 1.52s 1.57s p=0.084 n=6
Total Time 25.27s (± 0.31%) 25.36s (± 0.40%) ~ 25.26s 25.52s p=0.108 n=6
ts-pre-modules - node (v18.15.0, x64)
Errors 71 71 ~ ~ ~ p=1.000 n=6
Symbols 225,367 225,367 ~ ~ ~ p=1.000 n=6
Types 94,290 94,290 ~ ~ ~ p=1.000 n=6
Memory used 371,165k (± 0.01%) 371,143k (± 0.02%) ~ 371,043k 371,208k p=0.575 n=6
Parse Time 3.59s (± 1.04%) 3.60s (± 2.05%) ~ 3.47s 3.66s p=0.520 n=6
Bind Time 1.99s (± 1.00%) 1.97s (± 0.53%) -0.03s (- 1.26%) 1.95s 1.98s p=0.035 n=6
Check Time 20.43s (± 0.23%) 20.43s (± 0.41%) ~ 20.34s 20.56s p=0.687 n=6
Emit Time 0.00s (±244.70%) 0.00s ~ ~ ~ p=0.405 n=6
Total Time 26.02s (± 0.17%) 26.00s (± 0.45%) ~ 25.88s 26.16s p=0.574 n=6
vscode - node (v18.15.0, x64)
Errors 1 1 ~ ~ ~ p=1.000 n=6
Symbols 3,500,100 3,500,100 ~ ~ ~ p=1.000 n=6
Types 1,179,991 1,179,991 ~ ~ ~ p=1.000 n=6
Memory used 3,546,365k (± 0.01%) 3,546,206k (± 0.00%) ~ 3,545,985k 3,546,386k p=0.471 n=6
Parse Time 15.02s (± 0.75%) 15.00s (± 0.79%) ~ 14.86s 15.17s p=0.748 n=6
Bind Time 5.01s (± 2.43%) 5.00s (± 2.55%) ~ 4.86s 5.15s p=0.936 n=6
Check Time 99.62s (± 1.77%) 99.10s (± 1.36%) ~ 98.11s 101.68s p=0.810 n=6
Emit Time 30.16s (± 0.54%) 30.16s (± 1.86%) ~ 29.03s 30.48s p=0.173 n=6
Total Time 149.80s (± 1.25%) 149.25s (± 1.04%) ~ 147.42s 152.06s p=0.689 n=6
webpack - node (v18.15.0, x64)
Errors 2 2 ~ ~ ~ p=1.000 n=6
Symbols 318,567 319,853 +1,286 (+ 0.40%) ~ ~ p=0.001 n=6
Types 137,774 138,310 +536 (+ 0.39%) ~ ~ p=0.001 n=6
Memory used 474,039k (± 0.03%) 475,700k (± 0.03%) +1,661k (+ 0.35%) 475,498k 475,821k p=0.005 n=6
Parse Time 4.28s (± 0.50%) 4.31s (± 0.96%) ~ 4.25s 4.37s p=0.198 n=6
Bind Time 1.78s (± 1.27%) 1.79s (± 0.96%) ~ 1.76s 1.81s p=0.365 n=6
Check Time 20.59s (± 0.43%) 20.82s (± 0.43%) +0.23s (+ 1.14%) 20.71s 20.92s p=0.010 n=6
Emit Time 0.00s 0.00s ~ ~ ~ p=1.000 n=6
Total Time 26.65s (± 0.40%) 26.92s (± 0.31%) +0.27s (+ 1.03%) 26.79s 27.01s p=0.008 n=6
xstate-main - node (v18.15.0, x64)
Errors 30 30 ~ ~ ~ p=1.000 n=6
Symbols 666,092 666,742 +650 (+ 0.10%) ~ ~ p=0.001 n=6
Types 199,363 199,365 +2 (+ 0.00%) ~ ~ p=0.001 n=6
Memory used 571,550k (± 0.02%) 572,331k (± 0.02%) +781k (+ 0.14%) 572,223k 572,527k p=0.005 n=6
Parse Time 4.26s (± 0.46%) 4.26s (± 0.45%) ~ 4.24s 4.29s p=1.000 n=6
Bind Time 1.32s (± 1.11%) 1.34s (± 1.05%) ~ 1.32s 1.36s p=0.073 n=6
Check Time 20.09s (± 1.56%) 20.43s (± 1.85%) ~ 19.91s 20.71s p=0.335 n=6
Emit Time 0.00s 0.00s ~ ~ ~ p=1.000 n=6
Total Time 25.67s (± 1.25%) 26.03s (± 1.50%) ~ 25.52s 26.35s p=0.173 n=6
System info unknown
Hosts
  • node (v18.15.0, x64)
Scenarios
  • Compiler-Unions - node (v18.15.0, x64)
  • angular-1 - node (v18.15.0, x64)
  • mui-docs - node (v18.15.0, x64)
  • self-build-src - node (v18.15.0, x64)
  • self-build-src-public-api - node (v18.15.0, x64)
  • self-compiler - node (v18.15.0, x64)
  • ts-pre-modules - node (v18.15.0, x64)
  • vscode - node (v18.15.0, x64)
  • webpack - node (v18.15.0, x64)
  • xstate-main - node (v18.15.0, x64)
Benchmark Name Iterations
Current pr 6
Baseline baseline 6

Developer Information:

Download Benchmarks

@typescript-bot
Copy link
Collaborator

@jakebailey Here are the results of running the top 400 repos with tsc comparing main and refs/pull/62025/merge:

Something interesting changed - please have a look.

Details

BuilderIO/mitosis

17 of 25 projects failed to build with the old tsc and were ignored

packages/core/tsconfig.build.json

react-bootstrap/react-bootstrap

1 of 3 projects failed to build with the old tsc and were ignored

tsconfig.json

test/tsconfig.json

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Author: Team For Uncommitted Bug PR for untriaged, rejected, closed or missing bug
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants