Skip to content

Set impliedNodeFormat in every module mode #57570

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 18 commits into from

Conversation

andrewbranch
Copy link
Member

This is a starting point for substantive changes, only up in this state to test perf and breaking changes.

@typescript-bot typescript-bot added Author: Team For Uncommitted Bug PR for untriaged, rejected, closed or missing bug labels Feb 28, 2024
@andrewbranch
Copy link
Member Author

@typescript-bot perf test
@typescript-bot test top200

@typescript-bot
Copy link
Collaborator

typescript-bot commented Feb 28, 2024

Heya @andrewbranch, I've started to run the diff-based top-repos suite on this PR at 74fc5a5. You can monitor the build here.

Update: The results are in!

@typescript-bot
Copy link
Collaborator

typescript-bot commented Feb 28, 2024

Heya @andrewbranch, I've started to run the regular perf test suite on this PR at 74fc5a5. You can monitor the build here.

Update: The results are in!

@typescript-bot
Copy link
Collaborator

@andrewbranch
The results of the perf run you requested are in!

Here they are:

tsc

Comparison Report - baseline..pr
Metric baseline pr Delta Best Worst p-value
Angular - node (v18.15.0, x64)
Memory used 295,646k (± 0.01%) 296,605k (± 0.00%) +959k (+ 0.32%) 296,591k 296,626k p=0.005 n=6
Parse Time 2.66s (± 0.28%) 2.68s (± 0.61%) +0.02s (+ 0.81%) 2.67s 2.71s p=0.015 n=6
Bind Time 0.83s (± 0.66%) 0.83s (± 0.62%) +0.01s (+ 1.01%) 0.83s 0.84s p=0.038 n=6
Check Time 8.23s (± 0.33%) 8.26s (± 0.25%) ~ 8.24s 8.29s p=0.060 n=6
Emit Time 7.11s (± 0.26%) 7.12s (± 0.33%) ~ 7.09s 7.15s p=0.622 n=6
Total Time 18.82s (± 0.18%) 18.90s (± 0.21%) +0.07s (+ 0.40%) 18.86s 18.95s p=0.008 n=6
Compiler-Unions - node (v18.15.0, x64)
Memory used 195,432k (± 1.54%) 192,587k (± 1.23%) ~ 191,607k 197,414k p=0.689 n=6
Parse Time 1.36s (± 1.14%) 1.37s (± 1.49%) ~ 1.34s 1.40s p=0.366 n=6
Bind Time 0.72s (± 0.00%) 0.72s (± 0.00%) ~ 0.72s 0.72s p=1.000 n=6
Check Time 9.35s (± 0.09%) 9.34s (± 0.22%) ~ 9.31s 9.37s p=0.797 n=6
Emit Time 2.62s (± 0.75%) 2.63s (± 0.52%) ~ 2.60s 2.64s p=0.357 n=6
Total Time 14.04s (± 0.31%) 14.06s (± 0.18%) ~ 14.04s 14.11s p=0.089 n=6
Monaco - node (v18.15.0, x64)
Memory used 347,425k (± 0.01%) 348,494k (± 0.00%) +1,069k (+ 0.31%) 348,479k 348,516k p=0.005 n=6
Parse Time 2.48s (± 0.59%) 2.54s (± 0.25%) +0.06s (+ 2.49%) 2.53s 2.55s p=0.004 n=6
Bind Time 0.92s (± 0.59%) 0.93s (± 0.00%) ~ 0.93s 0.93s p=0.071 n=6
Check Time 6.94s (± 0.40%) 6.98s (± 0.36%) +0.04s (+ 0.53%) 6.94s 7.01s p=0.044 n=6
Emit Time 4.06s (± 0.24%) 4.07s (± 0.22%) ~ 4.06s 4.08s p=0.142 n=6
Total Time 14.41s (± 0.17%) 14.52s (± 0.18%) +0.11s (+ 0.76%) 14.48s 14.54s p=0.005 n=6
TFS - node (v18.15.0, x64)
Memory used 302,859k (± 0.01%) 303,113k (± 0.00%) +254k (+ 0.08%) 303,099k 303,137k p=0.005 n=6
Parse Time 2.02s (± 0.68%) 2.03s (± 0.41%) +0.02s (+ 0.91%) 2.03s 2.05s p=0.033 n=6
Bind Time 1.00s (± 1.22%) 1.00s (± 0.41%) ~ 0.99s 1.00s p=0.389 n=6
Check Time 6.36s (± 0.40%) 6.35s (± 0.26%) ~ 6.33s 6.38s p=0.683 n=6
Emit Time 3.60s (± 0.29%) 3.60s (± 0.52%) ~ 3.58s 3.62s p=0.802 n=6
Total Time 12.98s (± 0.27%) 12.98s (± 0.23%) ~ 12.94s 13.02s p=0.685 n=6
material-ui - node (v18.15.0, x64)
Memory used 511,250k (± 0.00%) 512,333k (± 0.01%) +1,082k (+ 0.21%) 512,275k 512,370k p=0.005 n=6
Parse Time 2.66s (± 0.52%) 2.70s (± 0.45%) +0.04s (+ 1.57%) 2.68s 2.71s p=0.005 n=6
Bind Time 1.00s (± 1.05%) 0.99s (± 1.22%) ~ 0.98s 1.01s p=0.868 n=6
Check Time 17.28s (± 0.39%) 17.29s (± 0.67%) ~ 17.16s 17.47s p=0.936 n=6
Emit Time 0.00s (± 0.00%) 0.00s (± 0.00%) ~ 0.00s 0.00s p=1.000 n=6
Total Time 20.92s (± 0.31%) 20.98s (± 0.58%) ~ 20.86s 21.19s p=0.468 n=6
mui-docs - node (v18.15.0, x64)
Memory used 2,295,429k (± 0.00%) 2,307,742k (± 0.00%) +12,313k (+ 0.54%) 2,307,627k 2,307,871k p=0.005 n=6
Parse Time 12.00s (± 0.85%) 12.36s (± 0.74%) +0.36s (+ 2.99%) 12.28s 12.53s p=0.005 n=6
Bind Time 2.65s (± 0.31%) 2.65s (± 0.48%) ~ 2.63s 2.66s p=0.796 n=6
Check Time 102.23s (± 0.43%) 103.31s (± 1.20%) ~ 101.27s 105.07s p=0.066 n=6
Emit Time 0.32s (± 1.27%) 0.33s (± 2.50%) ~ 0.32s 0.34s p=0.248 n=6
Total Time 117.20s (± 0.35%) 118.65s (± 1.00%) +1.45s (+ 1.23%) 116.76s 120.41s p=0.045 n=6
self-build-src - node (v18.15.0, x64)
Memory used 2,405,654k (± 0.03%) 2,406,467k (± 0.02%) ~ 2,405,689k 2,407,008k p=0.066 n=6
Parse Time 5.16s (± 0.89%) 5.13s (± 1.03%) ~ 5.05s 5.20s p=0.335 n=6
Bind Time 1.88s (± 0.55%) 1.90s (± 0.72%) ~ 1.88s 1.92s p=0.098 n=6
Check Time 33.67s (± 0.26%) 33.65s (± 0.50%) ~ 33.49s 33.95s p=0.630 n=6
Emit Time 2.73s (± 1.17%) 2.70s (± 0.86%) ~ 2.66s 2.73s p=0.126 n=6
Total Time 43.47s (± 0.32%) 43.39s (± 0.39%) ~ 43.19s 43.69s p=0.298 n=6
self-compiler - node (v18.15.0, x64)
Memory used 418,709k (± 0.01%) 418,899k (± 0.01%) +190k (+ 0.05%) 418,871k 418,956k p=0.005 n=6
Parse Time 2.83s (± 1.29%) 2.82s (± 1.20%) ~ 2.79s 2.88s p=0.746 n=6
Bind Time 1.08s (± 0.48%) 1.08s (± 0.38%) ~ 1.07s 1.08s p=0.595 n=6
Check Time 15.23s (± 0.34%) 15.22s (± 0.22%) ~ 15.19s 15.27s p=0.746 n=6
Emit Time 1.16s (± 0.89%) 1.16s (± 1.60%) ~ 1.14s 1.19s p=0.677 n=6
Total Time 20.30s (± 0.29%) 20.29s (± 0.16%) ~ 20.24s 20.34s p=0.872 n=6
vscode - node (v18.15.0, x64)
Memory used 2,850,581k (± 0.00%) 2,855,595k (± 0.00%) +5,014k (+ 0.18%) 2,855,568k 2,855,647k p=0.005 n=6
Parse Time 10.75s (± 0.24%) 11.11s (± 0.22%) +0.36s (+ 3.33%) 11.08s 11.13s p=0.005 n=6
Bind Time 3.43s (± 0.50%) 3.43s (± 0.18%) ~ 3.42s 3.44s p=1.000 n=6
Check Time 60.71s (± 0.39%) 60.60s (± 0.38%) ~ 60.29s 60.82s p=0.471 n=6
Emit Time 16.27s (± 0.53%) 16.31s (± 0.55%) ~ 16.18s 16.43s p=0.470 n=6
Total Time 91.16s (± 0.29%) 91.44s (± 0.26%) +0.28s (+ 0.31%) 91.19s 91.75s p=0.045 n=6
webpack - node (v18.15.0, x64)
Memory used 397,031k (± 0.01%) 397,597k (± 0.01%) +566k (+ 0.14%) 397,529k 397,643k p=0.005 n=6
Parse Time 3.16s (± 0.54%) 3.21s (± 0.51%) +0.06s (+ 1.74%) 3.19s 3.23s p=0.005 n=6
Bind Time 1.39s (± 0.87%) 1.40s (± 0.97%) ~ 1.38s 1.42s p=0.215 n=6
Check Time 14.04s (± 0.39%) 14.08s (± 0.40%) ~ 14.01s 14.15s p=0.227 n=6
Emit Time 0.00s (± 0.00%) 0.00s (± 0.00%) ~ 0.00s 0.00s p=1.000 n=6
Total Time 18.59s (± 0.35%) 18.70s (± 0.39%) +0.11s (+ 0.57%) 18.61s 18.78s p=0.044 n=6
xstate - node (v18.15.0, x64)
Memory used 513,369k (± 0.01%) 514,055k (± 0.02%) +686k (+ 0.13%) 513,930k 514,179k p=0.005 n=6
Parse Time 3.28s (± 0.31%) 3.33s (± 0.19%) +0.05s (+ 1.63%) 3.32s 3.34s p=0.004 n=6
Bind Time 1.54s (± 0.33%) 1.55s (± 0.33%) +0.01s (+ 0.65%) 1.55s 1.56s p=0.018 n=6
Check Time 2.87s (± 0.70%) 2.87s (± 0.70%) ~ 2.84s 2.90s p=1.000 n=6
Emit Time 0.08s (± 0.00%) 0.08s (± 0.00%) ~ 0.08s 0.08s p=1.000 n=6
Total Time 7.77s (± 0.32%) 7.84s (± 0.21%) +0.07s (+ 0.88%) 7.83s 7.87s p=0.004 n=6
System info unknown
Hosts
  • node (v18.15.0, x64)
Scenarios
  • Angular - node (v18.15.0, x64)
  • Compiler-Unions - node (v18.15.0, x64)
  • Monaco - node (v18.15.0, x64)
  • TFS - node (v18.15.0, x64)
  • material-ui - node (v18.15.0, x64)
  • mui-docs - node (v18.15.0, x64)
  • self-build-src - node (v18.15.0, x64)
  • self-compiler - node (v18.15.0, x64)
  • vscode - node (v18.15.0, x64)
  • webpack - node (v18.15.0, x64)
  • xstate - node (v18.15.0, x64)
Benchmark Name Iterations
Current pr 6
Baseline baseline 6

tsserver

Comparison Report - baseline..pr
Metric baseline pr Delta Best Worst p-value
Compiler-UnionsTSServer - node (v18.15.0, x64)
Req 1 - updateOpen 2,346ms (± 0.68%) 2,366ms (± 0.91%) ~ 2,340ms 2,391ms p=0.173 n=6
Req 2 - geterr 5,572ms (± 1.54%) 5,516ms (± 1.10%) ~ 5,480ms 5,637ms p=0.575 n=6
Req 3 - references 323ms (± 0.32%) 330ms (± 1.04%) +6ms (+ 1.96%) 324ms 333ms p=0.010 n=6
Req 4 - navto 274ms (± 0.92%) 274ms (± 0.44%) ~ 272ms 275ms p=0.935 n=6
Req 5 - completionInfo count 1,357 (± 0.00%) 1,357 (± 0.00%) ~ 1,357 1,357 p=1.000 n=6
Req 5 - completionInfo 88ms (± 8.21%) 81ms (± 5.19%) ~ 78ms 89ms p=0.072 n=6
CompilerTSServer - node (v18.15.0, x64)
Req 1 - updateOpen 2,478ms (± 0.83%) 2,502ms (± 0.57%) ~ 2,475ms 2,514ms p=0.054 n=6
Req 2 - geterr 4,136ms (± 0.21%) 4,173ms (± 1.67%) ~ 4,124ms 4,276ms p=1.000 n=6
Req 3 - references 335ms (± 0.90%) 336ms (± 1.39%) ~ 330ms 342ms p=1.000 n=6
Req 4 - navto 286ms (± 0.19%) 288ms (± 0.34%) +2ms (+ 0.82%) 287ms 289ms p=0.004 n=6
Req 5 - completionInfo count 1,519 (± 0.00%) 1,519 (± 0.00%) ~ 1,519 1,519 p=1.000 n=6
Req 5 - completionInfo 89ms (± 0.84%) 87ms (± 4.73%) ~ 79ms 90ms p=0.437 n=6
xstateTSServer - node (v18.15.0, x64)
Req 1 - updateOpen 2,613ms (± 0.55%) 2,645ms (± 0.44%) +32ms (+ 1.23%) 2,628ms 2,656ms p=0.010 n=6
Req 2 - geterr 1,739ms (± 2.77%) 1,730ms (± 2.45%) ~ 1,675ms 1,795ms p=0.873 n=6
Req 3 - references 114ms (± 8.75%) 106ms (± 1.03%) 🟩-8ms (- 6.74%) 105ms 108ms p=0.022 n=6
Req 4 - navto 371ms (± 0.23%) 370ms (± 0.24%) ~ 369ms 371ms p=0.437 n=6
Req 5 - completionInfo count 2,079 (± 0.00%) 2,079 (± 0.00%) ~ 2,079 2,079 p=1.000 n=6
Req 5 - completionInfo 310ms (± 1.54%) 322ms (± 1.78%) +12ms (+ 3.82%) 314ms 327ms p=0.014 n=6
System info unknown
Hosts
  • node (v18.15.0, x64)
Scenarios
  • CompilerTSServer - node (v18.15.0, x64)
  • Compiler-UnionsTSServer - node (v18.15.0, x64)
  • xstateTSServer - node (v18.15.0, x64)
Benchmark Name Iterations
Current pr 6
Baseline baseline 6

startup

Comparison Report - baseline..pr
Metric baseline pr Delta Best Worst p-value
tsc-startup - node (v18.15.0, x64)
Execution time 153.74ms (± 0.21%) 153.60ms (± 0.18%) -0.14ms (- 0.09%) 152.50ms 156.01ms p=0.001 n=600
tsserver-startup - node (v18.15.0, x64)
Execution time 229.70ms (± 0.21%) 229.52ms (± 0.16%) -0.19ms (- 0.08%) 228.07ms 233.64ms p=0.000 n=600
tsserverlibrary-startup - node (v18.15.0, x64)
Execution time 231.19ms (± 0.19%) 231.29ms (± 0.21%) +0.10ms (+ 0.04%) 229.53ms 241.96ms p=0.030 n=600
typescript-startup - node (v18.15.0, x64)
Execution time 231.11ms (± 0.17%) 231.11ms (± 0.20%) ~ 229.51ms 237.85ms p=0.278 n=600
System info unknown
Hosts
  • node (v18.15.0, x64)
Scenarios
  • tsc-startup - node (v18.15.0, x64)
  • tsserver-startup - node (v18.15.0, x64)
  • tsserverlibrary-startup - node (v18.15.0, x64)
  • typescript-startup - node (v18.15.0, x64)
Benchmark Name Iterations
Current pr 6
Baseline baseline 6

Developer Information:

Download Benchmarks

@typescript-bot
Copy link
Collaborator

@andrewbranch Here are the results of running the top-repos suite comparing main and refs/pull/57570/merge:

Everything looks good!

@andrewbranch
Copy link
Member Author

@typescript-bot perf test

@typescript-bot
Copy link
Collaborator

typescript-bot commented Feb 28, 2024

Heya @andrewbranch, I've started to run the regular perf test suite on this PR at ab5d376. You can monitor the build here.

Update: The results are in!

@typescript-bot
Copy link
Collaborator

@andrewbranch
The results of the perf run you requested are in!

Here they are:

tsc

Comparison Report - baseline..pr
Metric baseline pr Delta Best Worst p-value
Angular - node (v18.15.0, x64)
Memory used 295,530k (± 0.01%) 296,765k (± 0.00%) +1,235k (+ 0.42%) 296,753k 296,786k p=0.005 n=6
Parse Time 2.67s (± 0.24%) 2.70s (± 0.56%) +0.03s (+ 1.25%) 2.69s 2.73s p=0.004 n=6
Bind Time 0.83s (± 1.32%) 0.84s (± 0.62%) ~ 0.83s 0.84s p=0.149 n=6
Check Time 8.26s (± 0.30%) 8.24s (± 0.21%) ~ 8.21s 8.26s p=0.618 n=6
Emit Time 7.09s (± 0.22%) 7.13s (± 0.41%) +0.04s (+ 0.52%) 7.08s 7.16s p=0.043 n=6
Total Time 18.84s (± 0.14%) 18.91s (± 0.21%) +0.07s (+ 0.37%) 18.86s 18.98s p=0.008 n=6
Compiler-Unions - node (v18.15.0, x64)
Memory used 193,191k (± 1.00%) 192,669k (± 0.94%) ~ 191,474k 195,024k p=0.575 n=6
Parse Time 1.36s (± 0.86%) 1.36s (± 0.55%) ~ 1.35s 1.37s p=0.796 n=6
Bind Time 0.72s (± 0.00%) 0.72s (± 0.00%) ~ 0.72s 0.72s p=1.000 n=6
Check Time 9.33s (± 0.17%) 9.36s (± 0.30%) ~ 9.33s 9.40s p=0.075 n=6
Emit Time 2.61s (± 0.34%) 2.61s (± 0.34%) ~ 2.60s 2.62s p=1.000 n=6
Total Time 14.02s (± 0.18%) 14.05s (± 0.19%) ~ 14.03s 14.10s p=0.063 n=6
Monaco - node (v18.15.0, x64)
Memory used 347,349k (± 0.01%) 348,427k (± 0.01%) +1,078k (+ 0.31%) 348,403k 348,455k p=0.005 n=6
Parse Time 2.46s (± 1.37%) 2.54s (± 0.69%) +0.08s (+ 3.32%) 2.52s 2.57s p=0.005 n=6
Bind Time 0.93s (± 1.18%) 0.92s (± 0.59%) ~ 0.92s 0.93s p=0.476 n=6
Check Time 6.95s (± 0.17%) 6.96s (± 0.39%) ~ 6.93s 7.00s p=0.372 n=6
Emit Time 4.08s (± 0.39%) 4.09s (± 0.18%) ~ 4.08s 4.10s p=0.136 n=6
Total Time 14.42s (± 0.07%) 14.52s (± 0.28%) +0.10s (+ 0.71%) 14.47s 14.58s p=0.004 n=6
TFS - node (v18.15.0, x64)
Memory used 302,774k (± 0.01%) 303,041k (± 0.00%) +267k (+ 0.09%) 303,031k 303,049k p=0.005 n=6
Parse Time 2.02s (± 0.75%) 2.03s (± 0.51%) ~ 2.01s 2.04s p=0.241 n=6
Bind Time 1.00s (± 0.41%) 1.00s (± 0.51%) ~ 1.00s 1.01s p=0.114 n=6
Check Time 6.36s (± 0.55%) 6.36s (± 0.40%) ~ 6.33s 6.39s p=1.000 n=6
Emit Time 3.63s (± 0.48%) 3.60s (± 0.67%) ~ 3.57s 3.64s p=0.121 n=6
Total Time 13.00s (± 0.30%) 12.99s (± 0.26%) ~ 12.94s 13.04s p=0.747 n=6
material-ui - node (v18.15.0, x64)
Memory used 511,190k (± 0.00%) 512,354k (± 0.01%) +1,164k (+ 0.23%) 512,299k 512,384k p=0.005 n=6
Parse Time 2.65s (± 0.51%) 2.70s (± 0.49%) +0.05s (+ 1.82%) 2.68s 2.71s p=0.004 n=6
Bind Time 0.99s (± 0.76%) 1.00s (± 1.03%) ~ 0.99s 1.02s p=0.063 n=6
Check Time 17.27s (± 0.48%) 17.31s (± 0.18%) ~ 17.25s 17.34s p=0.574 n=6
Emit Time 0.00s (± 0.00%) 0.00s (± 0.00%) ~ 0.00s 0.00s p=1.000 n=6
Total Time 20.92s (± 0.40%) 21.02s (± 0.13%) ~ 20.97s 21.05s p=0.053 n=6
mui-docs - node (v18.15.0, x64)
Memory used 2,295,315k (± 0.00%) 2,307,895k (± 0.00%) +12,580k (+ 0.55%) 2,307,851k 2,308,016k p=0.005 n=6
Parse Time 11.94s (± 0.73%) 12.19s (± 0.69%) +0.24s (+ 2.05%) 12.09s 12.28s p=0.005 n=6
Bind Time 2.65s (± 0.52%) 2.64s (± 0.39%) ~ 2.63s 2.66s p=0.737 n=6
Check Time 101.96s (± 1.26%) 101.98s (± 0.74%) ~ 101.00s 103.00s p=0.575 n=6
Emit Time 0.32s (± 1.27%) 0.33s (± 2.45%) +0.01s (+ 3.63%) 0.32s 0.34s p=0.024 n=6
Total Time 116.87s (± 1.08%) 117.14s (± 0.73%) ~ 116.06s 118.26s p=1.000 n=6
self-build-src - node (v18.15.0, x64)
Memory used 2,394,611k (± 0.03%) 2,396,726k (± 0.02%) +2,116k (+ 0.09%) 2,396,417k 2,397,415k p=0.005 n=6
Parse Time 5.05s (± 1.05%) 5.08s (± 0.92%) ~ 5.00s 5.12s p=0.230 n=6
Bind Time 1.89s (± 1.28%) 1.90s (± 0.73%) ~ 1.88s 1.91s p=1.000 n=6
Check Time 33.56s (± 0.26%) 33.48s (± 0.43%) ~ 33.34s 33.72s p=0.378 n=6
Emit Time 2.65s (± 1.54%) 2.72s (± 1.06%) +0.06s (+ 2.39%) 2.67s 2.75s p=0.025 n=6
Total Time 43.17s (± 0.26%) 43.19s (± 0.25%) ~ 43.08s 43.33s p=1.000 n=6
self-compiler - node (v18.15.0, x64)
Memory used 414,614k (± 0.01%) 414,839k (± 0.01%) +225k (+ 0.05%) 414,800k 414,866k p=0.005 n=6
Parse Time 2.80s (± 0.98%) 2.81s (± 0.89%) ~ 2.76s 2.83s p=0.746 n=6
Bind Time 1.07s (± 0.70%) 1.07s (± 0.59%) ~ 1.06s 1.08s p=0.718 n=6
Check Time 15.14s (± 0.13%) 15.08s (± 0.21%) -0.06s (- 0.42%) 15.03s 15.11s p=0.006 n=6
Emit Time 1.10s (± 0.95%) 1.11s (± 1.49%) ~ 1.09s 1.13s p=0.869 n=6
Total Time 20.11s (± 0.14%) 20.06s (± 0.28%) ~ 19.98s 20.14s p=0.123 n=6
vscode - node (v18.15.0, x64)
Memory used 2,851,462k (± 0.00%) 2,857,071k (± 0.00%) +5,609k (+ 0.20%) 2,857,049k 2,857,114k p=0.005 n=6
Parse Time 10.74s (± 0.46%) 11.00s (± 0.18%) +0.26s (+ 2.42%) 10.98s 11.03s p=0.005 n=6
Bind Time 3.43s (± 0.40%) 3.44s (± 0.36%) ~ 3.43s 3.46s p=0.183 n=6
Check Time 60.82s (± 0.87%) 60.62s (± 0.24%) ~ 60.35s 60.76s p=0.298 n=6
Emit Time 16.22s (± 0.50%) 16.19s (± 0.35%) ~ 16.12s 16.26s p=0.377 n=6
Total Time 91.22s (± 0.57%) 91.26s (± 0.20%) ~ 90.93s 91.44s p=1.000 n=6
webpack - node (v18.15.0, x64)
Memory used 397,009k (± 0.01%) 397,626k (± 0.01%) +617k (+ 0.16%) 397,535k 397,682k p=0.005 n=6
Parse Time 3.16s (± 0.49%) 3.19s (± 0.56%) +0.03s (+ 0.95%) 3.16s 3.21s p=0.022 n=6
Bind Time 1.39s (± 1.15%) 1.39s (± 0.74%) ~ 1.38s 1.41s p=0.618 n=6
Check Time 14.13s (± 0.44%) 14.07s (± 0.22%) ~ 14.02s 14.10s p=0.145 n=6
Emit Time 0.00s (± 0.00%) 0.00s (± 0.00%) ~ 0.00s 0.00s p=1.000 n=6
Total Time 18.67s (± 0.34%) 18.66s (± 0.22%) ~ 18.60s 18.72s p=0.936 n=6
xstate - node (v18.15.0, x64)
Memory used 513,123k (± 0.01%) 513,927k (± 0.01%) +804k (+ 0.16%) 513,817k 514,015k p=0.005 n=6
Parse Time 3.27s (± 0.12%) 3.33s (± 0.32%) +0.06s (+ 1.73%) 3.31s 3.34s p=0.004 n=6
Bind Time 1.54s (± 0.53%) 1.55s (± 0.26%) +0.01s (+ 0.54%) 1.55s 1.56s p=0.038 n=6
Check Time 2.87s (± 0.46%) 2.85s (± 0.43%) ~ 2.84s 2.87s p=0.086 n=6
Emit Time 0.08s (± 4.99%) 0.08s (± 0.00%) ~ 0.08s 0.08s p=0.405 n=6
Total Time 7.77s (± 0.24%) 7.82s (± 0.11%) +0.05s (+ 0.64%) 7.81s 7.83s p=0.005 n=6
System info unknown
Hosts
  • node (v18.15.0, x64)
Scenarios
  • Angular - node (v18.15.0, x64)
  • Compiler-Unions - node (v18.15.0, x64)
  • Monaco - node (v18.15.0, x64)
  • TFS - node (v18.15.0, x64)
  • material-ui - node (v18.15.0, x64)
  • mui-docs - node (v18.15.0, x64)
  • self-build-src - node (v18.15.0, x64)
  • self-compiler - node (v18.15.0, x64)
  • vscode - node (v18.15.0, x64)
  • webpack - node (v18.15.0, x64)
  • xstate - node (v18.15.0, x64)
Benchmark Name Iterations
Current pr 6
Baseline baseline 6

tsserver

Comparison Report - baseline..pr
Metric baseline pr Delta Best Worst p-value
Compiler-UnionsTSServer - node (v18.15.0, x64)
Req 1 - updateOpen 2,353ms (± 1.00%) 2,353ms (± 0.83%) ~ 2,331ms 2,377ms p=0.872 n=6
Req 2 - geterr 5,525ms (± 1.27%) 5,539ms (± 1.47%) ~ 5,472ms 5,646ms p=0.471 n=6
Req 3 - references 327ms (± 1.54%) 326ms (± 1.46%) ~ 322ms 332ms p=0.870 n=6
Req 4 - navto 276ms (± 0.98%) 274ms (± 1.00%) ~ 271ms 278ms p=0.333 n=6
Req 5 - completionInfo count 1,357 (± 0.00%) 1,357 (± 0.00%) ~ 1,357 1,357 p=1.000 n=6
Req 5 - completionInfo 85ms (± 8.11%) 85ms (± 7.43%) ~ 79ms 93ms p=0.798 n=6
CompilerTSServer - node (v18.15.0, x64)
Req 1 - updateOpen 2,477ms (± 0.63%) 2,488ms (± 0.66%) ~ 2,463ms 2,509ms p=0.261 n=6
Req 2 - geterr 4,212ms (± 1.86%) 4,178ms (± 1.91%) ~ 4,122ms 4,294ms p=0.229 n=6
Req 3 - references 333ms (± 0.46%) 332ms (± 0.83%) ~ 329ms 337ms p=0.360 n=6
Req 4 - navto 287ms (± 1.26%) 286ms (± 0.48%) ~ 284ms 287ms p=0.745 n=6
Req 5 - completionInfo count 1,519 (± 0.00%) 1,519 (± 0.00%) ~ 1,519 1,519 p=1.000 n=6
Req 5 - completionInfo 83ms (± 7.69%) 85ms (± 7.09%) ~ 76ms 90ms p=0.677 n=6
xstateTSServer - node (v18.15.0, x64)
Req 1 - updateOpen 2,614ms (± 0.30%) 2,630ms (± 0.35%) +15ms (+ 0.59%) 2,617ms 2,639ms p=0.020 n=6
Req 2 - geterr 1,731ms (± 0.87%) 1,728ms (± 2.27%) ~ 1,673ms 1,769ms p=0.936 n=6
Req 3 - references 117ms (± 9.83%) 116ms (± 9.45%) ~ 105ms 127ms p=0.465 n=6
Req 4 - navto 371ms (± 0.31%) 377ms (± 0.64%) +6ms (+ 1.48%) 374ms 381ms p=0.005 n=6
Req 5 - completionInfo count 2,079 (± 0.00%) 2,079 (± 0.00%) ~ 2,079 2,079 p=1.000 n=6
Req 5 - completionInfo 309ms (± 1.10%) 319ms (± 2.51%) +10ms (+ 3.29%) 308ms 326ms p=0.036 n=6
System info unknown
Hosts
  • node (v18.15.0, x64)
Scenarios
  • CompilerTSServer - node (v18.15.0, x64)
  • Compiler-UnionsTSServer - node (v18.15.0, x64)
  • xstateTSServer - node (v18.15.0, x64)
Benchmark Name Iterations
Current pr 6
Baseline baseline 6

startup

Comparison Report - baseline..pr
Metric baseline pr Delta Best Worst p-value
tsc-startup - node (v18.15.0, x64)
Execution time 153.10ms (± 0.15%) 153.19ms (± 0.15%) +0.09ms (+ 0.06%) 152.27ms 156.86ms p=0.000 n=600
tsserver-startup - node (v18.15.0, x64)
Execution time 229.38ms (± 0.17%) 228.99ms (± 0.16%) -0.39ms (- 0.17%) 227.83ms 235.45ms p=0.000 n=600
tsserverlibrary-startup - node (v18.15.0, x64)
Execution time 230.65ms (± 0.15%) 230.87ms (± 0.17%) +0.21ms (+ 0.09%) 228.89ms 238.24ms p=0.000 n=600
typescript-startup - node (v18.15.0, x64)
Execution time 231.84ms (± 0.17%) 231.94ms (± 0.14%) +0.10ms (+ 0.04%) 230.50ms 234.54ms p=0.001 n=600
System info unknown
Hosts
  • node (v18.15.0, x64)
Scenarios
  • tsc-startup - node (v18.15.0, x64)
  • tsserver-startup - node (v18.15.0, x64)
  • tsserverlibrary-startup - node (v18.15.0, x64)
  • typescript-startup - node (v18.15.0, x64)
Benchmark Name Iterations
Current pr 6
Baseline baseline 6

Developer Information:

Download Benchmarks

@typescript-bot
Copy link
Collaborator

Looks like you're introducing a change to the public API surface area. If this includes breaking changes, please document them on our wiki's API Breaking Changes page.

Also, please make sure @DanielRosenwasser and @RyanCavanaugh are aware of the changes, just as a heads up.

@andrewbranch
Copy link
Member Author

@typescript-bot test top200

@typescript-bot
Copy link
Collaborator

typescript-bot commented Mar 5, 2024

Starting jobs; this comment will be updated as builds start and complete.

Command Status Results
test top200 ✅ Started

@typescript-bot
Copy link
Collaborator

@andrewbranch Here are the results of running the top-repos suite comparing main and refs/pull/57570/merge:

Something interesting changed - please have a look.

Details

abi/screenshot-to-code

frontend/tsconfig.json

alibaba/ice

52 of 73 projects failed to build with the old tsc and were ignored

packages/create-ice/tsconfig.json

packages/plugin-css-assets-local/tsconfig.json

packages/plugin-i18n/tsconfig.json

packages/plugin-icestark/tsconfig.json

packages/plugin-pha/tsconfig.json

packages/plugin-rax-compat/tsconfig.json

packages/plugin-request/tsconfig.json

packages/plugin-unocss/tsconfig.json

packages/webpack-modify/tsconfig.json

angular/angular-cli

4 of 22 projects failed to build with the old tsc and were ignored

tests/legacy-cli/e2e/assets/17-ssr-project-webpack/tsconfig.json

tests/legacy-cli/e2e/assets/17-ssr-project-webpack/tsconfig.server.json

apache/superset

31 of 34 projects failed to build with the old tsc and were ignored

docs/tsconfig.json

superset-embedded-sdk/tsconfig.json

@jakebailey
Copy link
Member

The pipeline actually failed to push due to the text being too long; will try and fix that, but it was about to send a looot of comments: https://typescript.visualstudio.com/TypeScript/_build/results?buildId=160202&view=logs&j=15ac8a4d-b341-5815-5352-14d7ae9c5a86&t=b4a5e2cd-8727-5d20-e3d3-86822d3c46a6

@andrewbranch
Copy link
Member Author

@typescript-bot test top100

@typescript-bot
Copy link
Collaborator

typescript-bot commented Mar 6, 2024

Starting jobs; this comment will be updated as builds start and complete.

Command Status Results
test top100 ✅ Started 👀 Results

@typescript-bot
Copy link
Collaborator

@andrewbranch Here are the results of running the top-repos suite comparing main and refs/pull/57570/merge:

Something interesting changed - please have a look.

Details

microsoft/playwright

5 of 15 projects failed to build with the old tsc and were ignored

packages/html-reporter/tsconfig.json

Comment on lines +91 to +92
import referencedSource from "../../lib/src/a"; // Error
import referencedDeclaration from "../../lib/dist/a"; // Error
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@sheetalkamat do you think it’s worth it to fix this? These two default imports would ideally error, because we could know by using the referenced project settings that the emit was ESM. We currently don’t error because we assume that a declaration file that says export declare const a = 0 could represent a CJS file. I’m not sure if it should be out of scope for this PR to start using referenced project settings to get more accurate information during type checking like this.

@andrewbranch
Copy link
Member Author

@typescript-bot test top200

@typescript-bot
Copy link
Collaborator

typescript-bot commented Mar 18, 2024

Starting jobs; this comment will be updated as builds start and complete.

Command Status Results
test top200 ✅ Started 👀 Results

@typescript-bot
Copy link
Collaborator

@andrewbranch Here are the results of running the top-repos suite comparing main and refs/pull/57570/merge:

Something interesting changed - please have a look.

Details

mattermost/mattermost

1 of 4 projects failed to build with the old tsc and were ignored

webapp/channels/tsconfig.json

microsoft/playwright

4 of 15 projects failed to build with the old tsc and were ignored

packages/html-reporter/tsconfig.json

nextauthjs/next-auth

20 of 41 projects failed to build with the old tsc and were ignored

packages/adapter-surrealdb/tsconfig.json

ueberdosis/tiptap

3 of 8 projects failed to build with the old tsc and were ignored

tests/cypress/tsconfig.json

vercel/hyper

2 of 3 projects failed to build with the old tsc and were ignored

tsconfig.json

@andrewbranch
Copy link
Member Author

@typescript-bot test top200

@typescript-bot
Copy link
Collaborator

typescript-bot commented Mar 19, 2024

Starting jobs; this comment will be updated as builds start and complete.

Command Status Results
test top200 ✅ Started 👀 Results

@typescript-bot
Copy link
Collaborator

@andrewbranch Here are the results of running the top-repos suite comparing main and refs/pull/57570/merge:

Something interesting changed - please have a look.

Details

microsoft/playwright

4 of 15 projects failed to build with the old tsc and were ignored

packages/html-reporter/tsconfig.json

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Author: Team For Uncommitted Bug PR for untriaged, rejected, closed or missing bug
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants