Skip to content

Another perf test #41063

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
wants to merge 21 commits into from
Closed

Another perf test #41063

wants to merge 21 commits into from

Conversation

Kingwl
Copy link
Contributor

@Kingwl Kingwl commented Oct 12, 2020

@typescript-bot typescript-bot added the For Uncommitted Bug PR for untriaged, rejected, closed or missing bug label Oct 12, 2020
@Kingwl
Copy link
Contributor Author

Kingwl commented Oct 12, 2020

@typescript-bot perf test.

@typescript-bot
Copy link
Collaborator

typescript-bot commented Oct 12, 2020 •
edited
Loading

Heya @Kingwl, I've started to run the perf test suite on this PR at 04a449f. You can monitor the build here.

Update: The results are in!

@typescript-bot
Copy link
Collaborator

@Kingwl
The results of the perf run you requested are in!

Here they are:

Comparison Report - master..41063

Metric master 41063 Delta Best Worst
Angular - node (v10.16.3, x64)
Memory used 349,757k (± 0.02%) 350,229k (± 0.02%) +472k (+ 0.13%) 350,080k 350,401k
Parse Time 2.01s (± 0.80%) 2.00s (± 0.47%) -0.01s (- 0.60%) 1.98s 2.02s
Bind Time 0.82s (± 1.07%) 0.83s (± 0.48%) +0.01s (+ 0.73%) 0.82s 0.84s
Check Time 4.94s (± 0.54%) 4.95s (± 0.38%) +0.01s (+ 0.18%) 4.90s 4.98s
Emit Time 5.19s (± 0.41%) 5.23s (± 0.56%) +0.04s (+ 0.73%) 5.17s 5.28s
Total Time 12.96s (± 0.34%) 13.00s (± 0.31%) +0.03s (+ 0.26%) 12.88s 13.07s
Monaco - node (v10.16.3, x64)
Memory used 354,351k (± 0.02%) 354,380k (± 0.02%) +29k (+ 0.01%) 354,183k 354,511k
Parse Time 1.57s (± 0.57%) 1.55s (± 0.29%) -0.01s (- 0.89%) 1.54s 1.56s
Bind Time 0.71s (± 0.56%) 0.72s (± 0.62%) +0.01s (+ 0.98%) 0.71s 0.73s
Check Time 5.07s (± 0.54%) 5.06s (± 0.53%) -0.01s (- 0.14%) 5.00s 5.13s
Emit Time 2.76s (± 0.93%) 2.75s (± 0.51%) -0.02s (- 0.62%) 2.72s 2.78s
Total Time 10.11s (± 0.37%) 10.08s (± 0.35%) -0.04s (- 0.35%) 9.99s 10.17s
TFS - node (v10.16.3, x64)
Memory used 307,640k (± 0.04%) 307,642k (± 0.02%) +2k (+ 0.00%) 307,532k 307,795k
Parse Time 1.22s (± 0.76%) 1.22s (± 0.92%) -0.01s (- 0.57%) 1.20s 1.25s
Bind Time 0.66s (± 1.37%) 0.67s (± 0.66%) +0.01s (+ 1.66%) 0.66s 0.68s
Check Time 4.57s (± 0.94%) 4.57s (± 0.45%) +0.01s (+ 0.13%) 4.53s 4.62s
Emit Time 2.90s (± 1.72%) 2.94s (± 0.51%) +0.04s (+ 1.28%) 2.91s 2.97s
Total Time 9.35s (± 0.59%) 9.40s (± 0.31%) +0.05s (+ 0.53%) 9.35s 9.46s
material-ui - node (v10.16.3, x64)
Memory used 489,125k (± 0.02%) 489,099k (± 0.02%) -26k (- 0.01%) 488,882k 489,322k
Parse Time 1.99s (± 0.54%) 1.98s (± 0.44%) -0.01s (- 0.55%) 1.97s 2.00s
Bind Time 0.65s (± 0.90%) 0.65s (± 1.00%) +0.00s (+ 0.15%) 0.63s 0.66s
Check Time 13.42s (± 0.51%) 13.43s (± 0.59%) +0.01s (+ 0.04%) 13.26s 13.61s
Emit Time 0.00s (± 0.00%) 0.00s (± 0.00%) 0.00s ( NaN%) 0.00s 0.00s
Total Time 16.06s (± 0.45%) 16.06s (± 0.52%) -0.01s (- 0.03%) 15.88s 16.23s
Angular - node (v12.1.0, x64)
Memory used 326,934k (± 0.02%) 327,454k (± 0.02%) +520k (+ 0.16%) 327,307k 327,642k
Parse Time 2.00s (± 0.53%) 2.01s (± 0.60%) +0.01s (+ 0.30%) 1.98s 2.03s
Bind Time 0.81s (± 1.12%) 0.81s (± 0.71%) +0.00s (+ 0.12%) 0.80s 0.82s
Check Time 4.83s (± 0.40%) 4.85s (± 0.49%) +0.02s (+ 0.37%) 4.79s 4.90s
Emit Time 5.39s (± 0.84%) 5.40s (± 0.56%) +0.01s (+ 0.11%) 5.35s 5.47s
Total Time 13.04s (± 0.52%) 13.07s (± 0.27%) +0.03s (+ 0.25%) 13.00s 13.15s
Monaco - node (v12.1.0, x64)
Memory used 336,578k (± 0.02%) 336,574k (± 0.01%) -4k (- 0.00%) 336,490k 336,643k
Parse Time 1.54s (± 0.72%) 1.52s (± 1.02%) -0.01s (- 0.85%) 1.50s 1.56s
Bind Time 0.69s (± 0.58%) 0.69s (± 0.84%) +0.00s (+ 0.58%) 0.68s 0.71s
Check Time 4.88s (± 0.50%) 4.91s (± 0.46%) +0.03s (+ 0.66%) 4.88s 4.98s
Emit Time 2.82s (± 0.91%) 2.83s (± 0.90%) +0.01s (+ 0.46%) 2.78s 2.90s
Total Time 9.93s (± 0.39%) 9.97s (± 0.39%) +0.04s (+ 0.38%) 9.89s 10.08s
TFS - node (v12.1.0, x64)
Memory used 291,933k (± 0.03%) 291,954k (± 0.02%) +20k (+ 0.01%) 291,802k 292,132k
Parse Time 1.23s (± 0.49%) 1.23s (± 0.86%) +0.00s (+ 0.16%) 1.21s 1.26s
Bind Time 0.65s (± 1.38%) 0.65s (± 1.64%) 0.00s ( 0.00%) 0.63s 0.68s
Check Time 4.47s (± 0.30%) 4.48s (± 0.40%) +0.01s (+ 0.27%) 4.42s 4.50s
Emit Time 2.92s (± 0.99%) 2.92s (± 0.75%) +0.00s (+ 0.17%) 2.87s 2.96s
Total Time 9.26s (± 0.36%) 9.27s (± 0.35%) +0.02s (+ 0.18%) 9.20s 9.35s
material-ui - node (v12.1.0, x64)
Memory used 467,034k (± 0.05%) 467,066k (± 0.05%) +32k (+ 0.01%) 466,118k 467,301k
Parse Time 2.01s (± 0.37%) 2.02s (± 0.52%) +0.00s (+ 0.25%) 2.00s 2.04s
Bind Time 0.64s (± 1.05%) 0.63s (± 0.54%) -0.00s (- 0.63%) 0.63s 0.64s
Check Time 12.05s (± 0.94%) 12.01s (± 0.74%) -0.04s (- 0.35%) 11.86s 12.19s
Emit Time 0.00s (± 0.00%) 0.00s (± 0.00%) 0.00s ( NaN%) 0.00s 0.00s
Total Time 14.70s (± 0.81%) 14.66s (± 0.63%) -0.04s (- 0.27%) 14.50s 14.86s
Angular - node (v8.9.0, x64)
Memory used 346,442k (± 0.01%) 346,978k (± 0.02%) +536k (+ 0.15%) 346,779k 347,048k
Parse Time 2.54s (± 0.51%) 2.56s (± 0.22%) +0.01s (+ 0.51%) 2.55s 2.57s
Bind Time 0.85s (± 0.43%) 0.87s (± 0.76%) +0.02s (+ 1.87%) 0.86s 0.89s
Check Time 5.56s (± 0.52%) 5.61s (± 0.77%) +0.06s (+ 0.99%) 5.53s 5.73s
Emit Time 6.15s (± 1.07%) 6.23s (± 0.99%) +0.08s (+ 1.32%) 6.10s 6.37s
Total Time 15.11s (± 0.55%) 15.27s (± 0.53%) +0.16s (+ 1.05%) 15.11s 15.43s
Monaco - node (v8.9.0, x64)
Memory used 355,704k (± 0.02%) 355,859k (± 0.01%) +154k (+ 0.04%) 355,806k 355,998k
Parse Time 1.89s (± 0.77%) 1.88s (± 0.37%) -0.01s (- 0.37%) 1.87s 1.90s
Bind Time 0.89s (± 0.45%) 0.89s (± 0.42%) -0.01s (- 0.67%) 0.88s 0.89s
Check Time 5.62s (± 0.37%) 5.63s (± 0.36%) +0.01s (+ 0.18%) 5.59s 5.67s
Emit Time 3.29s (± 1.17%) 3.26s (± 0.82%) -0.03s (- 0.79%) 3.23s 3.36s
Total Time 11.69s (± 0.28%) 11.66s (± 0.32%) -0.03s (- 0.22%) 11.61s 11.77s
TFS - node (v8.9.0, x64)
Memory used 309,391k (± 0.02%) 309,419k (± 0.02%) +28k (+ 0.01%) 309,296k 309,537k
Parse Time 1.55s (± 0.64%) 1.55s (± 0.48%) -0.01s (- 0.39%) 1.53s 1.56s
Bind Time 0.68s (± 0.73%) 0.68s (± 0.50%) +0.00s (+ 0.15%) 0.67s 0.68s
Check Time 5.31s (± 0.58%) 5.31s (± 0.46%) +0.00s (+ 0.02%) 5.26s 5.36s
Emit Time 2.94s (± 0.34%) 2.94s (± 0.67%) -0.00s (- 0.07%) 2.87s 2.96s
Total Time 10.48s (± 0.34%) 10.47s (± 0.40%) -0.01s (- 0.09%) 10.34s 10.53s
material-ui - node (v8.9.0, x64)
Memory used 493,431k (± 0.01%) 493,616k (± 0.02%) +185k (+ 0.04%) 493,475k 493,896k
Parse Time 2.40s (± 0.46%) 2.41s (± 0.40%) +0.00s (+ 0.12%) 2.38s 2.42s
Bind Time 0.81s (± 1.02%) 0.81s (± 1.03%) -0.01s (- 0.98%) 0.79s 0.82s
Check Time 17.95s (± 0.69%) 17.97s (± 0.69%) +0.02s (+ 0.08%) 17.60s 18.19s
Emit Time 0.00s (± 0.00%) 0.00s (± 0.00%) 0.00s ( NaN%) 0.00s 0.00s
Total Time 21.17s (± 0.56%) 21.18s (± 0.58%) +0.01s (+ 0.04%) 20.83s 21.41s
Angular - node (v8.9.0, x86)
Memory used 198,690k (± 0.01%) 199,029k (± 0.03%) +339k (+ 0.17%) 198,876k 199,161k
Parse Time 2.48s (± 1.02%) 2.47s (± 0.59%) -0.01s (- 0.36%) 2.44s 2.50s
Bind Time 1.00s (± 1.00%) 1.01s (± 0.99%) +0.01s (+ 0.70%) 0.99s 1.03s
Check Time 5.05s (± 0.56%) 5.04s (± 0.50%) -0.01s (- 0.14%) 4.99s 5.09s
Emit Time 5.89s (± 0.83%) 6.04s (± 0.63%) +0.16s (+ 2.65%) 5.98s 6.17s
Total Time 14.42s (± 0.58%) 14.56s (± 0.33%) +0.15s (+ 1.02%) 14.45s 14.70s
Monaco - node (v8.9.0, x86)
Memory used 201,493k (± 0.01%) 201,582k (± 0.02%) +89k (+ 0.04%) 201,487k 201,650k
Parse Time 1.94s (± 1.05%) 1.92s (± 1.02%) -0.02s (- 1.08%) 1.89s 1.98s
Bind Time 0.71s (± 0.47%) 0.72s (± 1.41%) +0.01s (+ 0.70%) 0.70s 0.74s
Check Time 5.47s (± 0.38%) 5.54s (± 1.39%) +0.08s (+ 1.43%) 5.43s 5.70s
Emit Time 3.06s (± 0.59%) 2.96s (± 4.34%) 🟩-0.09s (- 3.04%) 2.68s 3.15s
Total Time 11.18s (± 0.25%) 11.15s (± 0.61%) -0.03s (- 0.29%) 10.99s 11.31s
TFS - node (v8.9.0, x86)
Memory used 176,867k (± 0.03%) 176,969k (± 0.04%) +102k (+ 0.06%) 176,743k 177,078k
Parse Time 1.60s (± 1.10%) 1.59s (± 0.56%) -0.02s (- 1.25%) 1.57s 1.61s
Bind Time 0.66s (± 2.04%) 0.64s (± 0.56%) -0.01s (- 1.68%) 0.64s 0.65s
Check Time 4.82s (± 0.58%) 4.81s (± 0.53%) -0.01s (- 0.17%) 4.77s 4.88s
Emit Time 2.80s (± 0.66%) 2.83s (± 1.08%) +0.02s (+ 0.86%) 2.76s 2.90s
Total Time 9.88s (± 0.51%) 9.87s (± 0.49%) -0.02s (- 0.17%) 9.77s 9.97s
material-ui - node (v8.9.0, x86)
Memory used 277,878k (± 0.02%) 277,913k (± 0.02%) +35k (+ 0.01%) 277,788k 278,034k
Parse Time 2.46s (± 0.43%) 2.47s (± 0.44%) +0.01s (+ 0.45%) 2.44s 2.49s
Bind Time 0.69s (± 1.35%) 0.69s (± 1.52%) +0.01s (+ 0.73%) 0.67s 0.71s
Check Time 16.45s (± 0.73%) 16.50s (± 0.90%) +0.05s (+ 0.30%) 16.16s 16.81s
Emit Time 0.00s (± 0.00%) 0.00s (± 0.00%) 0.00s ( NaN%) 0.00s 0.00s
Total Time 19.60s (± 0.63%) 19.66s (± 0.82%) +0.07s (+ 0.34%) 19.30s 20.00s
System
Machine Namets-ci-ubuntu
Platformlinux 4.4.0-166-generic
Architecturex64
Available Memory16 GB
Available Memory3 GB
CPUs4 × Intel(R) Core(TM) i7-4770 CPU @ 3.40GHz
Hosts
  • node (v10.16.3, x64)
  • node (v12.1.0, x64)
  • node (v8.9.0, x64)
  • node (v8.9.0, x86)
Scenarios
  • Angular - node (v10.16.3, x64)
  • Angular - node (v12.1.0, x64)
  • Angular - node (v8.9.0, x64)
  • Angular - node (v8.9.0, x86)
  • Monaco - node (v10.16.3, x64)
  • Monaco - node (v12.1.0, x64)
  • Monaco - node (v8.9.0, x64)
  • Monaco - node (v8.9.0, x86)
  • TFS - node (v10.16.3, x64)
  • TFS - node (v12.1.0, x64)
  • TFS - node (v8.9.0, x64)
  • TFS - node (v8.9.0, x86)
  • material-ui - node (v10.16.3, x64)
  • material-ui - node (v12.1.0, x64)
  • material-ui - node (v8.9.0, x64)
  • material-ui - node (v8.9.0, x86)
Benchmark Name Iterations
Current 41063 10
Baseline master 10

@Kingwl
Copy link
Contributor Author

Kingwl commented Oct 12, 2020

looks good.

@Kingwl Kingwl closed this Oct 13, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
For Uncommitted Bug PR for untriaged, rejected, closed or missing bug
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@Kingwl @typescript-bot