Skip to content

Performance tests #122

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
Totktonada opened this issue Dec 13, 2021 · 1 comment · Fixed by #152
Closed

Performance tests #122

Totktonada opened this issue Dec 13, 2021 · 1 comment · Fixed by #152
Assignees
@vr009
Labels
code health Improve code readability, simplify maintenance and so on

Comments

@Totktonada
Copy link
Member

It would be nice to add several benchmarks into the repository to ease performance evaluation during development.

What I'm interested about:

  • Point Select (as some kind of baseline).
  • Large Select (to look on msgpack decoder performance).
  • Replace (not really about connector's performance, rather about tarantool, but anyway interesting, whether there will be a noticeable difference from a point Select).

Consider snippets from tarantool/tarantool#3603.

Let's leave regular performance tracking and the relevant infrastructure out of context here.
@Totktonada Totktonada added teamE code health Improve code readability, simplify maintenance and so on labels Dec 13, 2021
vr009 added a commit that referenced this issue Mar 31, 2022
@vr009
test: add benchmark tests
68df18f 
Added benchmarking of large Select and Replace.
Added a new target in Makefile for running benchmark tests.
Added a new space in config.lua for large Select tests.

Fixes #122
vr009 added a commit that referenced this issue Mar 31, 2022
@vr009
ci: add ci steps for running benchmark tests
ba507ad 
Added third party gh-action for A/B testing
of performance degradation.

Follows up #122
vr009 added a commit that referenced this issue Mar 31, 2022
@vr009
ci: add ci steps for running benchmark tests
5934f44 
Added third party gh-action for A/B testing
of performance degradation.

Follows up #122
vr009 added a commit that referenced this issue Mar 31, 2022
@vr009
ci: add ci steps for running benchmark tests
ccac202 
Added third party gh-action for A/B testing
of performance degradation.

Follows up #122
vr009 added a commit that referenced this issue Mar 31, 2022
@vr009
ci: add ci steps for running benchmark tests
a85d089 
Added third party gh-action for A/B testing
of performance degradation.

Follows up #122
vr009 added a commit that referenced this issue Mar 31, 2022
@vr009
ci: add ci steps for running benchmark tests
8ffad81 
Added third party gh-action for A/B testing
of performance degradation.

Follows up #122
vr009 added a commit that referenced this issue Mar 31, 2022
@vr009
ci: add ci steps for running benchmark tests
4c6b5b9 
Added third party gh-action for A/B testing
of performance degradation.

Follows up #122
vr009 added a commit that referenced this issue Mar 31, 2022
@vr009
ci: add ci steps for running benchmark tests
b572f99 
Added third party gh-action for A/B testing
of performance degradation.

Follows up #122
vr009 added a commit that referenced this issue Mar 31, 2022
@vr009
ci: add ci steps for running benchmark tests
aab243b 
Added third party gh-action for A/B testing
of performance degradation.

Follows up #122
vr009 added a commit that referenced this issue Mar 31, 2022
@vr009
ci: add ci steps for running benchmark tests
2c9957c 
Added third party gh-action for A/B testing
of performance degradation.

Follows up #122
vr009 added a commit that referenced this issue Mar 31, 2022
@vr009
ci: add ci steps for running benchmark tests
c394500 
Added third party gh-action for A/B testing
of performance degradation.

Follows up #122
vr009 added a commit that referenced this issue Mar 31, 2022
@vr009
ci: add ci steps for running benchmark tests
824757a 
Added third party gh-action for A/B testing
of performance degradation.

Follows up #122
vr009 added a commit that referenced this issue Mar 31, 2022
@vr009
ci: add ci steps for running benchmark tests
34e0b5d 
Added third party gh-action for A/B testing
of performance degradation.

Follows up #122
vr009 added a commit that referenced this issue Mar 31, 2022
@vr009
ci: add ci steps for running benchmark tests
01b6b47 
Added third party gh-action for A/B testing
of performance degradation.

Follows up #122
vr009 added a commit that referenced this issue Mar 31, 2022
@vr009
ci: add ci steps for running benchmark tests
a4b2d8e 
Added third party gh-action for A/B testing
of performance degradation.

Follows up #122
vr009 added a commit that referenced this issue Mar 31, 2022
@vr009
ci: add ci steps for running benchmark tests
26490fa 
Added third party gh-action for A/B testing
of performance degradation.

Follows up #122
vr009 added a commit that referenced this issue Mar 31, 2022
@vr009
ci: add ci steps for running benchmark tests
c8640fb 
Added third party gh-action for A/B testing
of performance degradation.

Follows up #122
vr009 added a commit that referenced this issue Mar 31, 2022
@vr009
ci: add ci steps for running benchmark tests
61bae03 
Added third party gh-action for A/B testing
of performance degradation.

Follows up #122
vr009 added a commit that referenced this issue Mar 31, 2022
@vr009
ci: add ci steps for running benchmark tests
05bfa43 
Added third party gh-action for A/B testing
of performance degradation.

Follows up #122
vr009 added a commit that referenced this issue Mar 31, 2022
@vr009
ci: add ci steps for running benchmark tests
3ee8199 
Added third party gh-action for A/B testing
of performance degradation.

Follows up #122
vr009 added a commit that referenced this issue Mar 31, 2022
@vr009
ci: add ci steps for running benchmark tests
d32adee 
Added third party gh-action for A/B testing
of performance degradation.

Follows up #122
vr009 added a commit that referenced this issue Apr 1, 2022
@vr009
ci: add ci steps for running benchmark tests
3d6bf47 
Added third party gh-action for A/B testing
of performance degradation.

Follows up #122
vr009 added a commit that referenced this issue Apr 4, 2022
@vr009
test: add benchmark tests
8fbb84b 
Added benchmarking of large Select and Replace.
Added a new target in Makefile for running benchmark tests.
Added a new space in config.lua for large Select tests.

Fixes #122
vr009 added a commit that referenced this issue Apr 4, 2022
@vr009
ci: add benchmark tests
1fa6010 
Added benchmark tests in ci.

Follows up #122
@Totktonada
Copy link
Member Author

NB: I would also expect a short guide how to run benchmarks. I find it a good practice to place such information into the HACKING.md file and add the link to it into README. See https://github.com/luafun/luafun/blob/f126f9cc1ceedeff83eb8ca3f4df8e4f4cc96e85/HACKING.md for example. But consult with @ligurio first: maybe he knows whether there is a standard way to offer such information in Go projects.

vr009 added a commit that referenced this issue Apr 6, 2022
@vr009
test: add benchmark tests
2b2a0d9 
Added benchmarking of large Select and Replace.
Added a new target in Makefile for running benchmark tests.
Added a new space in config.lua for large Select tests.

Fixes #122
vr009 added a commit that referenced this issue Apr 26, 2022
@vr009
test: add benchmark tests
3c4a343 
Added benchmarks of large Select and Replace.
Added a new target in Makefile for running benchmark tests.
Added a new space in config.lua for large Select tests.
Added a new target in Makefile for measuring performance
degradation between current changes and master.
Added a new line in gitignore for ignoring artifacts from bench target.

Added a new step for running benchmark tests in ci.

Added description to the CONTRIBUTING.md for how to
run benchmark tests.

Closes #122
vr009 added a commit that referenced this issue Apr 27, 2022
@vr009
test: add benchmark tests
e49ec13 
Added benchmarks of large Select and Replace.
Added a new target in Makefile for running benchmark tests.
Added a new space in config.lua for large Select tests.
Added a new target in Makefile for measuring performance
degradation between current changes and master.
Added a new line in gitignore for ignoring artifacts from bench target.

Added a new step for running benchmark tests in ci.

Added description to the CONTRIBUTING.md for how to
run benchmark tests.

Closes #122
vr009 added a commit that referenced this issue Apr 27, 2022
@vr009
test: add benchmark tests
addc9c7 
Added benchmarks of large Select and Replace.
Added a new target in Makefile for running benchmark tests.
Added a new space in config.lua for large Select tests.
Added a new target in Makefile for measuring performance
degradation between current changes and master.
Added a new line in gitignore for ignoring artifacts from bench target.

Added a new step for running benchmark tests in ci.

Added description to the CONTRIBUTING.md for how to
run benchmark tests.

Closes #122
vr009 added a commit that referenced this issue Apr 27, 2022
@vr009
test: add benchmark tests
0ab34a3 
Added benchmarks of large Select and Replace.
Added a new target in Makefile for running benchmark tests.
Added a new space in config.lua for large Select tests.
Added a new target in Makefile for measuring performance
degradation between current changes and master.
Added a new line in gitignore for ignoring artifacts from bench target.

Added a new step for running benchmark tests in ci.

Added description to the CONTRIBUTING.md for how to
run benchmark tests.

Closes #122
vr009 added a commit that referenced this issue Apr 28, 2022
@vr009
test: fix incorrect perf measurement
1606275 
Added calls of b.ResetTimer() to all Benchmark tests before
running bench loop. That call clears all counters of allocs,
timers etc. The preparation before bench loop affected perf results.

Part of #122
vr009 added a commit that referenced this issue Apr 28, 2022
@vr009
test: add benchmark tests
2841c9f 
Added benchmarks of large Select and Replace.
Added a new target in Makefile for running benchmark tests.
Added a new space in config.lua for large Select tests.
Added a new target in Makefile for measuring performance
degradation between current changes and master.
Added a new line in gitignore for ignoring artifacts from bench target.

Added a new step for running benchmark tests in ci.

Added description to the CONTRIBUTING.md for how to
run benchmark tests.

Closes #122
vr009 added a commit that referenced this issue Apr 28, 2022
@vr009
test: add benchmark tests
eb6bee8 
Added benchmarks of large Select and Replace.
Added a new target in Makefile for running benchmark tests.
Added a new space in config.lua for large Select tests.
Added a new target in Makefile for measuring performance
degradation between current changes and master.
Added a new line in gitignore for ignoring artifacts from bench target.

Added a new step for running benchmark tests in ci.

Added description to the CONTRIBUTING.md for how to
run benchmark tests.

Closes #122
vr009 added a commit that referenced this issue Apr 28, 2022
@vr009
test: add benchmark tests
eaf659d 
Added benchmarks of large Select and Replace.
Added a new target in Makefile for running benchmark tests.
Added a new space in config.lua for large Select tests.
Added a new target in Makefile for measuring performance
degradation between current changes and master.
Added a new line in gitignore for ignoring artifacts from bench target.

Added a new step for running benchmark tests in ci.

Added description to the CONTRIBUTING.md for how to
run benchmark tests.

Closes #122
vr009 added a commit that referenced this issue Apr 28, 2022
@vr009
test: add benchmark tests
6dc5ba6 
Added benchmarks of large Select and Replace.
Added a new target in Makefile for running benchmark tests.
Added a new space in config.lua for large Select tests.
Added a new target in Makefile for measuring performance
degradation between current changes and master.
Added a new line in gitignore for ignoring artifacts from bench target.

Added a new step for running benchmark tests in ci.

Added description to the CONTRIBUTING.md for how to
run benchmark tests.

Closes #122
vr009 added a commit that referenced this issue Apr 28, 2022
@vr009
test: add benchmark tests
9da1984 
Added benchmarks of large Select and Replace.
Added a new target in Makefile for running benchmark tests.
Added a new space in config.lua for large Select tests.
Added a new target in Makefile for measuring performance
degradation between current changes and master.
Added a new line in gitignore for ignoring artifacts from bench target.

Added a new step for running benchmark tests in ci.

Added description to the CONTRIBUTING.md for how to
run benchmark tests.

Closes #122
vr009 added a commit that referenced this issue Apr 29, 2022
@vr009
test: add benchmark tests
723873e 
Added benchmarks of large Select and Replace.
Added a new target in Makefile for running benchmark tests.
Added a new space in config.lua for large Select tests.
Added a new target in Makefile for measuring performance
degradation between current changes and master.
Added a new line in gitignore for ignoring artifacts from bench target.

Added a new step for running benchmark tests in ci.

Added description to the CONTRIBUTING.md for how to
run benchmark tests.

Closes #122
vr009 added a commit that referenced this issue Apr 29, 2022
@vr009
test: fix incorrect perf measurement
7b39f7e 
Added calls of b.ResetTimer() to all Benchmark tests before
running bench loop. That call clears all counters of allocs,
timers etc. The preparation before bench loop affected perf results.

Part of #122
vr009 added a commit that referenced this issue Apr 29, 2022
@vr009
test: add benchmark tests
a93024a 
Added benchmarks of large Select and Replace.
Added a new target in Makefile for running benchmark tests.
Added a new space in config.lua for large Select tests.
Added a new target in Makefile for measuring performance
degradation between current changes and master.
Added a new line in gitignore for ignoring artifacts from bench target.

Added a new step for running benchmark tests in ci.

Added description to the CONTRIBUTING.md for how to
run benchmark tests.

Closes #122
vr009 added a commit that referenced this issue May 4, 2022
@vr009
test: add benchmark tests
cf95b4b 
Added benchmarks of large Select and Replace.
Added a new target in Makefile for running benchmark tests.
Added a new space in config.lua for large Select tests.
Added a new target in Makefile for measuring performance
degradation between current changes and master.
Added a new line in gitignore for ignoring artifacts from bench target.

Added a new step for running benchmark tests in ci.

Added description to the CONTRIBUTING.md for how to
run benchmark tests.

Closes #122
vr009 added a commit that referenced this issue May 6, 2022
@vr009
test: add benchmark tests
961ff1b 
Added benchmarks of large Select and Replace.
Added a new target in Makefile for running benchmark tests.
Added a new space in config.lua for large Select tests.
Added a new target in Makefile for measuring performance
degradation between current changes and master.
Added a new line in gitignore for ignoring artifacts from bench target.

Added a new step for running benchmark tests in ci.

Added description to the CONTRIBUTING.md for how to
run benchmark tests.

Closes #122
vr009 added a commit that referenced this issue May 6, 2022
@vr009
test: add benchmark tests
86f904d 
Added benchmarks of large Select and Replace.
Added a new target in Makefile for running benchmark tests.
Added a new space in config.lua for large Select tests.
Added a new target in Makefile for measuring performance
degradation between current changes and master.
Added a new line in gitignore for ignoring artifacts from bench target.

Added a new step for running benchmark tests in ci.

Added description to the CONTRIBUTING.md for how to
run benchmark tests.

Closes #122
vr009 added a commit that referenced this issue May 6, 2022
@vr009
test: add benchmark tests
e0326f5 
Added benchmarks of large Select and Replace.
Added a new target in Makefile for running benchmark tests.
Added a new space in config.lua for large Select tests.
Added a new target in Makefile for measuring performance
degradation between current changes and master.
Added a new line in gitignore for ignoring artifacts from bench target.

Added a new step for running benchmark tests in ci.

Added description to the CONTRIBUTING.md for how to
run benchmark tests.

Closes #122
vr009 added a commit that referenced this issue May 12, 2022
@vr009
test: add benchmark tests
ed4d55e 
Added benchmarks of large Select and Replace.
Added a new target in Makefile for running benchmark tests.
Added a new space in config.lua for large Select tests.
Added a new target in Makefile for measuring performance
degradation between current changes and master.
Added a new line in gitignore for ignoring artifacts from bench target.

Added a new step for running benchmark tests in ci.

Added description to the CONTRIBUTING.md for how to
run benchmark tests.

Closes #122
vr009 added a commit that referenced this issue May 18, 2022
@vr009
test: add benchmark tests
9a1f104 
Added benchmarks of large Select and Replace.
Added a new target in Makefile for running benchmark tests.
Added a new space in config.lua for large Select tests.
Added a new target in Makefile for measuring performance
degradation between current changes and master.
Added a new line in gitignore for ignoring artifacts from bench target.

Added a new step for running benchmark tests in ci.

Added description to the CONTRIBUTING.md for how to
run benchmark tests.

Closes #122
vr009 added a commit that referenced this issue May 18, 2022
@vr009
test: add benchmark tests
4f77e34 
Added benchmarks of large Select and Replace.
Added a new target in Makefile for running benchmark tests.
Added a new space in config.lua for large Select tests.
Added a new target in Makefile for measuring performance
degradation between current changes and master.
Added a new line in gitignore for ignoring artifacts from bench target.

Added a new step for running benchmark tests in ci.

Added description to the CONTRIBUTING.md for how to
run benchmark tests.

Closes #122
vr009 added a commit that referenced this issue May 18, 2022
@vr009
test: add benchmark tests
0d2c868 
Added benchmarks of large Select and Replace.
Added a new target in Makefile for running benchmark tests.
Added a new space in config.lua for large Select tests.
Added a new target in Makefile for measuring performance
degradation between current changes and master.
Added a new line in gitignore for ignoring artifacts from bench target.

Added a new step for running benchmark tests in ci.

Added description to the CONTRIBUTING.md for how to
run benchmark tests.

Closes #122
vr009 added a commit that referenced this issue May 18, 2022
@vr009
test: fix incorrect perf measurement
9fb381c 
Added calls of b.ResetTimer() to all Benchmark tests before
running bench loop. That call clears all counters of allocs,
timers etc. The preparation before bench loop affected perf results.

Part of #122
vr009 added a commit that referenced this issue May 18, 2022
@vr009
test: add benchmark tests
976020c 
Added benchmarks of large Select and Replace.
Added a new target in Makefile for running benchmark tests.
Added a new space in config.lua for large Select tests.
Added a new target in Makefile for measuring performance
degradation between current changes and master.
Added a new line in gitignore for ignoring artifacts from bench target.

Added a new step for running benchmark tests in ci.

Added description to the CONTRIBUTING.md for how to
run benchmark tests.

Closes #122
vr009 added a commit that referenced this issue May 30, 2022
@vr009
test: fix benchmark tests names
2bc07ed 
When using go test tool with different regexp for filtering
test functions, it is sometimes helpful to filter some of them
with any prefix like BenchmarkClientSerial or BenchmarkClientParallel.
This way it is possible to get results just for one type of load.

Follows up #62
Follows up #122
vr009 added a commit that referenced this issue Jun 27, 2022
@vr009
test: fix benchmark tests names
87df0a1 
When using go test tool with different regexp for filtering
test functions, it is sometimes helpful to filter some of them
with any prefix like BenchmarkClientSerial or BenchmarkClientParallel.
This way it is possible to get results just for one type of load.

Follows up #62
Follows up #122
vr009 added a commit that referenced this issue Jul 4, 2022
@vr009
test: fix benchmark tests names
51f07e2 
When using go test tool with different regexp for filtering
test functions, it is sometimes helpful to filter some of them
with any prefix like BenchmarkClientSerial or BenchmarkClientParallel.
This way it is possible to get results just for one type of load.

Follows up #62
Follows up #122
vr009 added a commit that referenced this issue Jul 7, 2022
@vr009
test: fix benchmark tests names
9fb2337 
When using go test tool with different regexp for filtering
test functions, it is sometimes helpful to filter some of them
with any prefix like BenchmarkClientSerial or BenchmarkClientParallel.
This way it is possible to get results just for one type of load.

Follows up #62
Follows up #122
vr009 added a commit that referenced this issue Jul 12, 2022
@vr009
test: fix benchmark tests names
8ca9102 
When using go test tool with different regexp for filtering
test functions, it is sometimes helpful to filter some of them
with any prefix like BenchmarkClientSerial or BenchmarkClientParallel.
This way it is possible to get results just for one type of load.

Follows up #62
Follows up #122
oleg-jukovec pushed a commit that referenced this issue Jul 13, 2022
@vr009 @oleg-jukovec
test: fix benchmark tests names
ac4f611 
When using go test tool with different regexp for filtering
test functions, it is sometimes helpful to filter some of them
with any prefix like BenchmarkClientSerial or BenchmarkClientParallel.
This way it is possible to get results just for one type of load.

Follows up #62
Follows up #122
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@vr009 vr009

Labels
code health Improve code readability, simplify maintenance and so on
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Add performance tests tarantool/go-tarantool
2 participants
@Totktonada @vr009