Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add performance test #168

Merged
merged 15 commits into from
Feb 27, 2020
Merged

Add performance test #168

merged 15 commits into from
Feb 27, 2020

Conversation

nikolay-borzov
Copy link
Collaborator

@nikolay-borzov nikolay-borzov commented Feb 22, 2020

  • Reorganize tests folder structure - split tests into end-to-end, unit and performance
  • Add performance test

Resolves #166

- Reorganize tests folder structure - split tests into end-to-end, unit and performance
- Add performance test
- Use `PerformanceObserver` to get duration to make actual execution time visible in failed test
@nikolay-borzov nikolay-borzov changed the title Add performance test (#166) Add performance test Feb 22, 2020
- Set performance test threshold to value actual for CI
@coveralls
Copy link

coveralls commented Feb 22, 2020

Coverage Status

Coverage remained the same at 97.938% when pulling 7ca2f99 on add-performance-test into c78a5c7 on master.

- Measure performance with `format = html` to cover default use case
- Increase threshold for CI
- Add `windows` and `osx` to Travis build matrix
- Increase threshold more
- Try to normalize EOLs on CI
- Increase threshold further
- Remove obsolete key `sudo`
- Force using LF on CI
- Force LF for CI
- Revert changes to `.travis.yml`. Will be added as a separate commit
- Increase threshold
- Add `_MS` to constant name
- Set threshould to 6000 so that we have ~1000ms buffer from the worst result on CI
@nikolay-borzov nikolay-borzov merged commit 7ec1b38 into master Feb 27, 2020
@nikolay-borzov nikolay-borzov deleted the add-performance-test branch February 27, 2020 17:18
@nikolay-borzov nikolay-borzov added this to the 2.4.0 milestone Mar 5, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Add performance test
3 participants