Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CI_RUNNERS #88

Merged
merged 89 commits into from
Jan 6, 2025
Merged

CI_RUNNERS #88

merged 89 commits into from
Jan 6, 2025

Conversation

AYAHASSAN287
Copy link
Collaborator

@AYAHASSAN287 AYAHASSAN287 commented Nov 25, 2024

PR Details

This PR contains changes in CI job to do the following :

1- Using 16 shards to execute 387 tests in time <16 mins
2- Dividing tests between 3 machines [test_rln.py - test_cursor_manymsgs.py - rest of tests ]
3- Aggregate all reports into 1 report

Issues reported:

@AYAHASSAN287 AYAHASSAN287 changed the title Change number of threads for CI runners to 8 CI_RUNNERS Nov 25, 2024
@AYAHASSAN287 AYAHASSAN287 marked this pull request as draft November 27, 2024 09:38
@@ -35,6 +35,12 @@ jobs:

tests:
name: tests
strategy:
matrix:
shard: [ 0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,23,
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this is overkill :)
I think we should use a max of 16 shards
Anyhow we would need to unskip RLN tests which need to run on the same shard and those tests will probably take more than any other shard, and the report needs to wait for them to finish.

@AYAHASSAN287 AYAHASSAN287 marked this pull request as ready for review December 30, 2024 13:22
Copy link
Collaborator

@fbarbu15 fbarbu15 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please clean this PR, you have marks and skips that shound't be here or are not quite correct
Also please add comments in the workflow explaining how starding works

fix: add multiple machines

fix: prevent fail fast

checkout on smoke_tests tag (#96)

* checkout on smoke_tests tag

* MOdify pytest command

* Update README.md

Add steps on how to use new tag for PR tests in readme file

Remove multiple skips

Revert changes in test_rln file
@AYAHASSAN287
Copy link
Collaborator Author

Please clean this PR, you have marks and skips that shound't be here or are not quite correct Also please add comments in the workflow explaining how starding works

Comments added in workflow , skips removed
for cleaning the PR I will apply squash all commits & merge once PR is approved

Copy link
Collaborator

@fbarbu15 fbarbu15 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, thanks :)

@AYAHASSAN287 AYAHASSAN287 merged commit 1a981a1 into master Jan 6, 2025
20 checks passed
@AYAHASSAN287 AYAHASSAN287 deleted the CI_RUNNERS branch January 6, 2025 13:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants