Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix(trafficrouting): Fix rollback behavior for canary with trafficrouting and .DynamicStableScale=true #4035

Open
wants to merge 2 commits into
base: master
Choose a base branch
from

test(controller): remove code duplication in replicaset/canary tests

2851f13
Select commit
Loading
Failed to load commit list.
Sign in for the full log view
Open

fix(trafficrouting): Fix rollback behavior for canary with trafficrouting and .DynamicStableScale=true #4035

test(controller): remove code duplication in replicaset/canary tests
2851f13
Select commit
Loading
Failed to load commit list.
GitHub Actions / Published E2E Test Results succeeded Jan 27, 2025 in 0s

4 fail, 7 skipped, 102 pass in 3h 10m 29s

  4 files    4 suites   3h 10m 29s ⏱️
113 tests 102 ✅  7 💤 4 ❌
456 runs  424 ✅ 28 💤 4 ❌

Results for commit 2851f13.

Annotations

Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e

See this annotation in the file changed.

@github-actions github-actions / Published E2E Test Results

1 out of 5 runs failed: TestAWSSuite/TestALBExperimentStepNoSetWeight (github.com/argoproj/argo-rollouts/test/e2e)

artifacts/E2E Test Results (k8s 1.30)/junit-e2e-test.xml [took 12s]
Raw output
Failed
=== RUN   TestAWSSuite/TestALBExperimentStepNoSetWeight
time="2025-01-27T15:31:02Z" level=info msg="Deleting e2e-test-name=TestALBExperimentStepNoSetWeight"
time="2025-01-27T15:31:02Z" level=info msg="service/alb-rollout-root created\n" rollout=alb-rollout
time="2025-01-27T15:31:03Z" level=info msg="service/alb-rollout-canary created\n" rollout=alb-rollout
time="2025-01-27T15:31:03Z" level=info msg="service/alb-rollout-stable created\n" rollout=alb-rollout
time="2025-01-27T15:31:03Z" level=info msg="Warning: annotation \"kubernetes.io/ingress.class\" is deprecated, please use 'spec.ingressClassName' instead\ningress.networking.k8s.io/alb-rollout-ingress created\n" rollout=alb-rollout
time="2025-01-27T15:31:03Z" level=info msg="rollout.argoproj.io/alb-rollout created\n" rollout=alb-rollout
time="2025-01-27T15:31:03Z" level=info msg="Waiting for condition: status=Healthy" rollout=alb-rollout
time="2025-01-27T15:31:04Z" level=info msg="Condition 'status=Healthy' met after 1s" rollout=alb-rollout
time="2025-01-27T15:31:04Z" level=info msg="Experiment expectation 'experiment count == 0' met" rollout=alb-rollout
time="2025-01-27T15:31:04Z" level=info msg="Updated rollout pod spec: 2025-01-27T15:31:04.525154576Z" rollout=alb-rollout
time="2025-01-27T15:31:04Z" level=info msg="Sleeping 10s" rollout=alb-rollout
    require.go:72: 
        	Error Trace:	/home/runner/go/pkg/mod/github.com/tj/[email protected]/require.go:72
        	            				/home/runner/work/argo-rollouts/argo-rollouts/test/e2e/aws_test.go:330
        	            				/home/runner/work/argo-rollouts/argo-rollouts/test/fixtures/then.go:29
        	            				/home/runner/work/argo-rollouts/argo-rollouts/test/e2e/aws_test.go:320
        	Error:      	Not equal: 
        	            	expected: "{\"Type\":\"forward\",\"ForwardConfig\":{\"TargetGroups\":[{\"ServiceName\":\"alb-rollout-canary\",\"ServicePort\":\"80\",\"Weight\":0},{\"ServiceName\":\"\",\"ServicePort\":\"80\",\"Weight\":20},{\"ServiceName\":\"\",\"ServicePort\":\"80\",\"Weight\":20},{\"ServiceName\":\"alb-rollout-stable\",\"ServicePort\":\"80\",\"Weight\":60}]}}"
        	            	actual  : "{\"Type\":\"forward\",\"ForwardConfig\":{\"TargetGroups\":[{\"ServiceName\":\"alb-rollout-canary\",\"ServicePort\":\"80\",\"Weight\":0},{\"ServicePort\":\"80\",\"Weight\":20},{\"ServicePort\":\"80\",\"Weight\":20},{\"ServiceName\":\"alb-rollout-stable\",\"ServicePort\":\"80\",\"Weight\":60}]}}"
        	            	
        	            	Diff:
        	            	--- Expected
        	            	+++ Actual
        	            	@@ -1 +1 @@
        	            	-{"Type":"forward","ForwardConfig":{"TargetGroups":[{"ServiceName":"alb-rollout-canary","ServicePort":"80","Weight":0},{"ServiceName":"","ServicePort":"80","Weight":20},{"ServiceName":"","ServicePort":"80","Weight":20},{"ServiceName":"alb-rollout-stable","ServicePort":"80","Weight":60}]}}
        	            	+{"Type":"forward","ForwardConfig":{"TargetGroups":[{"ServiceName":"alb-rollout-canary","ServicePort":"80","Weight":0},{"ServicePort":"80","Weight":20},{"ServicePort":"80","Weight":20},{"ServiceName":"alb-rollout-stable","ServicePort":"80","Weight":60}]}}
        	Test:       	TestAWSSuite/TestALBExperimentStepNoSetWeight
Name:            alb-rollout
Namespace:       default
Status:          �[94m◌�[0m Progressing
Message:         more replicas need to be updated
Strategy:        Canary
  Step:          0/1
  SetWeight:     0
  ActualWeight:  0
Images:          nginx:1.19-alpine (�[32mstable�[0m, �[0mΣ:experiment-alb-canary�[0m, �[0mΣ:experiment-alb-stable�[0m)
Replicas:
  Desired:       1
  Current:       1
  Updated:       0
  Ready:         1
  Available:     1

NAME                                                                  KIND        STATUS         AGE  INFO
⟳ alb-rollout                                                         Rollout     �[94m◌�[0m Progressing  11s  
├──# revision:2                                                                                       
│  ├──⧉ �[33malb-rollout-5d74d9cf99�[0m                                        ReplicaSet  �[0m•�[0m ScaledDown   10s  �[33mcanary�[0m
│  └──Σ �[94malb-rollout-5d74d9cf99-2-0�[0m                                    Experiment  �[94m◌�[0m Running      10s  
│     ├──⧉ alb-rollout-5d74d9cf99-2-0-experiment-alb-canary           ReplicaSet  �[32m✔�[0m Healthy      10s  
│     │  └──□ alb-rollout-5d74d9cf99-2-0-experiment-alb-canary-wxndp  Pod         �[32m✔�[0m Running      10s  ready:1/1
│     └──⧉ alb-rollout-5d74d9cf99-2-0-experiment-alb-stable           ReplicaSet  �[32m✔�[0m Healthy      10s  
│        └──□ alb-rollout-5d74d9cf99-2-0-experiment-alb-stable-x84b9  Pod         �[32m✔�[0m Running      10s  ready:1/1
└──# revision:1                                                                                       
   └──⧉ �[32malb-rollout-d6f4fdcdc�[0m                                         ReplicaSet  �[32m✔�[0m Healthy      11s  �[32mstable�[0m
      └──□ alb-rollout-d6f4fdcdc-9llf7                                Pod         �[32m✔�[0m Running      11s  ready:1/1

---
apiVersion: argoproj.io/v1alpha1
kind: Rollout
metadata:
  annotations:
    rollout.argoproj.io/revision: "2"
  creationTimestamp: "2025-01-27T15:31:03Z"
  generation: 4
  labels:
    argo-rollouts.argoproj.io/controller-instance-id: argo-rollouts-e2e
    e2e-test-name: TestALBExperimentStepNoSetWeight
  name: alb-rollout
  namespace: default
  resourceVersion: "3946"
  uid: bfe93939-a379-460f-be44-aa0a2c07fc8a
spec:
  replicas: 1
  selector:
    matchLabels:
      app: alb-rollout
  strategy:
    canary:
      canaryService: alb-rollout-canary
      stableService: alb-rollout-stable
      steps:
      - experiment:
          analysisRunMetadata: {}
          duration: 15s
          templates:
          - metadata: {}
            name: experiment-alb-canary
            specRef: canary
            weight: 20
          - metadata: {}
            name: experiment-alb-stable
            specRef: stable
            weight: 20
      trafficRouting:
        alb:
          ingress: alb-rollout-ingress
          rootService: alb-rollout-root
          servicePort: 80
  template:
    metadata:
      annotations:
        update: "2025-01-27T15:31:04.525154576Z"
      creationTimestamp: null
      labels:
        app: alb-rollout
    spec:
      containers:
      - image: nginx:1.19-alpine
        name: alb-rollout
        ports:
        - containerPort: 80
          name: http
          protocol: TCP
        resources:
          requests:
            cpu: 5m
            memory: 16Mi
status:
  HPAReplicas: 1
  availableReplicas: 1
  blueGreen: {}
  canary:
    currentExperiment: alb-rollout-5d74d9cf99-2-0
    weights:
      additional:
      - weight: 20
      - weight: 20
      canary:
        podTemplateHash: 5d74d9cf99
        serviceName: alb-rollout-canary
        weight: 0
      stable:
        podTemplateHash: d6f4fdcdc
        serviceName: alb-rollout-stable
        weight: 60
  conditions:
  - lastTransitionTime: "2025-01-27T15:31:04Z"
    lastUpdateTime: "2025-01-27T15:31:04Z"
    message: Rollout has minimum availability
    reason: AvailableReason
    status: "True"
    type: Available
  - lastTransitionTime: "2025-01-27T15:31:04Z"
    lastUpdateTime: "2025-01-27T15:31:04Z"
    message: Rollout is not healthy
    reason: RolloutHealthy
    status: "False"
    type: Healthy
  - lastTransitionTime: "2025-01-27T15:31:03Z"
    lastUpdateTime: "2025-01-27T15:31:04Z"
    message: ReplicaSet "alb-rollout-5d74d9cf99" is progressing.
    reason: ReplicaSetUpdated
    status: "True"
    type: Progressing
  - lastTransitionTime: "2025-01-27T15:31:04Z"
    lastUpdateTime: "2025-01-27T15:31:04Z"
    message: RolloutCompleted
    reason: RolloutCompleted
    status: "False"
    type: Completed
  currentPodHash: 5d74d9cf99
  currentStepHash: 8b59978
  currentStepIndex: 0
  message: more replicas need to be updated
  observedGeneration: "4"
  phase: Progressing
  readyReplicas: 1
  replicas: 1
  selector: app=alb-rollout
  stableRS: d6f4fdcdc

2025-01-27T15:31:03Z         Normal    RolloutAddedToInformer    Rollout resource added to informer: default/alb-rollout
2025-01-27T15:31:03Z         Normal    RolloutUpdated            Rollout updated to revision 1
2025-01-27T15:31:03Z         Normal    NewReplicaSetCreated      Created ReplicaSet alb-rollout-d6f4fdcdc (revision 1)
2025-01-27T15:31:03Z         Normal    RolloutNotCompleted       Rollout not completed, started update to revision 1 (d6f4fdcdc)
2025-01-27T15:31:05Z (x2)    Normal    PatchingALBIngress        Updating Ingress `alb-rollout-ingress` to desiredWeight '0'
2025-01-27T15:31:03Z         Normal    TrafficWeightUpdated      Traffic weight updated to 0
2025-01-27T15:31:03Z         Normal    ScalingReplicaSet         Scaled up ReplicaSet alb-rollout-d6f4fdcdc (revision 1) from 0 to 1
2025-01-27T15:31:03Z         Normal    RolloutCompleted          Rollout completed update to revision 1 (d6f4fdcdc): Initial deploy
2025-01-27T15:31:04Z (x2)    Normal    TrafficWeightUpdated      Traffic weight updated 
2025-01-27T15:31:04Z         Normal    SwitchService             Switched selector for service 'alb-rollout-stable' from '' to 'd6f4fdcdc'
2025-01-27T15:31:04Z         Normal    SwitchService             Switched selector for service 'alb-rollout-canary' from '' to 'd6f4fdcdc'
2025-01-27T15:31:04Z         Normal    RolloutUpdated            Rollout updated to revision 2
2025-01-27T15:31:04Z         Normal    NewReplicaSetCreated      Created ReplicaSet alb-rollout-5d74d9cf99 (revision 2)
2025-01-27T15:31:04Z         Normal    RolloutNotCompleted       Rollout not completed, started update to revision 2 (5d74d9cf99)
2025-01-27T15:31:04Z         Normal    ExperimentCreated         Created Experiment 'alb-rollout-5d74d9cf99-2-0'
2025-01-27T15:31:05Z         Normal    TrafficWeightUpdated      Traffic weight updated additional: [{20  } {20  }]

time="2025-01-27T15:31:14Z" level=info msg="Deleting e2e-test-name=TestALBExperimentStepNoSetWeight"
    --- FAIL: TestAWSSuite/TestALBExperimentStepNoSetWeight (12.13s)

Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e

See this annotation in the file changed.

@github-actions github-actions / Published E2E Test Results

1 out of 5 runs failed: TestAWSSuite (github.com/argoproj/argo-rollouts/test/e2e)

artifacts/E2E Test Results (k8s 1.30)/junit-e2e-test.xml [took 1m 51s]
Raw output
Failed
=== RUN   TestAWSSuite
--- FAIL: TestAWSSuite (111.85s)

Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e

See this annotation in the file changed.

@github-actions github-actions / Published E2E Test Results

1 out of 5 runs failed: TestCanarySuite/TestRolloutWithMaxSurgeScalingDuringUpdate (github.com/argoproj/argo-rollouts/test/e2e)

artifacts/E2E Test Results (k8s 1.30)/junit-e2e-test.xml [took 4s]
Raw output
Failed
=== RUN   TestCanarySuite/TestRolloutWithMaxSurgeScalingDuringUpdate
time="2025-01-27T15:39:28Z" level=info msg="Deleting e2e-test-name=TestRolloutWithMaxSurgeScalingDuringUpdate"
time="2025-01-27T15:39:28Z" level=info msg="rollout.argoproj.io/updatescaling created\n" rollout=updatescaling
time="2025-01-27T15:39:28Z" level=info msg="Waiting for condition: status=Healthy" rollout=updatescaling
time="2025-01-27T15:39:29Z" level=info msg="Condition 'status=Healthy' met after 1s" rollout=updatescaling
W0127 15:39:29.835183   27110 warnings.go:70] unknown field "spec.template.metadata.creationTimestamp"
time="2025-01-27T15:39:29Z" level=info msg="Patched rollout: {\"spec\":{\"template\":{\"spec\":{\"containers\":[{\"name\":\"updatescaling\",\"resources\":{\"requests\":{\"cpu\":\"2m\",\"memory\":\"16Mi\"}}}]}}}}" rollout=updatescaling
time="2025-01-27T15:39:29Z" level=info msg="Waiting for condition: status.replicas=7" rollout=updatescaling
time="2025-01-27T15:39:30Z" level=info msg="Condition 'status.replicas=7' met after 0s" rollout=updatescaling
time="2025-01-27T15:39:30Z" level=info msg="Pod expectation 'canary pod count == 4' met" rollout=updatescaling
time="2025-01-27T15:39:30Z" level=info msg="Pod expectation 'stable pod count == 3' met" rollout=updatescaling
time="2025-01-27T15:39:30Z" level=info msg="Scaled rollout to 8" rollout=updatescaling
time="2025-01-27T15:39:30Z" level=info msg="Waiting for condition: status.replicas=11" rollout=updatescaling
time="2025-01-27T15:39:30Z" level=info msg="Condition 'status.replicas=11' met after 0s" rollout=updatescaling
time="2025-01-27T15:39:30Z" level=info msg="Pod expectation 'canary pod count == 8' met" rollout=updatescaling
time="2025-01-27T15:39:30Z" level=info msg="Pod expectation 'stable pod count == 3' met" rollout=updatescaling
time="2025-01-27T15:39:30Z" level=info msg="Scaled rollout to 4" rollout=updatescaling
time="2025-01-27T15:39:30Z" level=info msg="Waiting for condition: status.replicas=7" rollout=updatescaling
time="2025-01-27T15:39:31Z" level=info msg="Condition 'status.replicas=7' met after 1s" rollout=updatescaling
time="2025-01-27T15:39:32Z" level=info msg="Pod expectation 'canary pod count == 4' met" rollout=updatescaling
time="2025-01-27T15:39:32Z" level=warning msg="unexpected stable (hash 79b6b5f5d4) pod count: expected 3, saw: 4" rollout=updatescaling
time="2025-01-27T15:39:32Z" level=error msg="Pod expectation 'stable pod count == 3' failed" rollout=updatescaling
Name:            updatescaling
Namespace:       default
Status:          �[94m◌�[0m Progressing
Message:         old replicas are pending termination
Strategy:        Canary
  Step:          
  SetWeight:     100
  ActualWeight:  100
Images:          nginx:1.19-alpine (�[32mstable�[0m)
Replicas:
  Desired:       4
  Current:       6
  Updated:       4
  Ready:         6
  Available:     6

NAME                                       KIND        STATUS         AGE  INFO
⟳ updatescaling                            Rollout     �[94m◌�[0m Progressing  4s   
├──# revision:2                                                            
│  └──⧉ �[32mupdatescaling-79b6b5f5d4�[0m           ReplicaSet  �[32m✔�[0m Healthy      3s   �[32mstable�[0m
│     ├──□ updatescaling-79b6b5f5d4-2xjgp  Pod         �[32m✔�[0m Running      3s   ready:1/1
│     ├──□ updatescaling-79b6b5f5d4-fsmgp  Pod         �[32m✔�[0m Running      3s   ready:1/1
│     ├──□ updatescaling-79b6b5f5d4-t679c  Pod         �[32m✔�[0m Running      3s   ready:1/1
│     ├──□ updatescaling-79b6b5f5d4-xx7cb  Pod         �[32m✔�[0m Running      3s   ready:1/1
│     ├──□ updatescaling-79b6b5f5d4-957gx  Pod         �[94m◌�[0m Terminating  2s   ready:0/1
│     ├──□ updatescaling-79b6b5f5d4-9rp64  Pod         �[94m◌�[0m Terminating  2s   ready:0/1
│     ├──□ updatescaling-79b6b5f5d4-fn6kk  Pod         �[94m◌�[0m Terminating  2s   ready:0/1
│     └──□ updatescaling-79b6b5f5d4-zshkv  Pod         �[94m◌�[0m Terminating  2s   ready:0/1
└──# revision:1                                                            
   └──⧉ updatescaling-54d546d75c           ReplicaSet  �[0m•�[0m ScaledDown   4s   

---
apiVersion: argoproj.io/v1alpha1
kind: Rollout
metadata:
  annotations:
    rollout.argoproj.io/revision: "2"
  creationTimestamp: "2025-01-27T15:39:28Z"
  generation: 4
  labels:
    argo-rollouts.argoproj.io/controller-instance-id: argo-rollouts-e2e
    e2e-test-name: TestRolloutWithMaxSurgeScalingDuringUpdate
  name: updatescaling
  namespace: default
  resourceVersion: "10002"
  uid: f95beb66-fabc-4767-bb41-4943556e6f62
spec:
  replicas: 4
  selector:
    matchLabels:
      app: updatescaling
  strategy:
    canary:
      maxSurge: 100%
  template:
    metadata:
      creationTimestamp: null
      labels:
        app: updatescaling
    spec:
      containers:
      - image: nginx:1.19-alpine
        name: updatescaling
        resources:
          requests:
            cpu: 2m
            memory: 16Mi
status:
  HPAReplicas: 6
  availableReplicas: 6
  blueGreen: {}
  canary: {}
  conditions:
  - lastTransitionTime: "2025-01-27T15:39:29Z"
    lastUpdateTime: "2025-01-27T15:39:29Z"
    message: Rollout is not healthy
    reason: RolloutHealthy
    status: "False"
    type: Healthy
  - lastTransitionTime: "2025-01-27T15:39:31Z"
    lastUpdateTime: "2025-01-27T15:39:31Z"
    message: Rollout has minimum availability
    reason: AvailableReason
    status: "True"
    type: Available
  - lastTransitionTime: "2025-01-27T15:39:31Z"
    lastUpdateTime: "2025-01-27T15:39:31Z"
    message: RolloutCompleted
    reason: RolloutCompleted
    status: "True"
    type: Completed
  - lastTransitionTime: "2025-01-27T15:39:28Z"
    lastUpdateTime: "2025-01-27T15:39:32Z"
    message: ReplicaSet "updatescaling-79b6b5f5d4" is progressing.
    reason: ReplicaSetUpdated
    status: "True"
    type: Progressing
  currentPodHash: 79b6b5f5d4
  currentStepHash: 5ffbfbbd64
  message: old replicas are pending termination
  observedGeneration: "4"
  phase: Progressing
  readyReplicas: 6
  replicas: 6
  selector: app=updatescaling
  stableRS: 79b6b5f5d4
  updatedReplicas: 4

2025-01-27T15:39:28Z    Normal    RolloutAddedToInformer    Rollout resource added to informer: default/updatescaling
2025-01-27T15:39:28Z    Normal    RolloutUpdated            Rollout updated to revision 1
2025-01-27T15:39:28Z    Normal    NewReplicaSetCreated      Created ReplicaSet updatescaling-54d546d75c (revision 1)
2025-01-27T15:39:28Z    Normal    RolloutNotCompleted       Rollout not completed, started update to revision 1 (54d546d75c)
2025-01-27T15:39:28Z    Normal    ScalingReplicaSet         Scaled up ReplicaSet updatescaling-54d546d75c (revision 1) from 0 to 4
2025-01-27T15:39:28Z    Normal    RolloutCompleted          Rollout completed update to revision 1 (54d546d75c): Initial deploy
2025-01-27T15:39:29Z    Normal    RolloutUpdated            Rollout updated to revision 2
2025-01-27T15:39:29Z    Normal    NewReplicaSetCreated      Created ReplicaSet updatescaling-79b6b5f5d4 (revision 2)
2025-01-27T15:39:29Z    Normal    RolloutNotCompleted       Rollout not completed, started update to revision 2 (79b6b5f5d4)
2025-01-27T15:39:29Z    Normal    ScalingReplicaSet         Scaled down ReplicaSet updatescaling-54d546d75c (revision 1) from 4 to 3
2025-01-27T15:39:29Z    Normal    ScalingReplicaSet         Scaled up ReplicaSet updatescaling-79b6b5f5d4 (revision 2) from 0 to 4
2025-01-27T15:39:30Z    Normal    ScalingReplicaSet         Scaled up ReplicaSet updatescaling-79b6b5f5d4 (revision 2) from 4 to 8
2025-01-27T15:39:30Z    Normal    ScalingReplicaSet         Scaled down ReplicaSet updatescaling-54d546d75c (revision 1) from 3 to 2
2025-01-27T15:39:31Z    Normal    ScalingReplicaSet         Scaled down ReplicaSet updatescaling-79b6b5f5d4 (revision 2) from 8 to 4
2025-01-27T15:39:31Z    Normal    ScalingReplicaSet         Scaled down ReplicaSet updatescaling-54d546d75c (revision 1) from 2 to 0
2025-01-27T15:39:31Z    Normal    RolloutCompleted          Rollout completed update to revision 2 (79b6b5f5d4): Completed all 0 canary steps

time="2025-01-27T15:39:32Z" level=info msg="Deleting e2e-test-name=TestRolloutWithMaxSurgeScalingDuringUpdate"
time="2025-01-27T15:39:32Z" level=info msg="Deleting e2e-test-name"
    --- FAIL: TestCanarySuite/TestRolloutWithMaxSurgeScalingDuringUpdate (4.12s)

Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e

See this annotation in the file changed.

@github-actions github-actions / Published E2E Test Results

1 out of 5 runs failed: TestCanarySuite (github.com/argoproj/argo-rollouts/test/e2e)

artifacts/E2E Test Results (k8s 1.30)/junit-e2e-test.xml [took 4m 53s]
Raw output
Failed
=== RUN   TestCanarySuite
time="2025-01-27T15:34:39Z" level=info msg="analysistemplate.argoproj.io/sleep-job created\n"
--- FAIL: TestCanarySuite (293.06s)

Check notice on line 0 in .github

See this annotation in the file changed.

@github-actions github-actions / Published E2E Test Results

7 skipped tests found

There are 7 skipped tests, see "Raw output" for the full list of skipped tests.
Raw output
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBBlueGreenUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBCanaryUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBCanaryUpdateMultiIngress
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAppMeshSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestSMIIngressSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestSMISuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestStepPluginSuite

Check notice on line 0 in .github

See this annotation in the file changed.

@github-actions github-actions / Published E2E Test Results

113 tests found

There are 113 tests, see "Raw output" for the full list of tests.
Raw output
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAPISIXSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAPISIXSuite/TestAPISIXCanarySetHeaderStep
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAPISIXSuite/TestAPISIXCanaryStep
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBBlueGreenUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBCanaryUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBCanaryUpdateMultiIngress
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBExperimentStep
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBExperimentStepMultiIngress
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBExperimentStepNoSetWeight
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBExperimentStepNoSetWeightMultiIngress
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBMesh_PingPong_StableCanary_Update
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBPingPongUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBPingPongUpdateMultiIngress
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestAlbHeaderRoute
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestAlbHeaderRouteMultiIngress
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestAnalysisWithArgs
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestAnalysisWithSecret
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestBackgroundAnalysisWithArgs
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestBlueGreenAbortAndUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestBlueGreenAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestBlueGreenKitchenSink
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestBlueGreenPostPromotionFail
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestBlueGreenPrePromotionFail
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestCanaryBackgroundAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestCanaryFailInlineMultipleAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestCanaryInlineAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestCanaryInlineMultipleAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestMultipleAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAppMeshSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestBlueGreenSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestBlueGreenSuite/TestBlueGreenPreviewReplicaCount
github.com/argoproj/argo-rollouts/test/e2e ‑ TestBlueGreenSuite/TestBlueGreenProgressDeadlineExceededWithPause
github.com/argoproj/argo-rollouts/test/e2e ‑ TestBlueGreenSuite/TestBlueGreenProgressDeadlineExceededWithoutPause
github.com/argoproj/argo-rollouts/test/e2e ‑ TestBlueGreenSuite/TestEphemeralMetadata
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryDynamicStableScale
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryDynamicStableScaleRollbackToStable
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryProgressDeadlineExceededWithPause
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryScaleDownDelay
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryScaleDownDelayWithProgressDeadline
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryScaleDownOnAbort
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryScaleDownOnAbortNoTrafficRouting
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanarySetCanaryScale
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryUnScaleDownOnAbort
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryWithPausedRollout
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestEphemeralMetadata
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestReduceWeightAndHonorMaxUnavailable
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestRolloutScalingDuringUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestRolloutScalingWhenPaused
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestRolloutWithMaxSurgeScalingDuringUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite/TestExperimentWithDryRunMetrics
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite/TestExperimentWithMeasurementRetentionMetrics
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite/TestExperimentWithMultiportServiceAndScaleDownDelay
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite/TestExperimentWithServiceAndScaleDownDelay
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite/TestExperimentWithServiceNameAndScaleDownDelay
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite/TestRolloutWithExperimentAndAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenExceedProgressDeadlineAbort
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenPreviewReplicaCountPromoteFull
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenPromoteFull
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenScaleDownDelay
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenScaleDownOnAbort
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenToCanary
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestCanaryPromoteFull
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestCompleteRolloutRestart
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestContainerResourceFormats
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestControllerMetrics
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestFixInvalidSpec
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestKubectlWaitForCompleted
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestKubectlWaitForPaused
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestMalformedRollout
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestMalformedRolloutEphemeralCtr
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestNeverScaleDown
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutAbortRetryPromote
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutBadToBadUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutBadToGoodSetWeightUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutBadToGoodUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutGoodToBadUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutPDBRestart
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutPauseDurationGreaterThanProgressDeadlineSeconds
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutPodVolumesItemsSpec
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutRestart
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestScaleDownOnSuccess
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestScaleDownProgressively
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestSpecAndReplicaChangeSameTime
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestWorkloadRef
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestWorkloadRefTemplate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestHeaderRoutingSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestHeaderRoutingSuite/TestIstioHostHeaderRoute
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioAbortUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioAbortUpdateDeleteAllCanaryPods
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioHostSplit
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioHostSplitExperimentStep
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioHostSplitOnlyTls
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioPingPongUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioSubsetSplit
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioSubsetSplitExperimentStep
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioSubsetSplitInStableDownscaleAfterCanaryAbort
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioSubsetSplitSingleRoute
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioUpdateInMiddleZeroCanaryReplicas
github.com/argoproj/argo-rollouts/test/e2e ‑ TestMirrorRouteSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestMirrorRouteSuite/TestIstioHostMirrorRoute
github.com/argoproj/argo-rollouts/test/e2e ‑ TestRollbackSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestRollbackSuite/TestRollbackAnalysisOutsideWindow
github.com/argoproj/argo-rollouts/test/e2e ‑ TestRollbackSuite/TestRollbackAnalysisWithinWindow
github.com/argoproj/argo-rollouts/test/e2e ‑ TestSMIIngressSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestSMISuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestStepPluginSuite