🚀 Release v1.55.0

[matusdrobuliak66]

Release version

1.55.0

Commit SHA

48d29cda9cb81c570fbd329ec560eb0c2167321a

Previous pre-release

https://github.com/ITISFoundation/osparc-simcore/releases/tag/staging_Watermelon2

Did the commit CI suceeded?

• The commit CI succeeded.

Motivation

n/a

Changes

Release Issue: #4397

• ✨ Use RUN mounts in dockerfiles + should make build more reliable #4347 by @sanderegg
• ♻️ change timeout until project gets closed to 1 minute (⚠️ devops) #4349 by @sanderegg
• Use forked openapi generator repo #4343 by @bisgaard-itis
• 📝 improving release doc [skip ci] #4297 by @matusdrobuliak66
• ⬆️ ♻️ Maintenance: sqlachemy2 compatibility upgrades #4330 by @pcrespov
• 🐛 Enabling make setting-schema.json for agent #4338 by @GitHK
• 🎨TIP v2: start Phase Modulated button #4365 by @odeimaiz
• 📝 add docs: how to determine if a service is legacy #4042 by @mrnicegyu11
• ⬆️ Bump Postgres minor version #4368 by @mrnicegyu11
• ✨ Frontend: Study home page #4360 by @odeimaiz
• ✨ Add check for weak passwords (small length) (⚠️ devops) #4367 by @mrnicegyu11
• Update client generation #4366 by @bisgaard-itis
• ✨ API: new DELETE /solvers/*/versions/*/jobs/* #4336 by @pcrespov
• ✨ Adds CLI to dask-sidecar service #4373 by @pcrespov
• ✨ Feature: Sticky notes #4324 by @odeimaiz
• ✨Personalized resource limits: add project nodes table to store nodes resources 🗃️ #4362 by @sanderegg
• ⚗️Computational services: pass as logs even if recognized as a progress value #4381 by @sanderegg
• ✨Personalized resources: remove projects to projects nodes table 🗃️ #4384 by @sanderegg
• Bump codecov/codecov-action from 3.1.3 to 3.1.4 #4382 by @dependabot
• 🐛 take osparc package from pypi #4388 by @bisgaard-itis
• ✨ Node previews for project homepage #4379 by @pcrespov
• ✨ Frontend: Preview page: WorkbenchPreview + Thumbnails #4378 by @odeimaiz
• 🐛 Fixes file-only study dispatcher #4387 by @pcrespov
• ✨ 🗃️ adding projects_comments DB table and API endpoints #4383 by @matusdrobuliak66
• ✨ Frontend: Study comments #4386 by @odeimaiz
• ♻️ refactor of project comments #4393 by @matusdrobuliak66
• 🐛 Fixes on studies dispatcher: file-picker download, extension mapping and study naming #4390 by @pcrespov
• 🗃️ adding minor projects comments table changes + forgotten migration #4395 by @matusdrobuliak66

No response

Devops check 👷

• Add changes (if any) and release tags in https://github.com/ITISFoundation/osparc-ops-environments/tags
• Add changes (if any) and release tags in osparc-ops-deployment-configuration (osparc.io & osparc.speag.com & tip.itis.swiss)
• ♻️ change timeout until project gets closed to 1 minute (⚠️ devops) #4349
• ✨ Add check for weak passwords (small length) (⚠️ devops) #4367
• double check INVITATION_PASSWORD (from comment below)
• DB migrations
• Restart many ops services (see comment below)
• Double check AUTOSCALING_EC2_INSTANCES_PRE_PULL_IMAGES (from comment below)
• Test Prometheus fix
• Recreate the swarm in aws-orid
• Add a new ops machine

Tests assessment: e2e testing check 🧪

No response

Test assessment: targeted-testing 🔍️

No response

Test assessment: user-testing 🧐

No response

Summary 📝

• Prepare release link

make release-prod version=1.55.0  git_sha=48d29cda9cb81c570fbd329ec560eb0c2167321a

• Draft release changelog
• Announce maintenance ( ** ANNOUNCE AT LEAST 24 HOURS BEFORE ** )
• redis {"start": "2023-06-23T07:00:00.000Z", "end": "2023-06-23T08:15:00.000Z", "reason": "Release v1.55.0"}
  • aws
  • dalco
  • tip
• status page (https://manage.statuspage.io/)
  • osparc
  • s4l
• mattermost channels
  • maintenance
  • power users

Releasing 🚀

• Maintenance page up.

cd /deployment/production/osparc-ops-environments
make up-maintenance
make down-maintenance

• Check hanging sidecars. Helper command to run in director-v2 CLI simcore-service-director-v2 close-and-save-service <uuid>
• Release by publishing draft
• Check release CI
• Check deployed
  • aws deploy
  • dalco deploy
  • tip deploy
• Check testing endpoint ex. https://testing.osparc.speag.com/
• Delete announcement
• Check e2e runs
• Announce

:tada: https://github.com/ITISFoundation/osparc-simcore/releases/tag/v1.55.0

[mrnicegyu11]

The deployment agent on aws-prod is paused since there were faulty env-vars for the invitations service. The env-vars have been adjusted manually in portainer

[mrnicegyu11]

We tried to put the fix in here, please double check upon releasing that especially the INVITATION_PASSWORD is correctly set on the service's env-vars, and not truncated after the dollar sign

https://git.speag.com/oSparc/osparc-ops-deployment-configuration/-/commit/e6828f94b150cad47034111675923fbbdc84be5f

[mrnicegyu11]

The deployment agent is paused, the faulty variable of AUTOSCALING_EC2_INSTANCES_PRE_PULL_IMAGES on the autoscaling service was corrected and is now set to

["itisfoundation/dynamic-sidecar:release-github-latest","itisfoundation/agent:release-github-latest","prom/node-exporter:v0.18.1","portainer/agent:2.13.1","docker:20.10.14-dind","caddy:2.4.5-alpine","gcr.io/cadvisor/cadvisor:v0.45.0","registry.osparc.io/simcore/services/dynamic/s4l-core-lite:2.0.106"]

I just noticed that this is not necessarily in sync with the actually used ops-containers, for example the portainer version is for sure outdated. I will open an issue about this.

[sanderegg]

The deployment agent is paused, the faulty variable of `` on the autoscaling service was corrected and is now set to

["itisfoundation/dynamic-sidecar:release-github-latest","itisfoundation/agent:release-github-latest","prom/node-exporter:v0.18.1","portainer/agent:2.13.1","docker:20.10.14-dind","caddy:2.4.5-alpine","gcr.io/cadvisor/cadvisor:v0.45.0","registry.osparc.io/simcore/services/dynamic/s4l-core-lite:2.0.106"]

I just noticed that this is not necessarily in sync with the actually used ops-containers, for example the portainer version is for sure outdated. I will open an issue about this.

@mrnicegyu11
Maybe we should just remove those ops ones. the images are not so big I think so that should not make a huge difference.

[mrnicegyu11]

The deployment agent is paused, the faulty variable of `` on the autoscaling service was corrected and is now set to

["itisfoundation/dynamic-sidecar:release-github-latest","itisfoundation/agent:release-github-latest","prom/node-exporter:v0.18.1","portainer/agent:2.13.1","docker:20.10.14-dind","caddy:2.4.5-alpine","gcr.io/cadvisor/cadvisor:v0.45.0","registry.osparc.io/simcore/services/dynamic/s4l-core-lite:2.0.106"]

I just noticed that this is not necessarily in sync with the actually used ops-containers, for example the portainer version is for sure outdated. I will open an issue about this.

@mrnicegyu11 Maybe we should just remove those ops ones. the images are not so big I think so that should not make a huge difference.

Sounds good I will put this in place on aws-prod now, we can then see how it looks/feels.

New env-var is: ["itisfoundation/dynamic-sidecar:release-github-latest","itisfoundation/agent:release-github-latest","registry.osparc.io/simcore/services/dynamic/s4l-core-lite:2.0.106"]

[mrnicegyu11]

The deployment agent is paused, the faulty variable of `` on the autoscaling service was corrected and is now set to

["itisfoundation/dynamic-sidecar:release-github-latest","itisfoundation/agent:release-github-latest","prom/node-exporter:v0.18.1","portainer/agent:2.13.1","docker:20.10.14-dind","caddy:2.4.5-alpine","gcr.io/cadvisor/cadvisor:v0.45.0","registry.osparc.io/simcore/services/dynamic/s4l-core-lite:2.0.106"]

I just noticed that this is not necessarily in sync with the actually used ops-containers, for example the portainer version is for sure outdated. I will open an issue about this.

@mrnicegyu11 Maybe we should just remove those ops ones. the images are not so big I think so that should not make a huge difference.

Sounds good I will put this in place on aws-prod now, we can then see how it looks/feels.

New env-var is: ["itisfoundation/dynamic-sidecar:release-github-latest","itisfoundation/agent:release-github-latest","registry.osparc.io/simcore/services/dynamic/s4l-core-lite:2.0.106"]

Fixed in https://git.speag.com/oSparc/osparc-ops-deployment-configuration/-/commit/6412871d2dea6caf396574689babf97910e0e1ab

[mrnicegyu11]

Please add the second ops machine:

• https://git.speag.com/oSparc/osparc-infra/-/merge_requests/138
• Add prometheus cAdvisor placement label for second prometheus osparc-ops-environments#181
• https://git.speag.com/oSparc/osparc-ops-deployment-configuration/-/commit/8976902aa11b42a6d9279631245c73e1bbe2270b

[mrnicegyu11]

Please restart the following ops-services and thus roll out the latest ops-code from osparc-ops-environments on prod:

• filestash
• jaeger
• monitoring
• registry
• (ops) traefik
• graylog
• portainer

on aws-prod, dalco-prod and tip.itis.swiss.

Grafana and Graylog Alerts need to be re-provisioned.

[mrnicegyu11]

In order for the grafana dashboard to work, the old proper hostnames (instance prometheus labels) need to be restored. Potentially a full teardown and recreation of the swarm is necessary for this.

See: ITISFoundation/osparc-ops-environments#182

[odeimaiz]

Please include this commit as hotfix

[Surfict]

• Swarm was recreated
• Some problems to start the deploy script in aws production, ticket will be created
• The pwd for invitation service was not set correctly (keeping two $), I paused the deployemnt agent in aws production and set the good password manually in the service. An issue will be created
• We need documentation about how to run the swarm recipes in Ansible for the different uses cases

[pcrespov]

• Follow up on the invitations issue: Possible improvements on invitation+registration+login workflow #1980

[matusdrobuliak66]

Invitations:

• INVITATIONS_OSPARC_URL
• INVITATIONS_PASSWORD
  were manually modified in the Portainer