Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Monterey bottling #87708

Closed
Bo98 opened this issue Oct 21, 2021 · 1,406 comments
Closed

Monterey bottling #87708

Bo98 opened this issue Oct 21, 2021 · 1,406 comments
Labels
12 Monterey is specifically affected

Comments

@Bo98
Copy link
Member

Bo98 commented Oct 21, 2021 •
edited
Loading

This is a tracking issue on Monterey bottling process and will be used as a dump for build failures.

This year we are bottling for both x86_64 and arm64. Our upload flow cannot currently handle bottling for both at the same time - please wait for one architecture to complete and be pushed to master before starting the other architecture. If you are bottling for both at the same time, pass --macos=12,12-arm64. Do not start two independent runs at the same time.

Currently, we have six x86_64 runners and three arm64 runners.

The arm64 runners are currently running 12.0.1 RC with Xcode 13.1 RC.
The x86_64 runners are also using Xcode 13.1 RC but are stuck on 12.0 beta 10 as their board ID is currently blocked from receiving further updates. I don't anticipate this will cause any issues for mass bottling however.

I will start by focussing on popular formula with a high number of dependents.

Please do not bottle something until all its dependencies have been bottled and their associated bottle commits have been pushed to master.
@Bo98 Bo98 added the 12 Monterey is specifically affected label Oct 21, 2021
@Homebrew Homebrew locked and limited conversation to collaborators Oct 21, 2021
@BrewTestBot

This comment has been minimized.

Sign in to view
@carlocab

This comment has been minimized.

Sign in to view
@Bo98

This comment has been minimized.

Sign in to view
@BrewTestBot

This comment has been minimized.

Sign in to view
@BrewTestBot

This comment has been minimized.

Sign in to view
@BrewTestBot

This comment has been minimized.

Sign in to view
@Bo98
Copy link
Member Author

Bo98 commented Oct 21, 2021

Looks like our upload flow cannot handle bottling x86_64 and arm64 at the same time.

@BrewTestBot

This comment has been minimized.

Sign in to view
@BrewTestBot

This comment has been minimized.

Sign in to view
@BrewTestBot

This comment has been minimized.

Sign in to view
@BrewTestBot

This comment has been minimized.

Sign in to view
@BrewTestBot

This comment has been minimized.

Sign in to view
@BrewTestBot

This comment has been minimized.

Sign in to view
@BrewTestBot

This comment has been minimized.

Sign in to view
@BrewTestBot

This comment has been minimized.

Sign in to view
@BrewTestBot

This comment has been minimized.

Sign in to view
@BrewTestBot

This comment has been minimized.

Sign in to view
@BrewTestBot

This comment has been minimized.

Sign in to view
1 similar comment
@BrewTestBot

This comment has been minimized.

Sign in to view
@BrewTestBot

This comment has been minimized.

Sign in to view
@BrewTestBot

This comment has been minimized.

Sign in to view
@Bo98
Copy link
Member Author

Bo98 commented Oct 21, 2021

We have a cache issue with bottle manifests. I've emptied the cache on the arm64 machines so that will cover it for now.

@BrewTestBot

This comment has been minimized.

Sign in to view
@BrewTestBot

This comment has been minimized.

Sign in to view
@BrewTestBot

This comment has been minimized.

Sign in to view
@BrewTestBot

This comment has been minimized.

Sign in to view
@BrewTestBot

This comment has been minimized.

Sign in to view
@Bo98
Copy link
Member Author

Bo98 commented Oct 21, 2021

@chenrui333 Please follow this:

This year we are bottling for both x86_64 and arm64. Our upload flow cannot currently handle bottling for both at the same time.

All of your x86_64 uploads are now stuck and retrying won't fix them.

@BrewTestBot

This comment has been minimized.

Sign in to view
@BrewTestBot

This comment has been minimized.

Sign in to view
@BrewTestBot

This comment has been minimized.

Sign in to view
@BrewTestBot

This comment has been minimized.

Sign in to view
@BrewTestBot

This comment has been minimized.

Sign in to view
@BrewTestBot
Copy link
Member

❌ @carlocab bottle request for bsponmpi failed.

@BrewTestBot
Copy link
Member

❌ @carlocab bottle request for astrometry-net failed.

@BrewTestBot
Copy link
Member

❌ @carlocab bottle request for blaze failed.

@BrewTestBot
Copy link
Member

❌ @carlocab bottle request for arrayfire failed.

@BrewTestBot
Copy link
Member

❌ @carlocab bottle request for dungeon failed.

@BrewTestBot

This comment has been minimized.

Sign in to view
@BrewTestBot
Copy link
Member

BrewTestBot commented Nov 26, 2021 •
edited by carlocab
Loading

❌ @carlocab bottle request for itpp failed. -- #include <version>

@BrewTestBot
Copy link
Member

❌ @carlocab bottle request for mpdviz failed.

@BrewTestBot
Copy link
Member

❌ @carlocab bottle request for mvtools failed.

@BrewTestBot
Copy link
Member

❌ @carlocab bottle request for nwchem failed.

@BrewTestBot
Copy link
Member

❌ @carlocab bottle request for openfast failed.

@BrewTestBot
Copy link
Member

❌ @carlocab bottle request for raxml-ng failed.

@BrewTestBot
Copy link
Member

❌ @carlocab bottle request for openmodelica failed.

@BrewTestBot
Copy link
Member

❌ @fxcoudert bottle request for percona-server failed.

@BrewTestBot
Copy link
Member

❌ @carlocab bottle request for wangle failed.

@BrewTestBot
Copy link
Member

❌ @carlocab bottle request for minimal-racket failed.

@BrewTestBot
Copy link
Member

❌ @Moisan bottle request for librsvg failed.

@cho-m
Copy link
Member

cho-m commented Apr 5, 2022

The following 68 formulae now have an all bottle added into OS-specific bottle block, which may be due to 12 and 12-arm64 generating identical bottles:

Formulae list
  • align
  • apollo
  • cash-cli
  • chruby
  • cvsutils
  • docx2txt
  • dupseek
  • easy-rsa
  • foreman
  • fpp
  • g2
  • generate-json-schema
  • ghi
  • gist
  • git-cal
  • git-integration
  • git-multipush
  • git-now
  • git-number
  • git-octopus
  • git-secrets
  • git-standup
  • git-tracker
  • gitslave
  • gnome-common
  • gpm
  • gvp
  • icon-naming-utils
  • imessage-ruby
  • jsonlint
  • kaitai-struct-compiler
  • logcheck
  • lolcat
  • markdown
  • mecab-jumandic
  • mecab-unidic
  • mergepbx
  • mkvdts2ac3
  • nanopb-generator
  • ndiff
  • onetime
  • pass-otp
  • pdf-redact-tools
  • pex
  • pipes-sh
  • pkgdiff
  • quicktype
  • range-v3
  • rcm
  • react-native-cli
  • roundup
  • rubyfmt
  • ry
  • sjk
  • sloc
  • st
  • termcolor
  • terraform_landscape
  • tesseract-lang
  • translate-shell
  • um
  • umple
  • urdfdom_headers
  • vert.x
  • vip
  • wemux
  • xbitmaps
  • zshdb

@Bo98
Copy link
Member Author

Bo98 commented Apr 5, 2022 •
edited
Loading

The following 68 formulae now have an all bottle added into OS-specific bottle block, which may be due to 12 and 12-arm64 generating identical bottles:

Easiest solution for those is to just remove that line and dispatch the bottle job again. The bug which caused this should already be fixed.

There is no need for a full rebottle - the uploaded all bottle will do no harm and just be ignored if it doesn't exist in the bottle block, and it will never exist in the future without a full rebottle.

@Bo98
Copy link
Member Author

Bo98 commented Apr 5, 2022

For clarity: it was fixed in Homebrew/brew#12384 + Homebrew/brew#12387.

@Bo98
Copy link
Member Author

Bo98 commented Oct 21, 2022

Mass bottling is over. Focus will be on Ventura shortly.

@Bo98 Bo98 closed this as completed Oct 21, 2022
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
12 Monterey is specifically affected
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
10 participants
@jonchang @Bo98 @chenrui333 @BrewTestBot @fxcoudert @alebcay @danielnachun @branchvincent @cho-m @carlocab