Fix pybind11 to a specific commit on smart_holder branch #1696

Job	Run time
build (ubuntu-24.04, 3.12, OFF, OFF, OFF)	20m 5s
build (ubuntu-24.04, 3.12, OFF, OFF, OFF)	20m 5s
build (macos-14, 3.12, OFF, OFF, OFF)	13m 14s
build (macos-14, 3.12, OFF, OFF, OFF)	13m 14s
build (ubuntu-22.04, 3.11, ON, OFF, OFF)	24m 23s
build (ubuntu-22.04, 3.11, ON, OFF, OFF)	25m 8s
build (ubuntu-22.04, 3.10, ON, OFF, ON, https://github.com/google/or-tools/releases/download/v9.6...	23m 26s
build (ubuntu-22.04, 3.10, ON, OFF, ON, https://github.com/google/or-tools/releases/download/v9.6...	23m 26s
build (ubuntu-22.04, 3.10, OFF, OFF, OFF)	18m 27s
build (ubuntu-22.04, 3.10, OFF, OFF, OFF)	18m 27s
build (macos-13, 3.11, 0, OFF, OFF, OFF)	24m 41s
build (macos-13, 3.11, 0, OFF, OFF, OFF)	27m 50s
	4h 12m 26s

Provide feedback