101-150 of 10000 results (100ms)
2025-11-20 ยง
19:52 <swfrench@deploy2002> swfrench: Backport for [[gerrit:1204948|De-configure cookie-based enrollment in PHP 8.3 (T405955)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
19:48 <sukhe@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on hcaptcha-proxy6001.wikimedia.org with reason: host reimage [production]
19:47 <swfrench@deploy2002> Started scap sync-world: Backport for [[gerrit:1204948|De-configure cookie-based enrollment in PHP 8.3 (T405955)]] [production]
19:44 <sukhe@cumin1003> START - Cookbook sre.hosts.downtime for 2:00:00 on hcaptcha-proxy6002.wikimedia.org with reason: host reimage [production]
19:44 <sukhe@cumin1003> START - Cookbook sre.hosts.downtime for 2:00:00 on hcaptcha-proxy7001.wikimedia.org with reason: host reimage [production]
19:43 <sukhe@cumin1003> START - Cookbook sre.hosts.downtime for 2:00:00 on hcaptcha-proxy7002.wikimedia.org with reason: host reimage [production]
19:43 <sukhe@cumin1003> START - Cookbook sre.hosts.downtime for 2:00:00 on hcaptcha-proxy6001.wikimedia.org with reason: host reimage [production]
19:37 <sukhe> sudo cumin 'A:lvs-eqiad or A:lvs-codfw' 'run-puppet-agent --enable "set druid-coordinator to state lvs_setup"' [production]
19:35 <sukhe> sukhe@lvs1020:~$ sudo systemctl restart pybal.service [production]
19:29 <sukhe@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host hcaptcha-proxy5002.wikimedia.org with OS bookworm [production]
19:24 <sukhe@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host hcaptcha-proxy5001.wikimedia.org with OS bookworm [production]
19:16 <sukhe@cumin1003> START - Cookbook sre.hosts.reimage for host hcaptcha-proxy7002.wikimedia.org with OS bookworm [production]
19:16 <sukhe@cumin1003> START - Cookbook sre.hosts.reimage for host hcaptcha-proxy7001.wikimedia.org with OS bookworm [production]
19:16 <brennen@deploy2002> rebuilt and synchronized wikiversions files: group2 to 1.46.0-wmf.3 refs T408273 [production]
19:16 <sukhe@cumin1003> START - Cookbook sre.hosts.reimage for host hcaptcha-proxy6002.wikimedia.org with OS bookworm [production]
19:16 <sukhe@cumin1003> START - Cookbook sre.hosts.reimage for host hcaptcha-proxy6001.wikimedia.org with OS bookworm [production]
19:08 <sukhe@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host hcaptcha-proxy4002.wikimedia.org with OS bookworm [production]
19:07 <sukhe@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on hcaptcha-proxy5002.wikimedia.org with reason: host reimage [production]
19:04 <brennen> 1.46.0-wmf.3 train status (T408273): no current blockers, rolling to all wikis [production]
19:04 <sukhe@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host hcaptcha-proxy3001.wikimedia.org with OS bookworm [production]
19:03 <sukhe@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on hcaptcha-proxy5001.wikimedia.org with reason: host reimage [production]
19:02 <sukhe@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host hcaptcha-proxy3002.wikimedia.org with OS bookworm [production]
19:00 <sukhe@cumin1003> START - Cookbook sre.hosts.downtime for 2:00:00 on hcaptcha-proxy5002.wikimedia.org with reason: host reimage [production]
19:00 <sukhe@cumin1003> START - Cookbook sre.hosts.downtime for 2:00:00 on hcaptcha-proxy5001.wikimedia.org with reason: host reimage [production]
18:59 <sukhe@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host hcaptcha-proxy4001.wikimedia.org with OS bookworm [production]
18:49 <sukhe@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on hcaptcha-proxy4002.wikimedia.org with reason: host reimage [production]
18:46 <sukhe@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on hcaptcha-proxy3001.wikimedia.org with reason: host reimage [production]
18:44 <sukhe@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on hcaptcha-proxy3002.wikimedia.org with reason: host reimage [production]
18:39 <sukhe@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on hcaptcha-proxy4001.wikimedia.org with reason: host reimage [production]
18:34 <swfrench@deploy2002> Finished scap sync-world: Normal scap run after switching scap mwscript to PHP 8.3 - T405955 (duration: 05m 34s) [production]
18:34 <sukhe@cumin1003> START - Cookbook sre.hosts.downtime for 2:00:00 on hcaptcha-proxy3001.wikimedia.org with reason: host reimage [production]
18:33 <sukhe@cumin1003> START - Cookbook sre.hosts.downtime for 2:00:00 on hcaptcha-proxy4002.wikimedia.org with reason: host reimage [production]
18:33 <sukhe@cumin1003> START - Cookbook sre.hosts.downtime for 2:00:00 on hcaptcha-proxy3002.wikimedia.org with reason: host reimage [production]
18:33 <sukhe@cumin1003> START - Cookbook sre.hosts.downtime for 2:00:00 on hcaptcha-proxy4001.wikimedia.org with reason: host reimage [production]
18:28 <swfrench@deploy2002> Started scap sync-world: Normal scap run after switching scap mwscript to PHP 8.3 - T405955 [production]
18:27 <swfrench@deploy2002> Stopping before sync operations [production]
18:27 <sukhe> sukhe@lvs1020:~$ sudo systemctl restart pybal.service: T406222 [production]
18:26 <swfrench@deploy2002> Started scap sync-world: No-deployment scap run after switching scap mwscript to PHP 8.3 - T405955 [production]
18:24 <swfrench@deploy2002> Installation of scap version "4.228.0" completed for 2 hosts [production]
18:22 <swfrench@deploy2002> Installing scap version "4.228.0" for 2 host(s) [production]
18:21 <sukhe> sudo cumin 'A:lvs-eqiad or A:lvs-codfw' 'disable-puppet "set druid-coordinator to state lvs_setup"' [production]
18:18 <urbanecm@deploy2002> Finished scap sync-world: Backport for [[gerrit:1207920|hotfix: Disable Urdu alias for Special:Homepage (T410666)]], [[gerrit:1207919|hotfix: Disable Urdu alias for Special:Homepage (T410666)]] (duration: 41m 57s) [production]
18:14 <sukhe@cumin1003> START - Cookbook sre.hosts.reimage for host hcaptcha-proxy5002.wikimedia.org with OS bookworm [production]
18:13 <sukhe@cumin1003> START - Cookbook sre.hosts.reimage for host hcaptcha-proxy5001.wikimedia.org with OS bookworm [production]
18:11 <sukhe@cumin1003> START - Cookbook sre.hosts.reimage for host hcaptcha-proxy4002.wikimedia.org with OS bookworm [production]
18:09 <sukhe@cumin1003> START - Cookbook sre.hosts.reimage for host hcaptcha-proxy4001.wikimedia.org with OS bookworm [production]
18:09 <sukhe@cumin1003> START - Cookbook sre.hosts.reimage for host hcaptcha-proxy3002.wikimedia.org with OS bookworm [production]
18:08 <sukhe@cumin1003> START - Cookbook sre.hosts.reimage for host hcaptcha-proxy3001.wikimedia.org with OS bookworm [production]
18:05 <urbanecm@deploy2002> urbanecm: Continuing with sync [production]
18:04 <urbanecm@deploy2002> urbanecm: Backport for [[gerrit:1207920|hotfix: Disable Urdu alias for Special:Homepage (T410666)]], [[gerrit:1207919|hotfix: Disable Urdu alias for Special:Homepage (T410666)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]