1-50 of 10000 results (5ms)
2026-09-02 §
04:53 <tstarling@deploy1003> tstarling: Continuing with deployment [production]
04:29 <tstarling@deploy1003> tstarling: Backport for [[gerrit:1333470|Updater: Normalize MW_VERSION (T436741)]], [[gerrit:1333423|Set a short CC:max-age on cacheable REST responses]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
04:24 <tstarling@deploy1003> Started scap sync-world: Backport for [[gerrit:1333470|Updater: Normalize MW_VERSION (T436741)]], [[gerrit:1333423|Set a short CC:max-age on cacheable REST responses]] [production]
02:14 <Krinkle> Switch cvn.wmflabs.org and cvn.wmcloud.org web proxy from cvn-apache11 to cvn-apache12, ref T395164 [cvn]
02:08 <mwpresync@deploy1003> Finished scap build-images: Publishing wmf/next image (duration: 07m 43s) [production]
02:00 <mwpresync@deploy1003> Started scap build-images: Publishing wmf/next image [production]
2026-09-01 §
23:56 <eileen> * civicrm upgraded from 1871f4c7 to f4f09304 [fundraising]
21:59 <jdlrobson@deploy1003> Finished scap sync-world: Backport for [[gerrit:1333294|Merge branch 'master' into wmf_deploy]] (duration: 18m 05s) [production]
21:52 <jdlrobson@deploy1003> jdlrobson: Continuing with deployment [production]
21:47 <jdlrobson@deploy1003> jdlrobson: Backport for [[gerrit:1333294|Merge branch 'master' into wmf_deploy]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
21:45 <Southparkfan> hiera: switch ATS routing for performance.beta.wmcloud.org from webperf21 to webperf31 - T436464 [deployment-prep]
21:45 <Southparkfan> hiera: switch ATS routing for performance.beta.wmcloud.org from webperf21 to webperf31 - T436464 [releng]
21:41 <jdlrobson@deploy1003> Started scap sync-world: Backport for [[gerrit:1333294|Merge branch 'master' into wmf_deploy]] [production]
21:38 <jdlrobson@deploy1003> Finished scap sync-world: Backport for [[gerrit:1333293|Merge branch 'master' into wmf_deploy]], [[gerrit:1333277|Preserve showlogin query parameter on redirects (T435248)]] (duration: 23m 55s) [production]
21:28 <jdlrobson@deploy1003> jdlrobson: Continuing with deployment [production]
21:20 <jdlrobson@deploy1003> jdlrobson: Backport for [[gerrit:1333293|Merge branch 'master' into wmf_deploy]], [[gerrit:1333277|Preserve showlogin query parameter on redirects (T435248)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
21:14 <jdlrobson@deploy1003> Started scap sync-world: Backport for [[gerrit:1333293|Merge branch 'master' into wmf_deploy]], [[gerrit:1333277|Preserve showlogin query parameter on redirects (T435248)]] [production]
20:55 <Southparkfan> decommission deployment-webperf22 - T436464 [releng]
20:55 <Southparkfan> decommission deployment-webperf22 - T436464 [deployment-prep]
20:52 <Southparkfan> https://gerrit.wikimedia.org/r/c/operations/puppet/+/1333288 cherry-picked on project puppetserver - T436464 [deployment-prep]
20:52 <Southparkfan> https://gerrit.wikimedia.org/r/c/operations/puppet/+/1333288 cherry-picked on project puppetserver - T436464 [releng]
20:47 <eevans@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host aqs1016.eqiad.wmnet with OS bookworm [production]
20:28 <eevans@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on aqs1016.eqiad.wmnet with reason: host reimage [production]
20:24 <eevans@cumin1003> START - Cookbook sre.hosts.downtime for 2:00:00 on aqs1016.eqiad.wmnet with reason: host reimage [production]
20:11 <eevans@cumin1003> START - Cookbook sre.hosts.reimage for host aqs1016.eqiad.wmnet with OS bookworm [production]
20:11 <eevans@cumin1003> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host aqs1016.eqiad.wmnet with OS bookworm [production]
19:59 <Southparkfan> decommission deployment-webperf32 - T436464 [deployment-prep]
19:59 <Southparkfan> decommission deployment-webperf32 - T436464 [releng]
19:57 <jclark@cumin1003> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host cloudcephosd1055.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
19:57 <eevans@cumin1003> START - Cookbook sre.hosts.reimage for host aqs1016.eqiad.wmnet with OS bookworm [production]
19:56 <eevans@cumin1003> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host aqs1016.eqiad.wmnet with OS bookworm [production]
19:56 <jclark@cumin1003> START - Cookbook sre.hosts.provision for host cloudcephosd1055.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
19:56 <jclark@cumin1003> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host cloudcephosd1056.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
19:54 <jclark@cumin1003> START - Cookbook sre.hosts.provision for host cloudcephosd1056.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
19:54 <wm-bot2> Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/33551856122 (https://github.com/cluebotng/component-configs/commits/0c6ef4655c137d241bf31075ef088ea0dc85c8a3) [tools.cluebotng]
19:53 <wm-bot2> Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/33551856145 (https://github.com/cluebotng/component-configs/commits/0c6ef4655c137d241bf31075ef088ea0dc85c8a3) [tools.cluebotng-staging]
19:52 <jclark@cumin1003> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host cloudcephosd1056.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
19:47 <jclark@cumin1003> START - Cookbook sre.hosts.provision for host cloudcephosd1056.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
19:45 <eevans@cumin1003> START - Cookbook sre.hosts.reimage for host aqs1016.eqiad.wmnet with OS bookworm [production]
19:42 <eevans@cumin1003> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host aqs1016.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL [production]
19:41 <jhancock@cumin1003> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host cloudcephosd1055.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
19:40 <eevans@cumin1003> START - Cookbook sre.hosts.provision for host aqs1016.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL [production]
19:39 <eevans@cumin1003> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host aqs1016.eqiad.wmnet with OS bookworm [production]
19:35 <jhancock@cumin1003> START - Cookbook sre.hosts.provision for host cloudcephosd1055.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
19:32 <jhancock@cumin1003> END (FAIL) - Cookbook sre.network.configure-switch-interfaces (exit_code=99) for host cloudcephosd1055 [production]
19:32 <jhancock@cumin1003> START - Cookbook sre.network.configure-switch-interfaces for host cloudcephosd1055 [production]
19:30 <cdobbins@cumin1003> conftool action : set/pooled=yes; selector: name=cp5022.* [reason: update IP addrs] [production]
19:30 <cdobbins@cumin1003> END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for cp5022.eqsin.wmnet [production]
19:30 <cdobbins@cumin1003> START - Cookbook sre.hosts.remove-downtime for cp5022.eqsin.wmnet [production]
19:25 <jclark@cumin1003> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host cloudcephosd1055.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]