|
2026-07-08
§
|
| 08:06 |
<ayounsi@cumin1003> |
END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool es2051: codfw rack B3 depool for maintenance |
[production] |
| 08:05 |
<ayounsi@cumin1003> |
START - Cookbook sre.mysql.depool depool es2051: codfw rack B3 depool for maintenance |
[production] |
| 08:05 |
<mvernon@cumin2003> |
START - Cookbook sre.hosts.reimage for host thanos-fe1004.eqiad.wmnet with OS trixie |
[production] |
| 08:03 |
<mvernon@cumin2003> |
END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host thanos-fe1005.eqiad.wmnet with OS trixie |
[production] |
| 08:03 |
<ayounsi@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on 21 hosts with reason: codfw rack B3 depool for maintenance |
[production] |
| 07:56 |
<ayounsi@cumin1003> |
START - Cookbook sre.network.depool-rack with action 'depool' for codfw rack B3 |
[production] |
| 07:44 |
<mvernon@cumin2003> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on thanos-fe1005.eqiad.wmnet with reason: host reimage |
[production] |
| 07:38 |
<mvernon@cumin2003> |
START - Cookbook sre.hosts.downtime for 2:00:00 on thanos-fe1005.eqiad.wmnet with reason: host reimage |
[production] |
| 07:36 |
<elukey@cumin1003> |
END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host aux-k8s-etcd1005.eqiad.wmnet with OS bookworm |
[production] |
| 07:29 |
<moritzm> |
installing gnutls28 security updates |
[production] |
| 07:21 |
<mvernon@cumin2003> |
START - Cookbook sre.hosts.reimage for host thanos-fe1005.eqiad.wmnet with OS trixie |
[production] |
| 07:13 |
<ryankemper@cumin2002> |
END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cirrussearch1125.eqiad.wmnet with OS trixie |
[production] |
| 07:13 |
<elukey@cumin1003> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on aux-k8s-etcd1005.eqiad.wmnet with reason: host reimage |
[production] |
| 07:07 |
<elukey@cumin1003> |
START - Cookbook sre.hosts.downtime for 2:00:00 on aux-k8s-etcd1005.eqiad.wmnet with reason: host reimage |
[production] |
| 06:56 |
<elukey@cumin1003> |
START - Cookbook sre.hosts.reimage for host aux-k8s-etcd1005.eqiad.wmnet with OS bookworm |
[production] |
| 06:54 |
<ryankemper@cumin2002> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cirrussearch1125.eqiad.wmnet with reason: host reimage |
[production] |
| 06:52 |
<elukey> |
upgrade all trixie hosts to pywmflib 3.1 - T430552 |
[production] |
| 06:50 |
<ryankemper@cumin2002> |
START - Cookbook sre.hosts.downtime for 2:00:00 on cirrussearch1125.eqiad.wmnet with reason: host reimage |
[production] |
| 06:40 |
<elukey@cumin1003> |
END (PASS) - Cookbook sre.hosts.bmc-user-mgmt (exit_code=0) for host cirrussearch1111.eqiad.wmnet |
[production] |
| 06:40 |
<elukey@cumin1003> |
START - Cookbook sre.hosts.bmc-user-mgmt for host cirrussearch1111.eqiad.wmnet |
[production] |
| 06:38 |
<ryankemper@cumin2002> |
START - Cookbook sre.hosts.reimage for host cirrussearch1125.eqiad.wmnet with OS trixie |
[production] |
| 05:42 |
<ryankemper@cumin2002> |
END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cirrussearch1107.eqiad.wmnet with OS trixie |
[production] |
| 05:35 |
<ryankemper@cumin2002> |
END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cirrussearch1124.eqiad.wmnet with OS trixie |
[production] |
| 05:31 |
<ryankemper@cumin2002> |
END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cirrussearch1101.eqiad.wmnet with OS trixie |
[production] |
| 05:21 |
<ryankemper@cumin2002> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cirrussearch1107.eqiad.wmnet with reason: host reimage |
[production] |
| 05:17 |
<ryankemper@cumin2002> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cirrussearch1124.eqiad.wmnet with reason: host reimage |
[production] |
| 05:13 |
<ryankemper@cumin2002> |
START - Cookbook sre.hosts.downtime for 2:00:00 on cirrussearch1107.eqiad.wmnet with reason: host reimage |
[production] |
| 05:13 |
<ryankemper@cumin2002> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cirrussearch1101.eqiad.wmnet with reason: host reimage |
[production] |
| 05:11 |
<ryankemper@cumin2002> |
START - Cookbook sre.hosts.downtime for 2:00:00 on cirrussearch1124.eqiad.wmnet with reason: host reimage |
[production] |
| 05:10 |
<ryankemper@cumin2002> |
START - Cookbook sre.hosts.downtime for 2:00:00 on cirrussearch1101.eqiad.wmnet with reason: host reimage |
[production] |
| 04:58 |
<ryankemper@cumin2002> |
START - Cookbook sre.hosts.reimage for host cirrussearch1124.eqiad.wmnet with OS trixie |
[production] |
| 04:56 |
<ryankemper@cumin2002> |
START - Cookbook sre.hosts.reimage for host cirrussearch1107.eqiad.wmnet with OS trixie |
[production] |
| 04:55 |
<ryankemper@cumin2002> |
START - Cookbook sre.hosts.reimage for host cirrussearch1101.eqiad.wmnet with OS trixie |
[production] |
| 02:27 |
<ladsgroup@deploy1003> |
Finished scap sync-world: Backport for [[gerrit:1308251|Activate minwikiquote (T429922)]] (duration: 08m 14s) |
[production] |
| 02:22 |
<ladsgroup@deploy1003> |
ladsgroup: Continuing with deployment |
[production] |
| 02:21 |
<ladsgroup@deploy1003> |
ladsgroup: Backport for [[gerrit:1308251|Activate minwikiquote (T429922)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. |
[production] |
| 02:19 |
<ladsgroup@deploy1003> |
Started scap sync-world: Backport for [[gerrit:1308251|Activate minwikiquote (T429922)]] |
[production] |
| 01:59 |
<ladsgroup@deploy1003> |
Finished scap sync-world: Backport for [[gerrit:1308250|Init minwikiquote (T429922)]] (duration: 09m 46s) |
[production] |
| 01:55 |
<ladsgroup@deploy1003> |
ladsgroup: Continuing with deployment |
[production] |
| 01:51 |
<ladsgroup@deploy1003> |
ladsgroup: Backport for [[gerrit:1308250|Init minwikiquote (T429922)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. |
[production] |
| 01:49 |
<ladsgroup@deploy1003> |
Started scap sync-world: Backport for [[gerrit:1308250|Init minwikiquote (T429922)]] |
[production] |
| 01:03 |
<bking@cumin2003> |
END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cirrussearch1099.eqiad.wmnet with OS trixie |
[production] |
| 00:57 |
<bking@cumin2003> |
END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cirrussearch1110.eqiad.wmnet with OS trixie |
[production] |
| 00:44 |
<bking@cumin2003> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cirrussearch1099.eqiad.wmnet with reason: host reimage |
[production] |
| 00:41 |
<bking@cumin2003> |
START - Cookbook sre.hosts.downtime for 2:00:00 on cirrussearch1099.eqiad.wmnet with reason: host reimage |
[production] |
| 00:38 |
<bking@cumin2003> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cirrussearch1110.eqiad.wmnet with reason: host reimage |
[production] |
| 00:32 |
<bking@cumin2003> |
START - Cookbook sre.hosts.downtime for 2:00:00 on cirrussearch1110.eqiad.wmnet with reason: host reimage |
[production] |
| 00:26 |
<bking@cumin2003> |
START - Cookbook sre.hosts.reimage for host cirrussearch1099.eqiad.wmnet with OS trixie |
[production] |
| 00:15 |
<bking@cumin2003> |
START - Cookbook sre.hosts.reimage for host cirrussearch1110.eqiad.wmnet with OS trixie |
[production] |