151-200 of 10000 results (43ms)
2026-08-26 ยง
10:36 <blake@deploy1003> helmfile [eqiad] DONE helmfile.d/services/mw-api-int: apply [production]
10:35 <blake@deploy1003> helmfile [eqiad] START helmfile.d/services/mw-api-int: apply [production]
10:32 <blake@deploy1003> helmfile [codfw] DONE helmfile.d/services/mw-api-int: apply [production]
10:31 <blake@deploy1003> helmfile [codfw] START helmfile.d/services/mw-api-int: apply [production]
10:30 <blake@deploy1003> helmfile [eqiad] DONE helmfile.d/services/mw-api-ext: apply [production]
10:28 <blake@deploy1003> helmfile [eqiad] START helmfile.d/services/mw-api-ext: apply [production]
10:27 <fceratto@cumin1003> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
10:26 <blake@deploy1003> helmfile [codfw] DONE helmfile.d/services/mw-api-ext: apply [production]
10:25 <blake@deploy1003> helmfile [codfw] START helmfile.d/services/mw-api-ext: apply [production]
10:24 <fceratto@cumin1003> START - Cookbook sre.dns.netbox [production]
10:23 <blake@deploy1003> helmfile [codfw] DONE helmfile.d/services/mw-jobrunner: apply [production]
10:22 <blake@deploy1003> helmfile [codfw] START helmfile.d/services/mw-jobrunner: apply [production]
10:21 <blake@deploy1003> helmfile [eqiad] DONE helmfile.d/services/mw-jobrunner: apply [production]
10:20 <blake@deploy1003> helmfile [eqiad] START helmfile.d/services/mw-jobrunner: apply [production]
10:20 <blake@deploy1003> helmfile [eqiad] DONE helmfile.d/services/mw-misc: apply [production]
10:19 <blake@deploy1003> helmfile [eqiad] START helmfile.d/services/mw-misc: apply [production]
10:19 <blake@deploy1003> helmfile [codfw] DONE helmfile.d/services/mw-misc: apply [production]
10:19 <blake@deploy1003> helmfile [codfw] START helmfile.d/services/mw-misc: apply [production]
10:19 <blake@deploy1003> helmfile [codfw] DONE helmfile.d/services/mw-wikifunctions: apply [production]
10:18 <blake@deploy1003> helmfile [codfw] START helmfile.d/services/mw-wikifunctions: apply [production]
10:18 <blake@deploy1003> helmfile [eqiad] DONE helmfile.d/services/mw-wikifunctions: apply [production]
10:17 <blake@deploy1003> helmfile [eqiad] START helmfile.d/services/mw-wikifunctions: apply [production]
10:15 <brouberol@cumin1003> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host an-presto1010.eqiad.wmnet with OS bookworm [production]
10:07 <fceratto@cumin1003> START - Cookbook sre.dns.netbox [production]
10:05 <fceratto@cumin1003> END (FAIL) - Cookbook sre.dns.netbox (exit_code=99) [production]
10:03 <fceratto@cumin1003> START - Cookbook sre.dns.netbox [production]
10:02 <fceratto@cumin1003> START - Cookbook sre.hosts.decommission for hosts db-test2002.codfw.wmnet [production]
10:02 <fceratto@cumin1003> START - Cookbook sre.mysql.decommission [production]
09:55 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool pc1022: Pool back pc2 [production]
09:55 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.parsercache (exit_code=0) [production]
09:55 <marostegui@cumin1003> START - Cookbook sre.mysql.parsercache [production]
09:55 <marostegui@cumin1003> START - Cookbook sre.mysql.pool pool pc1022: Pool back pc2 [production]
09:55 <marostegui@cumin1003> END (FAIL) - Cookbook sre.mysql.pool (exit_code=99) pool pc1022: Pool back pc2 [production]
09:55 <marostegui@cumin1003> START - Cookbook sre.mysql.pool pool pc1022: Pool back pc2 [production]
09:55 <marostegui@cumin1003> END (FAIL) - Cookbook sre.mysql.pool (exit_code=99) pool pc1022: Pool back [production]
09:55 <marostegui@cumin1003> START - Cookbook sre.mysql.pool pool pc1022: Pool back [production]
09:47 <hashar@deploy1003> rebuilt and synchronized wikiversions files: group1 to 1.47.0-wmf.17 refs T430836 [production]
09:42 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on pc2022.codfw.wmnet,pc1022.eqiad.wmnet with reason: Working on pc2 truncation [production]
09:41 <fceratto@cumin1003> END (FAIL) - Cookbook sre.mysql.decommission (exit_code=99) [production]
09:41 <fceratto@cumin1003> END (FAIL) - Cookbook sre.hosts.decommission (exit_code=99) for hosts db-test2002.codfw.wmnet [production]
09:39 <fceratto@cumin1003> START - Cookbook sre.hosts.decommission for hosts db-test2002.codfw.wmnet [production]
09:39 <fceratto@cumin1003> START - Cookbook sre.mysql.decommission [production]
09:39 <fceratto@cumin1003> END (FAIL) - Cookbook sre.mysql.decommission (exit_code=99) [production]
09:39 <fceratto@cumin1003> END (FAIL) - Cookbook sre.hosts.decommission (exit_code=99) for hosts db-test2002.codfw.wmnet [production]
09:32 <hashar@deploy1003> Finished scap sync-world: Backport for [[gerrit:1329511|Revert "Removes unused join and refactors helper method." (T436060)]], [[gerrit:1329512|Revert "This splits the joined `wbc_entity_usage` queries into individual queries because of X1 migration." (T436060)]] (duration: 08m 13s) [production]
09:31 <fceratto@cumin1003> START - Cookbook sre.hosts.decommission for hosts db-test2002.codfw.wmnet [production]
09:31 <fceratto@cumin1003> START - Cookbook sre.mysql.decommission [production]
09:30 <fceratto@cumin1003> END (FAIL) - Cookbook sre.mysql.decommission (exit_code=99) [production]
09:30 <fceratto@cumin1003> START - Cookbook sre.mysql.decommission [production]
09:28 <hashar@deploy1003> awight, hashar: Continuing with deployment [production]