1-50 of 10000 results (76ms)
2023-12-14 ยง
23:17 <brett@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host acmechief1002.eqiad.wmnet with OS bookworm [production]
23:02 <brett@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on acmechief1002.eqiad.wmnet with reason: host reimage [production]
22:57 <brett@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on acmechief1002.eqiad.wmnet with reason: host reimage [production]
22:48 <brett@cumin2002> START - Cookbook sre.hosts.reimage for host acmechief1002.eqiad.wmnet with OS bookworm [production]
21:24 <ssastry@deploy2002> Finished scap: Backport for [[gerrit:982845|Revert "Temporarily disable isPreview in Parsoid's rendering"]] (duration: 10m 38s) [production]
21:18 <ssastry@deploy2002> ssastry: Continuing with sync [production]
21:14 <ssastry@deploy2002> ssastry: Backport for [[gerrit:982845|Revert "Temporarily disable isPreview in Parsoid's rendering"]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
21:13 <ssastry@deploy2002> Started scap: Backport for [[gerrit:982845|Revert "Temporarily disable isPreview in Parsoid's rendering"]] [production]
20:52 <bd808@deploy2002> helmfile [codfw] DONE helmfile.d/services/shellbox-timeline: apply [production]
20:51 <bd808@deploy2002> helmfile [codfw] START helmfile.d/services/shellbox-timeline: apply [production]
20:51 <bd808@deploy2002> helmfile [codfw] DONE helmfile.d/services/shellbox-syntaxhighlight: apply [production]
20:51 <bd808@deploy2002> helmfile [codfw] START helmfile.d/services/shellbox-syntaxhighlight: apply [production]
20:51 <bd808@deploy2002> helmfile [codfw] DONE helmfile.d/services/shellbox-media: apply [production]
20:50 <bd808@deploy2002> helmfile [codfw] START helmfile.d/services/shellbox-media: apply [production]
20:50 <bd808@deploy2002> helmfile [codfw] DONE helmfile.d/services/shellbox-constraints: apply [production]
20:50 <bd808@deploy2002> helmfile [codfw] START helmfile.d/services/shellbox-constraints: apply [production]
20:50 <bd808@deploy2002> helmfile [codfw] DONE helmfile.d/services/shellbox: apply [production]
20:49 <bd808@deploy2002> helmfile [codfw] START helmfile.d/services/shellbox: apply [production]
20:48 <bd808@deploy2002> helmfile [eqiad] DONE helmfile.d/services/shellbox-timeline: apply [production]
20:48 <bd808@deploy2002> helmfile [eqiad] START helmfile.d/services/shellbox-timeline: apply [production]
20:48 <bd808@deploy2002> helmfile [eqiad] DONE helmfile.d/services/shellbox-syntaxhighlight: apply [production]
20:47 <bd808@deploy2002> helmfile [eqiad] START helmfile.d/services/shellbox-syntaxhighlight: apply [production]
20:47 <bd808@deploy2002> helmfile [eqiad] DONE helmfile.d/services/shellbox-media: apply [production]
20:46 <bd808@deploy2002> helmfile [eqiad] START helmfile.d/services/shellbox-media: apply [production]
20:46 <bd808@deploy2002> helmfile [eqiad] DONE helmfile.d/services/shellbox-constraints: apply [production]
20:46 <bd808@deploy2002> helmfile [eqiad] START helmfile.d/services/shellbox-constraints: apply [production]
20:45 <bd808@deploy2002> helmfile [eqiad] DONE helmfile.d/services/shellbox: apply [production]
20:45 <bd808@deploy2002> helmfile [eqiad] START helmfile.d/services/shellbox: apply [production]
20:40 <ryankemper@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts wdqs[1009-1010].eqiad.wmnet [production]
20:40 <ryankemper@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
20:40 <ryankemper@cumin1001> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: wdqs[1009-1010].eqiad.wmnet decommissioned, removing all IPs except the asset tag one - ryankemper@cumin1001" [production]
20:40 <bd808@deploy2002> helmfile [staging] DONE helmfile.d/services/shellbox-timeline: apply [production]
20:39 <bd808@deploy2002> helmfile [staging] START helmfile.d/services/shellbox-timeline: apply [production]
20:39 <bd808@deploy2002> helmfile [staging] DONE helmfile.d/services/shellbox-syntaxhighlight: apply [production]
20:39 <bd808@deploy2002> helmfile [staging] START helmfile.d/services/shellbox-syntaxhighlight: apply [production]
20:39 <bd808@deploy2002> helmfile [staging] DONE helmfile.d/services/shellbox-media: apply [production]
20:38 <bd808@deploy2002> helmfile [staging] START helmfile.d/services/shellbox-media: apply [production]
20:38 <bd808@deploy2002> helmfile [staging] DONE helmfile.d/services/shellbox-constraints: apply [production]
20:38 <bd808@deploy2002> helmfile [staging] START helmfile.d/services/shellbox-constraints: apply [production]
20:38 <bd808@deploy2002> helmfile [staging] DONE helmfile.d/services/shellbox: apply [production]
20:37 <ryankemper@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: wdqs[1009-1010].eqiad.wmnet decommissioned, removing all IPs except the asset tag one - ryankemper@cumin1001" [production]
20:37 <bd808@deploy2002> helmfile [staging] START helmfile.d/services/shellbox: apply [production]
20:31 <ryankemper@cumin1001> START - Cookbook sre.dns.netbox [production]
20:23 <ryankemper@cumin1001> START - Cookbook sre.hosts.decommission for hosts wdqs[1009-1010].eqiad.wmnet [production]
20:06 <jmm@cumin1002> END (PASS) - Cookbook sre.ganeti.reboot-vm (exit_code=0) for VM moscovium.eqiad.wmnet [production]
20:02 <jmm@cumin1002> START - Cookbook sre.ganeti.reboot-vm for VM moscovium.eqiad.wmnet [production]
19:12 <brennen@deploy2002> rebuilt and synchronized wikiversions files: group2 wikis to 1.42.0-wmf.9 refs T350085 [production]
19:03 <brennen> 1.42.0-wmf.9 (T350085) status: no current blockers, although we should keep an eye on T353400. rolling to all wikis. [production]
18:35 <arnaudb@cumin1001> dbctl commit (dc=all): 'db1249 (re)pooling @ 100%: Post clone repooling', diff saved to https://phabricator.wikimedia.org/P54462 and previous config saved to /var/cache/conftool/dbconfig/20231214-183508-arnaudb.json [production]
18:35 <arnaudb@cumin1001> dbctl commit (dc=all): 'db1234 (re)pooling @ 100%: Post clone repooling', diff saved to https://phabricator.wikimedia.org/P54461 and previous config saved to /var/cache/conftool/dbconfig/20231214-183459-arnaudb.json [production]