651-700 of 10000 results (81ms)
2023-10-26 §
08:07 <brouberol@cumin1001> START - Cookbook sre.hosts.reimage for host kafka-jumbo1008.eqiad.wmnet with OS bullseye [production]
08:02 <godog> restart prometheus k8s k8s-aux - T343529 [production]
07:55 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'configure' for AS: 15133 [production]
07:54 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'configure' for AS: 15133 [production]
07:36 <jelto@deploy2002> helmfile [codfw] DONE helmfile.d/services/miscweb: apply [production]
07:32 <jelto@deploy2002> helmfile [codfw] START helmfile.d/services/miscweb: apply [production]
07:31 <jelto@deploy2002> helmfile [eqiad] DONE helmfile.d/services/miscweb: apply [production]
07:23 <jelto@deploy2002> helmfile [staging] START helmfile.d/services/miscweb: apply [production]
07:21 <apergos> UTC morning backport and config window closed [production]
07:19 <kartik@deploy2002> Finished scap: Backport for [[gerrit:968649|testwiki: Enable Section translation on some Wikipedias with potential to be supported with MinT (T345267)]] (duration: 13m 11s) [production]
07:13 <kartik@deploy2002> kartik: Continuing with sync [production]
07:08 <kartik@deploy2002> kartik: Backport for [[gerrit:968649|testwiki: Enable Section translation on some Wikipedias with potential to be supported with MinT (T345267)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
07:06 <kartik@deploy2002> Started scap: Backport for [[gerrit:968649|testwiki: Enable Section translation on some Wikipedias with potential to be supported with MinT (T345267)]] [production]
06:52 <moritzm> installing openssl security updates [production]
06:40 <_joe_> rebuilding the base httpd image for mediawiki to pick up glogger changes [production]
04:31 <cstone> civicrm upgraded from 16175067 to 70e0b88d [production]
01:35 <cstone> payments-wiki upgraded from 382a5a70 to f7407053 [production]
2023-10-25 §
22:28 <jforrester@deploy2002> Finished scap: Backport for [[gerrit:968766|diff: Fix LinkRenderer method call (T349726)]] (duration: 07m 21s) [production]
22:22 <jforrester@deploy2002> jforrester and umherirrender: Continuing with sync [production]
22:22 <jforrester@deploy2002> jforrester and umherirrender: Backport for [[gerrit:968766|diff: Fix LinkRenderer method call (T349726)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
22:20 <jforrester@deploy2002> Started scap: Backport for [[gerrit:968766|diff: Fix LinkRenderer method call (T349726)]] [production]
21:01 <jforrester@deploy2002> helmfile [codfw] DONE helmfile.d/services/wikifunctions: apply [production]
21:00 <jforrester@deploy2002> helmfile [codfw] START helmfile.d/services/wikifunctions: apply [production]
21:00 <jforrester@deploy2002> helmfile [eqiad] DONE helmfile.d/services/wikifunctions: apply [production]
20:59 <jforrester@deploy2002> helmfile [eqiad] START helmfile.d/services/wikifunctions: apply [production]
20:58 <jforrester@deploy2002> helmfile [staging] DONE helmfile.d/services/wikifunctions: apply [production]
20:57 <jforrester@deploy2002> helmfile [staging] START helmfile.d/services/wikifunctions: apply [production]
20:25 <ebernhardson@deploy2002> helmfile [staging] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
20:23 <ebernhardson@deploy2002> helmfile [staging] START helmfile.d/services/cirrus-streaming-updater: apply [production]
20:20 <ejegg> payments-wiki upgraded from 7575f0e6 to 382a5a70 [production]
20:11 <ebernhardson@deploy2002> helmfile [staging] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
20:10 <ebernhardson@deploy2002> helmfile [staging] START helmfile.d/services/cirrus-streaming-updater: apply [production]
20:04 <brett@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host dns1006.wikimedia.org with OS bookworm [production]
19:57 <eevans@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts restbase1018.eqiad.wmnet [production]
19:57 <eevans@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
19:57 <eevans@cumin1001> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: restbase1018.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - eevans@cumin1001" [production]
19:56 <eevans@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: restbase1018.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - eevans@cumin1001" [production]
19:50 <eevans@cumin1001> START - Cookbook sre.dns.netbox [production]
19:44 <ebernhardson@deploy2002> helmfile [staging] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
19:44 <ebernhardson@deploy2002> helmfile [staging] START helmfile.d/services/cirrus-streaming-updater: apply [production]
19:44 <brett@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on dns1006.wikimedia.org with reason: host reimage [production]
19:41 <brett@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on dns1006.wikimedia.org with reason: host reimage [production]
19:40 <eevans@cumin1001> START - Cookbook sre.hosts.decommission for hosts restbase1018.eqiad.wmnet [production]
19:36 <eevans@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts restbase1017.eqiad.wmnet [production]
19:36 <eevans@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
19:36 <eevans@cumin1001> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: restbase1017.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - eevans@cumin1001" [production]
19:35 <eevans@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: restbase1017.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - eevans@cumin1001" [production]
19:33 <eevans@cumin1001> START - Cookbook sre.dns.netbox [production]
19:27 <brett@cumin2002> START - Cookbook sre.hosts.reimage for host dns1006.wikimedia.org with OS bookworm [production]
19:25 <eevans@cumin1001> START - Cookbook sre.hosts.decommission for hosts restbase1017.eqiad.wmnet [production]