3051-3100 of 10000 results (110ms)
2023-01-09 ยง
16:11 <jiji@cumin1001> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: mc2019.codfw.wmnet decommissioned, removing all IPs except the asset tag one - jiji@cumin1001" [production]
16:08 <jiji@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: mc2019.codfw.wmnet decommissioned, removing all IPs except the asset tag one - jiji@cumin1001" [production]
16:04 <XioNoX> start VC link maintenance in eqiad - T325803 [production]
16:03 <jiji@cumin1001> START - Cookbook sre.dns.netbox [production]
15:58 <jiji@cumin1001> START - Cookbook sre.hosts.decommission for hosts mc2019.codfw.wmnet [production]
15:37 <cgoubert@cumin1001> START - Cookbook sre.hosts.reboot-cluster [production]
15:37 <claime> Starting codfw jobrunner rolling reboot [production]
15:35 <Lucas_WMDE> UTC afternoon backport+config window done [production]
15:34 <lucaswerkmeister-wmde@deploy1002> Finished scap: Backport for [[gerrit:877139|CX: Allow composer/installers plugin]] (duration: 10m 03s) [production]
15:29 <claime> Not starting codfw jobrunner rolling reboot, deploy in progress [production]
15:28 <claime> Starting codfw jobrunner rolling reboot [production]
15:26 <lucaswerkmeister-wmde@deploy1002> lucaswerkmeister-wmde and kartik: Backport for [[gerrit:877139|CX: Allow composer/installers plugin]] synced to the testservers: mwdebug2001.codfw.wmnet, mwdebug1001.eqiad.wmnet, mwdebug2002.codfw.wmnet, mwdebug1002.eqiad.wmnet [production]
15:24 <lucaswerkmeister-wmde@deploy1002> Started scap: Backport for [[gerrit:877139|CX: Allow composer/installers plugin]] [production]
15:17 <hnowlan@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on maps2009.codfw.wmnet,maps1009.eqiad.wmnet with reason: Removing redis service [production]
15:17 <hnowlan@cumin1001> START - Cookbook sre.hosts.downtime for 1:00:00 on maps2009.codfw.wmnet,maps1009.eqiad.wmnet with reason: Removing redis service [production]
15:11 <effie> disable puppet on all 'P:mediawiki::mcrouter_wancache' hosts to merge 875894 [production]
15:09 <lucaswerkmeister-wmde@deploy1002> Finished scap: Backport for [[gerrit:876311|extwiki: Install SandboxLink extension (T326450)]] (duration: 08m 37s) [production]
15:09 <jayme@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host registry2004.codfw.wmnet [production]
15:04 <jayme@cumin1001> START - Cookbook sre.hosts.reboot-single for host registry2004.codfw.wmnet [production]
15:02 <lucaswerkmeister-wmde@deploy1002> lucaswerkmeister-wmde and stang: Backport for [[gerrit:876311|extwiki: Install SandboxLink extension (T326450)]] synced to the testservers: mwdebug2001.codfw.wmnet, mwdebug1001.eqiad.wmnet, mwdebug1002.eqiad.wmnet, mwdebug2002.codfw.wmnet [production]
15:00 <lucaswerkmeister-wmde@deploy1002> Started scap: Backport for [[gerrit:876311|extwiki: Install SandboxLink extension (T326450)]] [production]
15:00 <jayme@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host registry2003.codfw.wmnet [production]
14:59 <Lucas_WMDE> lucaswerkmeister-wmde@mwmaint1002:~$ echo 'https://en.wikipedia.org/static/images/project-logos/jawikisource.png' | mwscript purgeList.php # T326488 [production]
14:56 <lucaswerkmeister-wmde@deploy1002> Finished scap: Backport for [[gerrit:876364|jawikisource: Update project logo and wordmark (T326488)]] (duration: 09m 24s) [production]
14:55 <jayme@cumin1001> START - Cookbook sre.hosts.reboot-single for host registry2003.codfw.wmnet [production]
14:52 <jayme@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host registry1004.eqiad.wmnet [production]
14:48 <lucaswerkmeister-wmde@deploy1002> lucaswerkmeister-wmde and stang: Backport for [[gerrit:876364|jawikisource: Update project logo and wordmark (T326488)]] synced to the testservers: mwdebug2002.codfw.wmnet, mwdebug1001.eqiad.wmnet, mwdebug1002.eqiad.wmnet, mwdebug2001.codfw.wmnet [production]
14:47 <jayme@cumin1001> START - Cookbook sre.hosts.reboot-single for host registry1004.eqiad.wmnet [production]
14:47 <lucaswerkmeister-wmde@deploy1002> Started scap: Backport for [[gerrit:876364|jawikisource: Update project logo and wordmark (T326488)]] [production]
14:45 <lucaswerkmeister-wmde@deploy1002> Finished scap: Backport for [[gerrit:876310|arwiki: Create extendedmover group (T326434)]] (duration: 08m 56s) [production]
14:38 <lucaswerkmeister-wmde@deploy1002> lucaswerkmeister-wmde and stang: Backport for [[gerrit:876310|arwiki: Create extendedmover group (T326434)]] synced to the testservers: mwdebug2002.codfw.wmnet, mwdebug2001.codfw.wmnet, mwdebug1001.eqiad.wmnet, mwdebug1002.eqiad.wmnet [production]
14:36 <lucaswerkmeister-wmde@deploy1002> Started scap: Backport for [[gerrit:876310|arwiki: Create extendedmover group (T326434)]] [production]
14:31 <godog> upgrade thanos to 0.30.1 on prometheus2005 - T303154 [production]
14:27 <lucaswerkmeister-wmde@deploy1002> Finished scap: Backport for [[gerrit:871286|mediawikiwiki: Disable Flow on new pages by default (T325907)]] (duration: 18m 19s) [production]
14:19 <lucaswerkmeister-wmde@deploy1002> lucaswerkmeister-wmde and stang: Backport for [[gerrit:871286|mediawikiwiki: Disable Flow on new pages by default (T325907)]] synced to the testservers: mwdebug2002.codfw.wmnet, mwdebug1002.eqiad.wmnet, mwdebug2001.codfw.wmnet, mwdebug1001.eqiad.wmnet [production]
14:09 <lucaswerkmeister-wmde@deploy1002> Started scap: Backport for [[gerrit:871286|mediawikiwiki: Disable Flow on new pages by default (T325907)]] [production]
13:55 <moritzm> installing systemd bugfix updates from Bullseye point release [production]
13:41 <jayme@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host registry1003.eqiad.wmnet [production]
13:36 <jayme@cumin1001> START - Cookbook sre.hosts.reboot-single for host registry1003.eqiad.wmnet [production]
13:35 <cgoubert@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-cluster (exit_code=0) [production]
13:35 <jayme@cumin1001> conftool action : set/pooled=true; selector: dnsdisc=helm-charts,name=eqiad [production]
12:53 <hnowlan@deploy1002> Finished deploy [restbase/deploy@bcb0a69]: New wikis T321284 T321290 T321296 T326140 (duration: 18m 56s) [production]
12:34 <hnowlan@deploy1002> Started deploy [restbase/deploy@bcb0a69]: New wikis T321284 T321290 T321296 T326140 [production]
12:18 <vgutierrez> repool cp5025 [production]
11:41 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'configure' for AS: 15954 [production]
11:40 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'configure' for AS: 15954 [production]
11:29 <vgutierrez> restart purged on cp5025 [production]
11:28 <vgutierrez> depool cp5025 due to purging issues [production]
11:23 <jayme@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host chartmuseum1001.eqiad.wmnet [production]
11:19 <jayme@cumin1001> START - Cookbook sre.hosts.reboot-single for host chartmuseum1001.eqiad.wmnet [production]