8451-8500 of 10000 results (138ms)
2024-09-16 ยง
13:39 <hashar@deploy1003> Started scap sync-world: Backport for [[gerrit:1072624|Define MW_ENTRY_POINT in static.php (T374286)]] [production]
13:37 <hashar> mwmaint: mwscript extensions/DiscussionTools/maintenance/persistRevisionThreadItems.php --wiki=sewikimedia --current --namespace 2 # T374089 [production]
13:37 <fnegri@cumin1002> START - Cookbook sre.hosts.reboot-single for host clouddb1017.eqiad.wmnet [production]
13:36 <sukhe> sudo cumin "A:cp" 'disable-puppet "merging CR 1072566"' [production]
13:36 <hashar@deploy1003> Finished scap sync-world: Backport for [[gerrit:1072848|[sewikimedia] Enable signatures in the User-namespace (T374089)]] (duration: 15m 35s) [production]
13:31 <fnegri@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on clouddb1017.eqiad.wmnet with reason: Upgrading mariadb on clouddb1017 T365424 [production]
13:31 <fnegri@cumin1002> START - Cookbook sre.hosts.downtime for 1:00:00 on clouddb1017.eqiad.wmnet with reason: Upgrading mariadb on clouddb1017 T365424 [production]
13:31 <fnegri@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on clouddb1016.eqiad.wmnet with reason: Upgrading mariadb on clouddb1017 T365424 [production]
13:30 <fnegri@cumin1002> START - Cookbook sre.hosts.downtime for 1:00:00 on clouddb1016.eqiad.wmnet with reason: Upgrading mariadb on clouddb1017 T365424 [production]
13:30 <fnegri@cumin1002> conftool action : set/pooled=no; selector: name=clouddb1017.eqiad.wmnet,service=s3 [production]
13:30 <fnegri@cumin1002> conftool action : set/pooled=no; selector: name=clouddb1017.eqiad.wmnet,service=s1 [production]
13:25 <hashar@deploy1003> gergesshamon, hashar: Continuing with sync [production]
13:25 <hashar@deploy1003> gergesshamon, hashar: Backport for [[gerrit:1072848|[sewikimedia] Enable signatures in the User-namespace (T374089)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
13:21 <hashar@deploy1003> Started scap sync-world: Backport for [[gerrit:1072848|[sewikimedia] Enable signatures in the User-namespace (T374089)]] [production]
13:20 <hashar@deploy1003> Sync cancelled. [production]
13:20 <hashar@deploy1003> hashar, gergesshamon: Backport for [[gerrit:1072848|[sewikimedia] Enable signatures in the User-namespace (T374089)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
13:14 <hashar@deploy1003> Started scap sync-world: Backport for [[gerrit:1072848|[sewikimedia] Enable signatures in the User-namespace (T374089)]] [production]
13:13 <hashar@deploy1003> Sync cancelled. [production]
13:13 <hashar@deploy1003> gergesshamon, hashar: Backport for [[gerrit:1072848|[sewikimedia] Enable signatures in the User-namespace (T374089)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
13:01 <hashar@deploy1003> Started scap sync-world: Backport for [[gerrit:1072848|[sewikimedia] Enable signatures in the User-namespace (T374089)]] [production]
12:51 <moritzm> installing node-undici security updates [production]
12:30 <kevinbazira@deploy1003> helmfile [ml-serve-codfw] 'sync' command on namespace 'recommendation-api-ng' for release 'main' . [production]
12:28 <kevinbazira@deploy1003> helmfile [ml-serve-eqiad] 'sync' command on namespace 'recommendation-api-ng' for release 'main' . [production]
12:23 <moritzm> installing glibc bugfix updates from bookworm 12.7 point release [production]
12:23 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host idp-test1004.wikimedia.org [production]
12:19 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host idp-test1004.wikimedia.org [production]
12:18 <kevinbazira@deploy1003> helmfile [ml-staging-codfw] 'sync' command on namespace 'recommendation-api-ng' for release 'main' . [production]
11:00 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.reboot-vm (exit_code=0) for VM chartmuseum1001.eqiad.wmnet [production]
10:56 <hnowlan@puppetmaster1001> conftool action : set/pooled=yes; selector: name=mw1349.eqiad.wmnet [production]
10:50 <jmm@cumin2002> START - Cookbook sre.ganeti.reboot-vm for VM chartmuseum1001.eqiad.wmnet [production]
10:50 <hnowlan@puppetmaster1001> conftool action : set/pooled=no; selector: name=mw1349.eqiad.wmnet [production]
10:33 <fnegri@cumin1002> conftool action : set/pooled=yes; selector: name=clouddb1016.eqiad.wmnet,service=s5 [production]
10:33 <fnegri@cumin1002> conftool action : set/pooled=yes; selector: name=clouddb1016.eqiad.wmnet,service=s8 [production]
10:29 <fnegri@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host clouddb1016.eqiad.wmnet [production]
10:25 <fnegri@cumin1002> START - Cookbook sre.hosts.reboot-single for host clouddb1016.eqiad.wmnet [production]
10:06 <fnegri@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on clouddb1016.eqiad.wmnet with reason: Upgrading mariadb on clouddb1016 T365424 [production]
10:06 <fnegri@cumin1002> START - Cookbook sre.hosts.downtime for 1:00:00 on clouddb1016.eqiad.wmnet with reason: Upgrading mariadb on clouddb1016 T365424 [production]
10:05 <fnegri@cumin1002> conftool action : set/pooled=no; selector: name=clouddb1016.eqiad.wmnet,service=s8 [production]
10:05 <fnegri@cumin1002> conftool action : set/pooled=no; selector: name=clouddb1016.eqiad.wmnet,service=s5 [production]
10:03 <elukey@deploy1003> Finished scap sync-world: Update network policies to allow the new poolcounter vms. (duration: 04m 35s) [production]
10:03 <fnegri@cumin1002> conftool action : set/pooled=yes; selector: name=clouddb1015.eqiad.wmnet,service=s4 [production]
10:03 <fnegri@cumin1002> conftool action : set/pooled=yes; selector: name=clouddb1015.eqiad.wmnet,service=s6 [production]
10:00 <elukey@deploy1003> Started scap sync-world: Update network policies to allow the new poolcounter vms. [production]
09:56 <elukey@puppetmaster1001> conftool action : set/pooled=true; selector: dnsdisc=helm-charts,name=codfw [production]
09:50 <fnegri@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host clouddb1015.eqiad.wmnet [production]
09:49 <elukey@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host chartmuseum2001.codfw.wmnet with OS bookworm [production]
09:47 <fnegri@cumin1002> START - Cookbook sre.hosts.reboot-single for host clouddb1015.eqiad.wmnet [production]
09:42 <elukey> upload helm3 3.11.3-2 to bookworm-wikimedia [production]
09:36 <fnegri@cumin1002> conftool action : set/pooled=no; selector: name=clouddb1015.eqiad.wmnet,service=s6 [production]
09:36 <fnegri@cumin1002> conftool action : set/pooled=no; selector: name=clouddb1015.eqiad.wmnet,service=s4 [production]