9301-9350 of 10000 results (138ms)
2024-09-16 ยง
14:00 <fnegri@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host clouddb1018.eqiad.wmnet [production]
13:59 <hashar@deploy1003> matmarex, hashar: Continuing with sync [production]
13:58 <hashar@deploy1003> matmarex, hashar: Backport for [[gerrit:1072207|logging: Default to log any error (on group0) (T228838)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
13:57 <fnegri@cumin1002> START - Cookbook sre.hosts.reboot-single for host clouddb1018.eqiad.wmnet [production]
13:56 <hashar@deploy1003> Started scap sync-world: Backport for [[gerrit:1072207|logging: Default to log any error (on group0) (T228838)]] [production]
13:50 <fnegri@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on clouddb1018.eqiad.wmnet with reason: Upgrading mariadb on clouddb1018 T365424 [production]
13:50 <fnegri@cumin1002> START - Cookbook sre.hosts.downtime for 1:00:00 on clouddb1018.eqiad.wmnet with reason: Upgrading mariadb on clouddb1018 T365424 [production]
13:49 <fnegri@cumin1002> conftool action : set/pooled=no; selector: name=clouddb1018.eqiad.wmnet,service=s7 [production]
13:49 <fnegri@cumin1002> conftool action : set/pooled=no; selector: name=clouddb1018.eqiad.wmnet,service=s2 [production]
13:49 <hashar@deploy1003> Finished scap sync-world: Backport for [[gerrit:1072624|Define MW_ENTRY_POINT in static.php (T374286)]] (duration: 10m 03s) [production]
13:48 <fnegri@cumin1002> conftool action : set/pooled=yes; selector: name=clouddb1017.eqiad.wmnet,service=s1 [production]
13:48 <fnegri@cumin1002> conftool action : set/pooled=yes; selector: name=clouddb1017.eqiad.wmnet,service=s3 [production]
13:48 <sukhe> sudo cumin -b11 "A:cp" 'run-puppet-agent --enable "merging CR 1072566"' [production]
13:47 <sukhe@puppetmaster1001> conftool action : set/pooled=yes; selector: name=cp4052.ulsfo.wmnet [reason: [done] testing NOOP CR but depooling to be extra sure] [production]
13:43 <hashar@deploy1003> hashar, matmarex: Continuing with sync [production]
13:43 <hashar@deploy1003> hashar, matmarex: Backport for [[gerrit:1072624|Define MW_ENTRY_POINT in static.php (T374286)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
13:42 <sukhe@puppetmaster1001> conftool action : set/pooled=no; selector: name=cp4052.ulsfo.wmnet [reason: testing NOOP CR but depooling to be extra sure] [production]
13:40 <fnegri@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host clouddb1017.eqiad.wmnet [production]
13:39 <hashar@deploy1003> Started scap sync-world: Backport for [[gerrit:1072624|Define MW_ENTRY_POINT in static.php (T374286)]] [production]
13:37 <hashar> mwmaint: mwscript extensions/DiscussionTools/maintenance/persistRevisionThreadItems.php --wiki=sewikimedia --current --namespace 2 # T374089 [production]
13:37 <fnegri@cumin1002> START - Cookbook sre.hosts.reboot-single for host clouddb1017.eqiad.wmnet [production]
13:36 <sukhe> sudo cumin "A:cp" 'disable-puppet "merging CR 1072566"' [production]
13:36 <hashar@deploy1003> Finished scap sync-world: Backport for [[gerrit:1072848|[sewikimedia] Enable signatures in the User-namespace (T374089)]] (duration: 15m 35s) [production]
13:31 <fnegri@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on clouddb1017.eqiad.wmnet with reason: Upgrading mariadb on clouddb1017 T365424 [production]
13:31 <fnegri@cumin1002> START - Cookbook sre.hosts.downtime for 1:00:00 on clouddb1017.eqiad.wmnet with reason: Upgrading mariadb on clouddb1017 T365424 [production]
13:31 <fnegri@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on clouddb1016.eqiad.wmnet with reason: Upgrading mariadb on clouddb1017 T365424 [production]
13:30 <fnegri@cumin1002> START - Cookbook sre.hosts.downtime for 1:00:00 on clouddb1016.eqiad.wmnet with reason: Upgrading mariadb on clouddb1017 T365424 [production]
13:30 <fnegri@cumin1002> conftool action : set/pooled=no; selector: name=clouddb1017.eqiad.wmnet,service=s3 [production]
13:30 <fnegri@cumin1002> conftool action : set/pooled=no; selector: name=clouddb1017.eqiad.wmnet,service=s1 [production]
13:25 <hashar@deploy1003> gergesshamon, hashar: Continuing with sync [production]
13:25 <hashar@deploy1003> gergesshamon, hashar: Backport for [[gerrit:1072848|[sewikimedia] Enable signatures in the User-namespace (T374089)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
13:21 <hashar@deploy1003> Started scap sync-world: Backport for [[gerrit:1072848|[sewikimedia] Enable signatures in the User-namespace (T374089)]] [production]
13:20 <hashar@deploy1003> Sync cancelled. [production]
13:20 <hashar@deploy1003> hashar, gergesshamon: Backport for [[gerrit:1072848|[sewikimedia] Enable signatures in the User-namespace (T374089)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
13:14 <hashar@deploy1003> Started scap sync-world: Backport for [[gerrit:1072848|[sewikimedia] Enable signatures in the User-namespace (T374089)]] [production]
13:13 <hashar@deploy1003> Sync cancelled. [production]
13:13 <hashar@deploy1003> gergesshamon, hashar: Backport for [[gerrit:1072848|[sewikimedia] Enable signatures in the User-namespace (T374089)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
13:01 <hashar@deploy1003> Started scap sync-world: Backport for [[gerrit:1072848|[sewikimedia] Enable signatures in the User-namespace (T374089)]] [production]
12:51 <moritzm> installing node-undici security updates [production]
12:30 <kevinbazira@deploy1003> helmfile [ml-serve-codfw] 'sync' command on namespace 'recommendation-api-ng' for release 'main' . [production]
12:28 <kevinbazira@deploy1003> helmfile [ml-serve-eqiad] 'sync' command on namespace 'recommendation-api-ng' for release 'main' . [production]
12:23 <moritzm> installing glibc bugfix updates from bookworm 12.7 point release [production]
12:23 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host idp-test1004.wikimedia.org [production]
12:19 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host idp-test1004.wikimedia.org [production]
12:18 <kevinbazira@deploy1003> helmfile [ml-staging-codfw] 'sync' command on namespace 'recommendation-api-ng' for release 'main' . [production]
11:00 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.reboot-vm (exit_code=0) for VM chartmuseum1001.eqiad.wmnet [production]
10:56 <hnowlan@puppetmaster1001> conftool action : set/pooled=yes; selector: name=mw1349.eqiad.wmnet [production]
10:50 <jmm@cumin2002> START - Cookbook sre.ganeti.reboot-vm for VM chartmuseum1001.eqiad.wmnet [production]
10:50 <hnowlan@puppetmaster1001> conftool action : set/pooled=no; selector: name=mw1349.eqiad.wmnet [production]
10:33 <fnegri@cumin1002> conftool action : set/pooled=yes; selector: name=clouddb1016.eqiad.wmnet,service=s5 [production]