5001-5050 of 10000 results (145ms)
2024-10-30 ยง
18:40 <dduvall@deploy2002> Finished scap sync-world: Backport for [[gerrit:1084759|Revert "Use array instead of string for class list" (T378531)]] (duration: 19m 04s) [production]
18:39 <inflatador> bking@stat1008,stat1009,stat1010.mgmt racadm jobqueue delete -i $job T376813 [production]
18:36 <fnegri@cumin1002> END (PASS) - Cookbook sre.wikireplicas.add-wiki (exit_code=0) for database nrwiki (T375101) [production]
18:35 <dduvall@deploy2002> ammarpad, dduvall: Continuing with sync [production]
18:35 <dduvall> error is still occurring following backport deployment of https://gerrit.wikimedia.org/r/c/mediawiki/skins/MinervaNeue/+/1084759 (T378531) [production]
18:27 <dduvall> monitoring testwiki error rates for a few minutes to see if the error related to T378531 subsides (current rate is 23 errors in the last 15 minutes) [production]
18:23 <dduvall@deploy2002> ammarpad, dduvall: Backport for [[gerrit:1084759|Revert "Use array instead of string for class list" (T378531)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
18:21 <dduvall@deploy2002> Started scap sync-world: Backport for [[gerrit:1084759|Revert "Use array instead of string for class list" (T378531)]] [production]
18:10 <fnegri@cumin1002> START - Cookbook sre.wikireplicas.add-wiki for database nrwiki (T375101) [production]
17:35 <fnegri@cumin1002> conftool action : set/pooled=yes; selector: name=clouddb1017.eqiad.wmnet,service=s3 [production]
17:35 <fnegri@cumin1002> conftool action : set/pooled=yes; selector: name=clouddb1017.eqiad.wmnet,service=s1 [production]
17:31 <fnegri@cumin1002> conftool action : set/pooled=no; selector: name=clouddb1017.eqiad.wmnet,service=s3 [production]
17:26 <fnegri@cumin1002> conftool action : set/pooled=no; selector: name=clouddb1017.eqiad.wmnet,service=s1 [production]
17:24 <fnegri@cumin1002> conftool action : set/pooled=yes; selector: name=clouddb1018.eqiad.wmnet,service=s7 [production]
17:23 <fnegri@cumin1002> conftool action : set/pooled=no; selector: name=clouddb1018.eqiad.wmnet,service=s7 [production]
17:21 <fnegri@cumin1002> conftool action : set/pooled=yes; selector: name=clouddb1019.eqiad.wmnet,service=s6 [production]
17:21 <fnegri@cumin1002> conftool action : set/pooled=yes; selector: name=clouddb1019.eqiad.wmnet,service=s4 [production]
17:20 <fnegri@cumin1002> conftool action : set/pooled=no; selector: name=clouddb1019.eqiad.wmnet,service=s6 [production]
17:20 <fnegri@cumin1002> conftool action : set/pooled=no; selector: name=clouddb1019.eqiad.wmnet,service=s4 [production]
17:19 <fnegri@cumin1002> conftool action : set/pooled=yes; selector: name=clouddb1020.eqiad.wmnet,service=s5 [production]
17:18 <fnegri@cumin1002> conftool action : set/pooled=yes; selector: name=clouddb1020.eqiad.wmnet,service=s8 [production]
17:11 <fnegri@cumin1002> conftool action : set/pooled=no; selector: name=clouddb1020.eqiad.wmnet,service=s8 [production]
17:11 <fnegri@cumin1002> conftool action : set/pooled=no; selector: name=clouddb1020.eqiad.wmnet,service=s5 [production]
17:03 <swfrench@deploy2002> helmfile [eqiad] DONE helmfile.d/services/shellbox-constraints: apply [production]
17:03 <swfrench@deploy2002> helmfile [eqiad] START helmfile.d/services/shellbox-constraints: apply [production]
17:01 <swfrench@deploy2002> helmfile [eqiad] DONE helmfile.d/services/shellbox-video: apply [production]
17:00 <swfrench@deploy2002> helmfile [eqiad] START helmfile.d/services/shellbox-video: apply [production]
16:59 <swfrench@deploy2002> helmfile [eqiad] DONE helmfile.d/services/shellbox-timeline: apply [production]
16:58 <swfrench@deploy2002> helmfile [eqiad] START helmfile.d/services/shellbox-timeline: apply [production]
16:58 <swfrench@deploy2002> helmfile [eqiad] DONE helmfile.d/services/shellbox-media: apply [production]
16:57 <swfrench@deploy2002> helmfile [eqiad] START helmfile.d/services/shellbox-media: apply [production]
16:54 <swfrench@deploy2002> helmfile [eqiad] DONE helmfile.d/services/shellbox: apply [production]
16:53 <swfrench@deploy2002> helmfile [eqiad] START helmfile.d/services/shellbox: apply [production]
16:44 <stevemunene@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host an-presto1017.eqiad.wmnet with OS bullseye [production]
16:39 <swfrench@deploy2002> helmfile [staging] DONE helmfile.d/services/shellbox-video: apply [production]
16:39 <swfrench@deploy2002> helmfile [staging] START helmfile.d/services/shellbox-video: apply [production]
16:39 <swfrench@deploy2002> helmfile [staging] DONE helmfile.d/services/shellbox-timeline: apply [production]
16:39 <elukey@cumin1002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ganeti1052.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART [production]
16:38 <swfrench@deploy2002> helmfile [staging] START helmfile.d/services/shellbox-timeline: apply [production]
16:38 <swfrench@deploy2002> helmfile [staging] DONE helmfile.d/services/shellbox-syntaxhighlight: apply [production]
16:38 <swfrench@deploy2002> helmfile [staging] START helmfile.d/services/shellbox-syntaxhighlight: apply [production]
16:38 <swfrench@deploy2002> helmfile [staging] DONE helmfile.d/services/shellbox-media: apply [production]
16:38 <swfrench@deploy2002> helmfile [staging] START helmfile.d/services/shellbox-media: apply [production]
16:38 <swfrench@deploy2002> helmfile [staging] DONE helmfile.d/services/shellbox-constraints: apply [production]
16:37 <swfrench@deploy2002> helmfile [staging] START helmfile.d/services/shellbox-constraints: apply [production]
16:37 <swfrench@deploy2002> helmfile [staging] DONE helmfile.d/services/shellbox: apply [production]
16:37 <swfrench@deploy2002> helmfile [staging] START helmfile.d/services/shellbox: apply [production]
16:33 <elukey@cumin1002> START - Cookbook sre.hosts.provision for host ganeti1052.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART [production]
16:26 <elukey@cumin1002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ganeti1051.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART [production]
16:21 <elukey@cumin1002> START - Cookbook sre.hosts.provision for host ganeti1051.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART [production]