601-650 of 10000 results (70ms)
2022-10-10 ยง
12:35 <moritzm> installing puma security updates [production]
12:28 <moritzm> installing jetty9 security updates [production]
12:19 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.addnode (exit_code=0) for new host ganeti1031.eqiad.wmnet to cluster eqiad and group A [production]
12:18 <jmm@cumin2002> START - Cookbook sre.ganeti.addnode for new host ganeti1031.eqiad.wmnet to cluster eqiad and group A [production]
12:16 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti1031.eqiad.wmnet [production]
12:14 <moritzm> installing ruby-rack security updates [production]
12:07 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host ganeti1031.eqiad.wmnet [production]
11:24 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.addnode (exit_code=0) for new host ganeti1014.eqiad.wmnet to cluster eqiad and group B [production]
11:23 <jmm@cumin2002> START - Cookbook sre.ganeti.addnode for new host ganeti1014.eqiad.wmnet to cluster eqiad and group B [production]
11:13 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
11:12 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
11:11 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
11:07 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
11:02 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
11:01 <urbanecm@deploy1002> Finished scap: Backport for [[gerrit:840570|Update interwiki cache]] (duration: 04m 13s) [production]
11:00 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti1014.eqiad.wmnet [production]
11:00 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
11:00 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
10:57 <urbanecm@deploy1002> urbanecm and urbanecm: Backport for [[gerrit:840570|Update interwiki cache]] synced to the testservers: mwdebug1001.eqiad.wmnet, mwdebug1002.eqiad.wmnet, mwdebug2002.codfw.wmnet, mwdebug2001.codfw.wmnet [production]
10:57 <urbanecm@deploy1002> Started scap: Backport for [[gerrit:840570|Update interwiki cache]] [production]
10:57 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
10:55 <urbanecm@deploy1002> Finished scap: Creating igwiktionary (T314635) (duration: 04m 13s) [production]
10:51 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
10:51 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host ganeti1014.eqiad.wmnet [production]
10:51 <urbanecm@deploy1002> Started scap: Creating igwiktionary (T314635) [production]
10:49 <urbanecm@deploy1002> Finished scap: Creating igwikiquote (T314636) (duration: 04m 24s) [production]
10:47 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
10:47 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
10:44 <urbanecm@deploy1002> Started scap: Creating igwikiquote (T314636) [production]
10:43 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
10:40 <urbanecm@deploy1002> Finished scap: Creating bclwikiquote (T316453) (duration: 04m 11s) [production]
10:38 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
10:36 <urbanecm@deploy1002> Started scap: Creating bclwikiquote (T316453) [production]
10:35 <urbanecm@deploy1002> scap failed: FileNotFoundError [Errno 2] Invalid/unavailable version dir: '/srv/mediawiki-staging/php-1.40-0-wmf.4' (duration: 00m 00s) [production]
10:34 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
10:34 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
10:32 <urbanecm@deploy1002> Finished scap: Creating tlwikiquote (T317107) (duration: 04m 04s) [production]
10:30 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
10:28 <urbanecm@deploy1002> Started scap: Creating tlwikiquote (T317107) [production]
10:24 <urbanecm@deploy1002> Finished scap: Creating bnwikiquote (T319183) (duration: 04m 56s) [production]
10:19 <urbanecm@deploy1002> Started scap: Creating bnwikiquote (T319183) [production]
10:14 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
10:14 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
10:14 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
10:13 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
10:04 <vgutierrez> rolling upgrade to HAProxy 2.4.19 on both text and upload caching clusters [production]
09:44 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.addnode (exit_code=0) for new host ganeti1026.eqiad.wmnet to cluster eqiad and group A [production]
09:43 <jmm@cumin2002> START - Cookbook sre.ganeti.addnode for new host ganeti1026.eqiad.wmnet to cluster eqiad and group A [production]
09:42 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti1026.eqiad.wmnet [production]
09:35 <claime> Imported helm3 3.9.4-1 to buster-wikimedia and bullseye-wikimedia [production]