6401-6450 of 10000 results (79ms)
2022-10-10 ยง
13:23 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
13:21 <moritzm> draining ganeti1006 T320419 [production]
13:21 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2121 (T314041)', diff saved to https://phabricator.wikimedia.org/P35386 and previous config saved to /var/cache/conftool/dbconfig/20221010-132115-ladsgroup.json [production]
13:20 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
13:20 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
13:20 <samtar@deploy1002> Finished scap: Backport for [[gerrit:840235|trwikivoyage: Install WikiLove extension (T319537)]] (duration: 06m 55s) [production]
13:19 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
13:13 <samtar@deploy1002> samtar and stang: Backport for [[gerrit:840235|trwikivoyage: Install WikiLove extension (T319537)]] synced to the testservers: mwdebug2002.codfw.wmnet, mwdebug1001.eqiad.wmnet, mwdebug1002.eqiad.wmnet, mwdebug2001.codfw.wmnet [production]
13:13 <samtar@deploy1002> Started scap: Backport for [[gerrit:840235|trwikivoyage: Install WikiLove extension (T319537)]] [production]
13:11 <TheresNoTime> [samtar@mwmaint1002 ~]$ mwscript extensions/WikimediaMaintenance/createExtensionTables.php trwikivoyage wikilove [production]
12:35 <moritzm> installing puma security updates [production]
12:28 <moritzm> installing jetty9 security updates [production]
12:19 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.addnode (exit_code=0) for new host ganeti1031.eqiad.wmnet to cluster eqiad and group A [production]
12:18 <jmm@cumin2002> START - Cookbook sre.ganeti.addnode for new host ganeti1031.eqiad.wmnet to cluster eqiad and group A [production]
12:16 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti1031.eqiad.wmnet [production]
12:14 <moritzm> installing ruby-rack security updates [production]
12:07 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host ganeti1031.eqiad.wmnet [production]
11:24 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.addnode (exit_code=0) for new host ganeti1014.eqiad.wmnet to cluster eqiad and group B [production]
11:23 <jmm@cumin2002> START - Cookbook sre.ganeti.addnode for new host ganeti1014.eqiad.wmnet to cluster eqiad and group B [production]
11:13 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
11:12 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
11:11 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
11:07 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
11:02 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
11:01 <urbanecm@deploy1002> Finished scap: Backport for [[gerrit:840570|Update interwiki cache]] (duration: 04m 13s) [production]
11:00 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti1014.eqiad.wmnet [production]
11:00 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
11:00 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
10:57 <urbanecm@deploy1002> urbanecm and urbanecm: Backport for [[gerrit:840570|Update interwiki cache]] synced to the testservers: mwdebug1001.eqiad.wmnet, mwdebug1002.eqiad.wmnet, mwdebug2002.codfw.wmnet, mwdebug2001.codfw.wmnet [production]
10:57 <urbanecm@deploy1002> Started scap: Backport for [[gerrit:840570|Update interwiki cache]] [production]
10:57 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
10:55 <urbanecm@deploy1002> Finished scap: Creating igwiktionary (T314635) (duration: 04m 13s) [production]
10:51 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
10:51 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host ganeti1014.eqiad.wmnet [production]
10:51 <urbanecm@deploy1002> Started scap: Creating igwiktionary (T314635) [production]
10:49 <urbanecm@deploy1002> Finished scap: Creating igwikiquote (T314636) (duration: 04m 24s) [production]
10:47 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
10:47 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
10:44 <urbanecm@deploy1002> Started scap: Creating igwikiquote (T314636) [production]
10:43 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
10:40 <urbanecm@deploy1002> Finished scap: Creating bclwikiquote (T316453) (duration: 04m 11s) [production]
10:38 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
10:36 <urbanecm@deploy1002> Started scap: Creating bclwikiquote (T316453) [production]
10:35 <urbanecm@deploy1002> scap failed: FileNotFoundError [Errno 2] Invalid/unavailable version dir: '/srv/mediawiki-staging/php-1.40-0-wmf.4' (duration: 00m 00s) [production]
10:34 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
10:34 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
10:32 <urbanecm@deploy1002> Finished scap: Creating tlwikiquote (T317107) (duration: 04m 04s) [production]
10:30 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
10:28 <urbanecm@deploy1002> Started scap: Creating tlwikiquote (T317107) [production]
10:24 <urbanecm@deploy1002> Finished scap: Creating bnwikiquote (T319183) (duration: 04m 56s) [production]