301-350 of 10000 results (31ms)
2021-03-16 ยง
23:56 <krinkle@deploy1002> Synchronized php-1.36.0-wmf.35/includes/Revision/: I8619ab9e92b, T277362, T275531 (duration: 00m 58s) [production]
23:51 <krinkle@deploy1002> Synchronized php-1.36.0-wmf.34/extensions/Scribunto/: I84e8732d8d - tmp logging (duration: 00m 58s) [production]
23:47 <Krinkle> There is an uncommitted dirty diff in /srv/mediawiki-staging/php-1.36.0-wmf.34/extensions/WikimediaMaintenance/createExtensionTables.php [production]
23:31 <krinkle@deploy1002> Synchronized wmf-config/InitialiseSettings.php: I1ca4f30c2, T262612 (duration: 00m 57s) [production]
23:22 <krinkle@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Icd6635cb302cc, T277332 (duration: 00m 58s) [production]
23:07 <krinkle@deploy1002> Synchronized wmf-config/InitialiseSettings.php: I8d8c94d95c6 (duration: 00m 59s) [production]
23:03 <twentyafterfour> applied hotfix to phabricator/src/infrastructure/customfield/storage/PhabricatorCustomFieldStorage.php and restarted php-fpm [production]
23:02 <krinkle@deploy1002> Synchronized wmf-config/CommonSettings.php: I4097cbcb1d5 (duration: 00m 59s) [production]
22:59 <krinkle@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Ie24eb2077 (duration: 00m 58s) [production]
20:59 <dzahn@cumin1001> conftool action : set/pooled=inactive; selector: name=mw2232.codfw.wmnet [production]
20:59 <dzahn@cumin1001> conftool action : set/pooled=inactive; selector: name=mw2231.codfw.wmnet [production]
20:59 <dzahn@cumin1001> conftool action : set/pooled=inactive; selector: name=mw2230.codfw.wmnet [production]
20:49 <andrew@deploy1002> Finished deploy [horizon/deploy@e4fd934]: tiny horizon patch to support flavor deprecation (duration: 03m 44s) [production]
20:45 <andrew@deploy1002> Started deploy [horizon/deploy@e4fd934]: tiny horizon patch to support flavor deprecation [production]
20:15 <XioNoX> remove DMZ zone from pfw3-eqiad - T174203 [production]
20:00 <brennen> 1.36.0-wmf.35 train status (T274939): blocked at group0 on T277362 [production]
19:52 <dancy@deploy1002> rebuilt and synchronized wikiversions files: group0 wikis to 1.36.0-wmf.34 [production]
19:51 <XioNoX> commit changes to pfw3-eqiad - T274422 [production]
19:44 <dancy@deploy1002> rebuilt and synchronized wikiversions files: group0 wikis to 1.36.0-wmf.35 [production]
19:31 <dancy@deploy1002> Finished scap: testwikis wikis to 1.36.0-wmf.35 (duration: 33m 41s) [production]
19:20 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts mw2229.codfw.wmnet [production]
19:11 <dzahn@cumin1001> conftool action : set/pooled=inactive; selector: name=mw2229.codfw.wmnet [production]
19:10 <dzahn@cumin1001> START - Cookbook sre.hosts.decommission for hosts mw2229.codfw.wmnet [production]
19:08 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts mw2228.codfw.wmnet [production]
19:07 <dzahn@cumin1001> conftool action : set/pooled=inactive; selector: name=mw2228.codfw.wmnet [production]
19:06 <XioNoX> commit changes to pfw3-codfw - T274422 [production]
18:58 <dancy@deploy1002> Started scap: testwikis wikis to 1.36.0-wmf.35 [production]
18:55 <dzahn@cumin1001> START - Cookbook sre.hosts.decommission for hosts mw2228.codfw.wmnet [production]
18:48 <mbsantos@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mobileapps' for release 'production' . [production]
18:43 <mbsantos@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mobileapps' for release 'production' . [production]
18:41 <mbsantos@deploy1002> helmfile [staging] Ran 'sync' command on namespace 'mobileapps' for release 'staging' . [production]
18:03 <ppchelko@deploy1002> Finished deploy [restbase/deploy@f99ddaa]: Add new wikis T275837 T271983 T273466 T276127 T273460 T276249 (duration: 31m 31s) [production]
17:44 <hnowlan@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6 days, 0:00:00 on aqs1011.eqiad.wmnet with reason: New buster hosts, not in use [production]
17:44 <hnowlan@cumin1001> START - Cookbook sre.hosts.downtime for 6 days, 0:00:00 on aqs1011.eqiad.wmnet with reason: New buster hosts, not in use [production]
17:37 <dzahn@cumin1001> END (FAIL) - Cookbook sre.hosts.decommission (exit_code=1) for hosts mw2227.codfw.wmnet [production]
17:32 <ppchelko@deploy1002> Started deploy [restbase/deploy@f99ddaa]: Add new wikis T275837 T271983 T273466 T276127 T273460 T276249 [production]
17:09 <dzahn@cumin1001> START - Cookbook sre.hosts.decommission for hosts mw2227.codfw.wmnet [production]
17:04 <dzahn@cumin1001> END (FAIL) - Cookbook sre.hosts.decommission (exit_code=1) for hosts mw2226.codfw.wmnet [production]
16:47 <eevans@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'sessionstore' for release 'production' . [production]
16:44 <eevans@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'sessionstore' for release 'production' . [production]
16:25 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=mw2242.codfw.wmnet [production]
16:25 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=mw2241.codfw.wmnet [production]
16:24 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=mw2240.codfw.wmnet [production]
16:21 <dzahn@cumin1001> START - Cookbook sre.hosts.decommission for hosts mw2226.codfw.wmnet [production]
16:20 <dzahn@cumin1001> conftool action : set/pooled=inactive; selector: name=mw2227.codfw.wmnet [production]
16:20 <dzahn@cumin1001> conftool action : set/pooled=inactive; selector: name=mw2226.codfw.wmnet [production]
16:17 <mutante> testreduce1001 - gzip /var/log/daemon.log.1 ; apt-get clean .. free some disk space [production]
15:47 <akosiaris@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 16 days, 16:00:00 on acrux.codfw.wmnet with reason: Extend downtime for like a month until we remove the VMs [production]
15:47 <akosiaris@cumin1001> START - Cookbook sre.hosts.downtime for 16 days, 16:00:00 on acrux.codfw.wmnet with reason: Extend downtime for like a month until we remove the VMs [production]
15:47 <akosiaris@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 16 days, 16:00:00 on acrab.codfw.wmnet with reason: Extend downtime for like a month until we remove the VMs [production]