9351-9400 of 10000 results (97ms)
2019-12-02 ยง
21:25 <mholloway-shell@deploy1001> helmfile [CODFW] Ran 'apply' command on namespace 'wikifeeds' for release 'production' . [production]
21:23 <mholloway-shell@deploy1001> helmfile [EQIAD] Ran 'apply' command on namespace 'wikifeeds' for release 'production' . [production]
21:22 <mholloway-shell@deploy1001> helmfile [STAGING] Ran 'apply' command on namespace 'wikifeeds' for release 'staging' . [production]
20:59 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1078 after schema change', diff saved to https://phabricator.wikimedia.org/P9796 and previous config saved to /var/cache/conftool/dbconfig/20191202-205904-marostegui.json [production]
20:47 <ariel@cumin1001> conftool action : set/pooled=yes; selector: cluster=appserver,name=mw2232.codfw.wmnet,service=nginx,dc=codfw [production]
20:47 <ariel@cumin1001> conftool action : set/pooled=yes; selector: cluster=appserver,name=mw2232.codfw.wmnet,service=apache2,dc=codfw [production]
20:47 <ariel@cumin1001> conftool action : set/pooled=yes; selector: name=mw2233.codfw.wmnet,dc=codfw,service=nginx,cluster=appserver [production]
20:46 <ariel@cumin1001> conftool action : set/pooled=yes; selector: name=mw2233.codfw.wmnet,dc=codfw,service=apache2,cluster=appserver [production]
20:46 <ariel@cumin1001> conftool action : set/pooled=yes; selector: name=mw2234.codfw.wmnet,service=nginx,cluster=appserver,dc=codfw [production]
20:46 <ariel@cumin1001> conftool action : set/pooled=yes; selector: name=mw2234.codfw.wmnet,service=apache2,cluster=appserver,dc=codfw [production]
20:46 <ariel@cumin1001> conftool action : set/pooled=yes; selector: cluster=appserver,name=mw2231.codfw.wmnet,service=nginx,dc=codfw [production]
20:46 <ariel@cumin1001> conftool action : set/pooled=yes; selector: cluster=appserver,name=mw2231.codfw.wmnet,service=apache2,dc=codfw [production]
20:36 <mobrovac@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Switch Flow on all wikis to Parsoid/PHP - T229015 (duration: 00m 59s) [production]
20:35 <otto@deploy1001> helmfile [STAGING] Ran 'apply' command on namespace 'eventgate-logging-external' for release 'logging-external' . [production]
20:26 <otto@deploy1001> helmfile [STAGING] Ran 'apply' command on namespace 'eventgate-logging-external' for release 'logging-external' . [production]
20:21 <mobrovac@deploy1001> Finished deploy [restbase/deploy@92acf1e]: Switch everything to Parsoid/PHP - T229015 (duration: 14m 59s) [production]
20:12 <joal@deploy1001> Finished deploy [analytics/refinery@9cd234a] (thin): Analytics deploy - Fixes for today deploy (2) (duration: 00m 05s) [production]
20:12 <joal@deploy1001> Started deploy [analytics/refinery@9cd234a] (thin): Analytics deploy - Fixes for today deploy (2) [production]
20:08 <joal@deploy1001> Finished deploy [analytics/refinery@9cd234a]: Analytics deploy - Fixes for today deploy (2) (duration: 08m 08s) [production]
20:06 <mobrovac@deploy1001> Started deploy [restbase/deploy@92acf1e]: Switch everything to Parsoid/PHP - T229015 [production]
20:05 <reedy@deploy1001> Synchronized wmf-config/LabsServices.php: labslabslabs (duration: 01m 08s) [production]
20:05 <mobrovac@deploy1001> Finished deploy [restbase/deploy@92acf1e] (dev-cluster): Switch everything to Parsoid/PHP (duration: 02m 48s) [production]
20:02 <mobrovac@deploy1001> Started deploy [restbase/deploy@92acf1e] (dev-cluster): Switch everything to Parsoid/PHP [production]
20:01 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
19:59 <joal@deploy1001> Started deploy [analytics/refinery@9cd234a]: Analytics deploy - Fixes for today deploy (2) [production]
19:59 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime [production]
19:56 <ariel@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
19:55 <ariel@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
19:55 <ariel@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
19:53 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
19:51 <ariel@cumin1001> START - Cookbook sre.hosts.downtime [production]
19:51 <dzahn@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
19:50 <ariel@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
19:50 <otto@deploy1001> helmfile [STAGING] Ran 'apply' command on namespace 'eventgate-logging-external' for release 'logging-external' . [production]
19:50 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime [production]
19:50 <ariel@cumin1001> START - Cookbook sre.hosts.downtime [production]
19:50 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime [production]
19:50 <ariel@cumin1001> START - Cookbook sre.hosts.downtime [production]
19:48 <ariel@cumin1001> START - Cookbook sre.hosts.downtime [production]
19:37 <mobrovac@deploy1001> Finished deploy [restbase/deploy@e69e2e5]: Switch everything but enwiki to Parsoid/PHP - T229015 (duration: 13m 48s) [production]
19:27 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
19:25 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
19:24 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime [production]
19:23 <mobrovac@deploy1001> Started deploy [restbase/deploy@e69e2e5]: Switch everything but enwiki to Parsoid/PHP - T229015 [production]
19:23 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime [production]
19:22 <mobrovac@deploy1001> Finished deploy [restbase/deploy@e69e2e5] (dev-cluster): Switch everything but enwiki to Parsoid/PHP (duration: 06m 38s) [production]
19:16 <mobrovac@deploy1001> Started deploy [restbase/deploy@e69e2e5] (dev-cluster): Switch everything but enwiki to Parsoid/PHP [production]
19:04 <mobrovac@deploy1001> Finished deploy [restbase/deploy@6a24685]: Parsoid Proxy: Direct html2html traffic to JS; Stop honouring the variant header; Switch sr and zh wikis to PHP - T229015 (duration: 14m 11s) [production]
18:58 <jiji@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
18:56 <jiji@cumin1001> START - Cookbook sre.hosts.downtime [production]