201-250 of 10000 results (20ms)
2020-10-19 ยง
23:56 <gehel@cumin1001> END (FAIL) - Cookbook sre.wdqs.data-reload (exit_code=99) [production]
23:11 <ebernhardson@deploy1001> Finished deploy [wikimedia/discovery/analytics@4bfd6c9]: spark: case insensitive schema validation (duration: 04m 33s) [production]
23:07 <ebernhardson@deploy1001> Started deploy [wikimedia/discovery/analytics@4bfd6c9]: spark: case insensitive schema validation [production]
23:02 <mutante> etherpad got restarted with new config options related to rate limiting - hopefully this fixed T265490 [production]
21:29 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) [production]
21:20 <dzahn@cumin1001> START - Cookbook sre.hosts.decommission [production]
21:19 <ebernhardson@deploy1001> Finished deploy [wikimedia/discovery/analytics@94c23a1]: airflow: fix column mismatch writing page predictions (duration: 04m 48s) [production]
21:14 <ebernhardson@deploy1001> Started deploy [wikimedia/discovery/analytics@94c23a1]: airflow: fix column mismatch writing page predictions [production]
21:01 <ppchelko@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'api-gateway' for release 'staging' . [production]
20:57 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) [production]
20:55 <ppchelko@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'api-gateway' for release 'staging' . [production]
20:49 <dzahn@cumin1001> START - Cookbook sre.hosts.decommission [production]
20:46 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) [production]
20:41 <eileen> drush vset match_on_import 1 [production]
20:38 <dzahn@cumin1001> START - Cookbook sre.hosts.decommission [production]
20:21 <otto@deploy1001> helmfile [codfw] Ran 'sync' command on namespace 'eventstreams' for release 'production' . [production]
20:21 <otto@deploy1001> helmfile [codfw] Ran 'sync' command on namespace 'eventstreams' for release 'canary' . [production]
20:19 <otto@deploy1001> helmfile [eqiad] Ran 'sync' command on namespace 'eventstreams' for release 'canary' . [production]
20:19 <otto@deploy1001> helmfile [eqiad] Ran 'sync' command on namespace 'eventstreams' for release 'production' . [production]
20:18 <otto@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'eventstreams' for release 'production' . [production]
20:18 <otto@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'eventstreams' for release 'canary' . [production]
20:17 <jgiannelos@deploy1001> helmfile [eqiad] Ran 'sync' command on namespace 'mobileapps' for release 'nontls' . [production]
20:17 <jgiannelos@deploy1001> helmfile [eqiad] Ran 'sync' command on namespace 'mobileapps' for release 'production' . [production]
20:16 <dzahn@cumin1001> conftool action : set/pooled=inactive; selector: dc=codfw,name=wtp2020.codfw.wmnet [production]
20:16 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
20:16 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime [production]
20:16 <ebernhardson@deploy1001> Finished deploy [wikimedia/discovery/analytics@e66bec2]: Fix column mismatch when reading discovery.wikibase_item (duration: 01m 03s) [production]
20:16 <mutante> decom'ing wtp201[0-9].codfw.wmnet (pooled=inactive) T265558 [production]
20:16 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
20:15 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime [production]
20:15 <dzahn@cumin1001> conftool action : set/pooled=inactive; selector: dc=codfw,name=wtp201[0-9].codfw.wmnet [production]
20:15 <ebernhardson@deploy1001> Started deploy [wikimedia/discovery/analytics@e66bec2]: Fix column mismatch when reading discovery.wikibase_item [production]
20:09 <dzahn@cumin1001> conftool action : set/weight=1; selector: dc=codfw,cluster=parsoid,service=canary [production]
20:08 <jgiannelos@deploy1001> helmfile [codfw] Ran 'sync' command on namespace 'mobileapps' for release 'production' . [production]
20:08 <jgiannelos@deploy1001> helmfile [codfw] Ran 'sync' command on namespace 'mobileapps' for release 'nontls' . [production]
20:06 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
20:06 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime [production]
20:01 <mutante> decom'ing wtp200[1-9].codfw.wmnet (pooled=inactive) T265558 [production]
20:00 <dzahn@cumin1001> conftool action : set/pooled=inactive; selector: dc=codfw,name=wtp200[1-9].codfw.wmnet [production]
19:57 <jgiannelos@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'mobileapps' for release 'staging' . [production]
19:57 <otto@deploy1001> helmfile [codfw] Ran 'sync' command on namespace 'eventgate-analytics-external' for release 'canary' . [production]
19:57 <otto@deploy1001> helmfile [codfw] Ran 'sync' command on namespace 'eventgate-analytics-external' for release 'production' . [production]
19:52 <otto@deploy1001> helmfile [eqiad] Ran 'sync' command on namespace 'eventgate-analytics-external' for release 'canary' . [production]
19:52 <otto@deploy1001> helmfile [eqiad] Ran 'sync' command on namespace 'eventgate-analytics-external' for release 'production' . [production]
19:51 <otto@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'eventgate-analytics-external' for release 'canary' . [production]
19:45 <ebernhardson@deploy1001> Finished deploy [wikimedia/discovery/analytics@3c590e2]: Fix column mismatch for discovery.wikibase_item and multilist handler for esbulk uploads (duration: 03m 35s) [production]
19:41 <ebernhardson@deploy1001> Started deploy [wikimedia/discovery/analytics@3c590e2]: Fix column mismatch for discovery.wikibase_item and multilist handler for esbulk uploads [production]
19:35 <otto@deploy1001> helmfile [codfw] Ran 'sync' command on namespace 'eventgate-logging-external' for release 'canary' . [production]
19:34 <otto@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'eventgate-logging-external' for release 'canary' . [production]
19:33 <mutante> wtp2001 - sudo confctl decommission [production]