3751-3800 of 10000 results (37ms)
2020-12-07 ยง
18:57 <ryankemper@cumin1001> END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) [production]
18:57 <ryankemper@cumin2001> END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) [production]
18:57 <ryankemper@cumin2001> END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) [production]
18:57 <ryankemper@cumin1001> END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) [production]
18:52 <herron> systemctl restart icinga on alert1001 T269560 [production]
18:52 <jiji@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
18:51 <ryankemper@cumin2001> START - Cookbook sre.wdqs.data-transfer [production]
18:51 <ryankemper@cumin2001> START - Cookbook sre.wdqs.data-transfer [production]
18:51 <ryankemper@cumin1001> START - Cookbook sre.wdqs.data-transfer [production]
18:51 <ryankemper@cumin1001> START - Cookbook sre.wdqs.data-transfer [production]
18:50 <ryankemper> T246345 Brought new `wdqs-internal` node `wdqs1011` into service: `sudo confctl select 'name=wdqs1011.eqiad.wmnet' set/pooled=yes:weight=10` [production]
18:49 <ryankemper@mwmaint1002> conftool action : set/pooled=yes:weight=10; selector: name=wdqs1011.eqiad.wmnet [production]
18:49 <jiji@cumin1001> START - Cookbook sre.hosts.downtime [production]
18:48 <ryankemper@mwmaint1002> conftool action : set/pooled=yes:weight=10; selector: service=wdqs-internal,name=wdqs1011.eqiad.wmnet [production]
18:28 <jiji@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
18:26 <jiji@cumin1001> START - Cookbook sre.hosts.downtime [production]
18:12 <urbanecm@deploy1001> Synchronized private/PrivateSettings.php: Update T250887 mitigrations (duration: 00m 57s) [production]
18:02 <urbanecm@deploy1001> Synchronized private/PrivateSettings.php: Update T250887 mitigrations (duration: 00m 58s) [production]
17:54 <urbanecm@deploy1001> Synchronized private/PrivateSettings.php: Update T250887 mitigrations (duration: 00m 59s) [production]
17:49 <urbanecm@deploy1001> Synchronized private/PrivateSettings.php: Update T250887 mitigrations (duration: 01m 01s) [production]
17:37 <akosiaris> cleanup the old recommendation-api non TLS LVS service [production]
17:18 <effie> disable puppet on mc1035, mc2035 for 646751 [production]
16:45 <akosiaris@deploy1001> helmfile [codfw] Ran 'sync' command on namespace 'mobileapps' for release 'production' . [production]
16:44 <akosiaris@deploy1001> helmfile [codfw] Ran 'sync' command on namespace 'mobileapps' for release 'staging' . [production]
16:43 <ema> deployment-cache-text06: downgrade varnish to 5.2.1-1wm1 T264398 [production]
16:42 <andrew@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
16:40 <andrew@cumin1001> START - Cookbook sre.hosts.downtime [production]
16:40 <dcaro@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
16:38 <dcaro@cumin1001> START - Cookbook sre.hosts.downtime [production]
16:35 <akosiaris@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'mobileapps' for release 'production' . [production]
16:35 <akosiaris@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'mobileapps' for release 'staging' . [production]
16:16 <moritzm> updated buster installation image to 10.7 T269558 [production]
16:04 <jmm@cumin2001> END (FAIL) - Cookbook sre.hosts.reboot-single (exit_code=99) [production]
16:04 <sukhe@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
16:04 <sukhe@cumin1001> START - Cookbook sre.hosts.downtime [production]
16:01 <jmm@cumin2001> START - Cookbook sre.hosts.reboot-single [production]
15:59 <jmm@cumin2001> END (FAIL) - Cookbook sre.hosts.reboot-single (exit_code=99) [production]
15:54 <jmm@cumin2001> START - Cookbook sre.hosts.reboot-single [production]
15:41 <moritzm> installing vips security updates [production]
14:50 <hashar@deploy1001> rebuilt and synchronized wikiversions files: all wikis to 1.36.0-wmf.20 [production]
14:46 <hashar@deploy1001> rebuilt and synchronized wikiversions files: group0 wikis to 1.36.0-wmf.20 [production]
14:38 <hashar@deploy1001> Synchronized php: group1 wikis to 1.36.0-wmf.20 (duration: 01m 06s) [production]
14:37 <hashar@deploy1001> rebuilt and synchronized wikiversions files: group1 wikis to 1.36.0-wmf.20 [production]
14:33 <hashar@deploy1001> Synchronized php-1.36.0-wmf.20/includes: Applying https://gerrit.wikimedia.org/r/c/mediawiki/core/+/645312 T2569396 (duration: 01m 15s) [production]
13:38 <kart_> Deployed apertium service to eqiad and codfw (T255672) [production]
13:23 <hashar> Stopping CI Jenkins for upgrade [production]
13:20 <kartik@deploy1001> helmfile [eqiad] Ran 'sync' command on namespace 'apertium' for release 'production' . [production]
13:18 <kartik@deploy1001> helmfile [codfw] Ran 'sync' command on namespace 'apertium' for release 'production' . [production]
13:12 <hashar> Upgrading Jenkins 2.252 > 2.263.1 on contint2001 / contint1001 [production]
12:57 <Urbanecm> EU B&C window done [production]