951-1000 of 10000 results (13ms)
2020-04-27 ยง
18:10 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: 8b71f38: Remove use of `wgAllowImageMoving` (T245293) (duration: 00m 57s) [production]
18:04 <otto@deploy1001> Synchronized wmf-config/InitialiseSettings-labs.php: wgEventStreams: in beta, merge settings from production - T242122 (duration: 00m 56s) [production]
18:02 <otto@deploy1001> Synchronized wmf-config/InitialiseSettings.php: wgEventStreams: configure SearchSatisfaction - T249261 (duration: 00m 58s) [production]
17:34 <ppchelko@deploy1001> helmfile [EQIAD] Ran 'sync' command on namespace 'changeprop' for release 'production' . [production]
17:31 <ppchelko@deploy1001> helmfile [CODFW] Ran 'sync' command on namespace 'changeprop' for release 'production' . [production]
16:46 <hnowlan@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'changeprop' for release 'staging' . [production]
16:07 <hnowlan@deploy1001> helmfile [EQIAD] Ran 'sync' command on namespace 'changeprop' for release 'production' . [production]
16:02 <hnowlan@deploy1001> helmfile [CODFW] Ran 'sync' command on namespace 'changeprop' for release 'production' . [production]
15:54 <hnowlan@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'changeprop' for release 'staging' . [production]
15:45 <gehel> restart wdqs-updater on all servers [production]
15:39 <hnowlan@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'changeprop' for release 'staging' . [production]
15:26 <hnowlan@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'changeprop' for release 'staging' . [production]
15:22 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1075', diff saved to https://phabricator.wikimedia.org/P11048 and previous config saved to /var/cache/conftool/dbconfig/20200427-152242-marostegui.json [production]
14:58 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1075 for schema change', diff saved to https://phabricator.wikimedia.org/P11047 and previous config saved to /var/cache/conftool/dbconfig/20200427-145851-marostegui.json [production]
14:50 <jynus> setting default etherpadlite db on m1 to utf8mb4_bin [production]
14:50 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1078', diff saved to https://phabricator.wikimedia.org/P11046 and previous config saved to /var/cache/conftool/dbconfig/20200427-145010-marostegui.json [production]
14:46 <vgutierrez> pool cp4026 running ATS 8.1.0 - T249335 [production]
14:33 <otto@deploy1001> helmfile [EQIAD] Ran 'apply' command on namespace 'eventgate-analytics-external' for release 'canary' . [production]
14:33 <otto@deploy1001> helmfile [EQIAD] Ran 'apply' command on namespace 'eventgate-analytics-external' for release 'production' . [production]
14:30 <otto@deploy1001> helmfile [CODFW] Ran 'apply' command on namespace 'eventgate-analytics-external' for release 'canary' . [production]
14:30 <otto@deploy1001> helmfile [CODFW] Ran 'apply' command on namespace 'eventgate-analytics-external' for release 'production' . [production]
14:27 <otto@deploy1001> helmfile [STAGING] Ran 'apply' command on namespace 'eventgate-analytics-external' for release 'canary' . [production]
14:27 <otto@deploy1001> helmfile [STAGING] Ran 'apply' command on namespace 'eventgate-analytics-external' for release 'production' . [production]
14:20 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1078 for schema change', diff saved to https://phabricator.wikimedia.org/P11045 and previous config saved to /var/cache/conftool/dbconfig/20200427-142006-marostegui.json [production]
13:56 <hnowlan@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'changeprop' for release 'staging' . [production]
13:55 <vgutierrez> depool cp4026 and upgrade to ATS 8.1.0 - T249335 [production]
13:53 <vgutierrez> restart ats-tls on cp3056 - T249335 [production]
13:52 <mutante> decom'ing install1002 and install2002 - see install1003/2003 and apt1001/2001 [production]
13:52 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) [production]
13:51 <dzahn@cumin1001> START - Cookbook sre.hosts.decommission [production]
13:47 <marostegui> Deploy schema change on s3 codfw, lag will show up - T250055 [production]
13:46 <marostegui> Drop img_deleted column from wikitech - T250055 [production]
13:45 <marostegui> Drop img_deleted column from s7 eqiad - T250055 [production]
13:42 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) [production]
13:42 <otto@deploy1001> helmfile [EQIAD] Ran 'apply' command on namespace 'eventgate-analytics' for release 'canary' . [production]
13:42 <otto@deploy1001> helmfile [EQIAD] Ran 'apply' command on namespace 'eventgate-analytics' for release 'production' . [production]
13:41 <dzahn@cumin1001> START - Cookbook sre.hosts.decommission [production]
13:41 <dzahn@cumin1001> END (ERROR) - Cookbook sre.hosts.decommission (exit_code=97) [production]
13:41 <dzahn@cumin1001> START - Cookbook sre.hosts.decommission [production]
13:38 <_joe_> repooling both mw1407 and mw1409 for tesing T99740 [production]
13:30 <_joe_> depooled mw1409 as well as mw1407 for further benchmarking, T99740 [production]
13:28 <otto@deploy1001> helmfile [CODFW] Ran 'apply' command on namespace 'eventgate-analytics' for release 'canary' . [production]
13:28 <otto@deploy1001> helmfile [CODFW] Ran 'apply' command on namespace 'eventgate-analytics' for release 'production' . [production]
13:10 <elukey> roll restart elastic on cloudelastic-chi again to pick up new JVM settings - T231517 [production]
13:09 <marostegui> Deploy schema change on s7 codfw, lag will show up - T250055 [production]
12:53 <marostegui> Drop T248086_wb_terms from db1104 - T248086 [production]
12:50 <marostegui> Removed img_deleted from s1 (enwiki) T250055 [production]
12:49 <akosiaris> rolling back etherpad to 1.8.0 [production]
12:45 <akosiaris> upgrade etherpad to 1.8.3 [production]
12:41 <marostegui> Remove empty table T248086_wb_terms from wikidatawiki on s3 eqiad - T248086 [production]