7401-7450 of 10000 results (85ms)
2020-01-08 ยง
15:11 <otto@deploy1001> sync-file aborted: Make EventBus use TLS for eventgate-analytics - T242224 (duration: 00m 00s) [production]
15:10 <otto@deploy1001> Synchronized wmf-config/ProductionServices.php: Make EventBus use TLS for eventgate-analytics - T242224 (duration: 06m 10s) [production]
15:02 <XioNoX> Routinator 0.6.4 looking good on rpki2001, upgrading rpki1001 - T242197 [production]
15:00 <ottomata> deploying change to use new TLS port for eventgate-analytics - T242224 [production]
14:35 <ema> repool cp4028 after successful X-Analytics-TLS patch test T237993 [production]
14:23 <ema> depool cp4028 to test X-Analytics-TLS patch T237993 [production]
14:07 <XioNoX> add routinator 0.6.4 to reprepro stretch-wikimedia - T242197 [production]
14:00 <ariel@deploy1001> Finished deploy [dumps/dumps@dbd0ecd]: don't regenerate existing 7z files on rerun of the 7z recompression job (duration: 00m 05s) [production]
14:00 <ariel@deploy1001> Started deploy [dumps/dumps@dbd0ecd]: don't regenerate existing 7z files on rerun of the 7z recompression job [production]
12:46 <_joe_> deleting releng/composer-php55:0.1.0 from the docker registry [production]
12:36 <Lucas_WMDE> EU SWAT done [production]
12:34 <lucaswerkmeister-wmde@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:510875|Update Skolt Sami language name (T223544)]] (duration: 01m 06s) [production]
12:30 <lucaswerkmeister-wmde@deploy1001> Synchronized php-1.35.0-wmf.11/extensions/Cite: SWAT: [[gerrit:561169|Fix handling of `<references responsive="" />` (T241303)]] (duration: 01m 06s) [production]
12:17 <tarrow@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:562777|Enable tainted references on test.wikidata.org (T239621)]] (duration: 01m 19s) [production]
12:08 <kart_> Updated cxserver to 2020-01-06-070550-production (T233405) [production]
12:04 <kartik@deploy1001> helmfile [EQIAD] Ran 'apply' command on namespace 'cxserver' for release 'production' . [production]
12:01 <kartik@deploy1001> helmfile [CODFW] Ran 'apply' command on namespace 'cxserver' for release 'production' . [production]
12:00 <kartik@deploy1001> helmfile [STAGING] Ran 'apply' command on namespace 'cxserver' for release 'staging' . [production]
11:47 <akosiaris@cumin1001> conftool action : set/pooled=yes; selector: name=kubernetes2001.* [production]
11:45 <akosiaris@cumin1001> conftool action : set/weight=10; selector: service=echostore [production]
11:44 <vgutierrez> uploaded varnish 5.1.3-1wm12 to apt.wikimedia.org (buster) - T242093 [production]
11:44 <akosiaris@cumin1001> conftool action : set/weight=10; selector: name=kubernetes1001.* [production]
11:44 <akosiaris@cumin1001> conftool action : set/pooled=yes; selector: name=kubernetes1001.* [production]
11:07 <moritzm> test failover of Ganeti master in eqsin T228099 [production]
11:00 <moritzm> drain ganeti5003 to test new Ganeti setup in eqsin T228099 [production]
10:53 <aborrero@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
10:53 <aborrero@cumin1001> START - Cookbook sre.hosts.downtime [production]
10:41 <moritzm> rebooting netflow5001 to pick up microcode [production]
10:08 <moritzm> enabling spec-ctr, ssbd. md-clear passthrough for new eqsin cluster T228099 [production]
09:27 <moritzm> installing urldownloader1002 T241979 [production]
09:11 <marostegui@cumin1001> dbctl commit (dc=all): 'Fully repool db1085', diff saved to https://phabricator.wikimedia.org/P10088 and previous config saved to /var/cache/conftool/dbconfig/20200108-091124-marostegui.json [production]
09:00 <moritzm> installing urldownloader1001 T241979 [production]
08:29 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1085', diff saved to https://phabricator.wikimedia.org/P10087 and previous config saved to /var/cache/conftool/dbconfig/20200108-082930-marostegui.json [production]
08:20 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1085', diff saved to https://phabricator.wikimedia.org/P10086 and previous config saved to /var/cache/conftool/dbconfig/20200108-082050-marostegui.json [production]
08:09 <marostegui> Upgrade db1085 [production]
08:08 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1085', diff saved to https://phabricator.wikimedia.org/P10085 and previous config saved to /var/cache/conftool/dbconfig/20200108-080853-marostegui.json [production]
08:07 <marostegui> Deploy schema change on s1 codfw, there will be lag on s1 codfw - T234052 [production]
07:57 <marostegui> Deploy schema change on clouddb2001-dev.labtestwiki - T234052 [production]
07:20 <marostegui@cumin1001> dbctl commit (dc=all): 'Fully repool db1079', diff saved to https://phabricator.wikimedia.org/P10084 and previous config saved to /var/cache/conftool/dbconfig/20200108-072017-marostegui.json [production]
07:13 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1079', diff saved to https://phabricator.wikimedia.org/P10083 and previous config saved to /var/cache/conftool/dbconfig/20200108-071312-marostegui.json [production]
07:07 <marostegui> Remove partitions from dewiki.revision on db1097:3315 T239453 [production]
07:07 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1097:3315', diff saved to https://phabricator.wikimedia.org/P10082 and previous config saved to /var/cache/conftool/dbconfig/20200108-070712-marostegui.json [production]
07:06 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1079', diff saved to https://phabricator.wikimedia.org/P10081 and previous config saved to /var/cache/conftool/dbconfig/20200108-070614-marostegui.json [production]
07:00 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1079', diff saved to https://phabricator.wikimedia.org/P10080 and previous config saved to /var/cache/conftool/dbconfig/20200108-070009-marostegui.json [production]
06:56 <marostegui> Upgrade db1079 [production]
06:44 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1079', diff saved to https://phabricator.wikimedia.org/P10079 and previous config saved to /var/cache/conftool/dbconfig/20200108-064404-marostegui.json [production]
06:42 <marostegui> Remove partitions from revision table on s6 for db1096:3316 - T239453 [production]
06:41 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1096:3316 - T239453', diff saved to https://phabricator.wikimedia.org/P10078 and previous config saved to /var/cache/conftool/dbconfig/20200108-064144-marostegui.json [production]
06:35 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1098:3316 - T239453', diff saved to https://phabricator.wikimedia.org/P10077 and previous config saved to /var/cache/conftool/dbconfig/20200108-063550-marostegui.json [production]
05:41 <XioNoX> enable netflow in eqsin [production]