4901-4950 of 10000 results (71ms)
2020-01-08 §
12:36 <Lucas_WMDE> EU SWAT done [production]
12:34 <lucaswerkmeister-wmde@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:510875|Update Skolt Sami language name (T223544)]] (duration: 01m 06s) [production]
12:30 <lucaswerkmeister-wmde@deploy1001> Synchronized php-1.35.0-wmf.11/extensions/Cite: SWAT: [[gerrit:561169|Fix handling of `<references responsive="" />` (T241303)]] (duration: 01m 06s) [production]
12:17 <tarrow@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:562777|Enable tainted references on test.wikidata.org (T239621)]] (duration: 01m 19s) [production]
12:08 <kart_> Updated cxserver to 2020-01-06-070550-production (T233405) [production]
12:04 <kartik@deploy1001> helmfile [EQIAD] Ran 'apply' command on namespace 'cxserver' for release 'production' . [production]
12:01 <kartik@deploy1001> helmfile [CODFW] Ran 'apply' command on namespace 'cxserver' for release 'production' . [production]
12:00 <kartik@deploy1001> helmfile [STAGING] Ran 'apply' command on namespace 'cxserver' for release 'staging' . [production]
11:47 <akosiaris@cumin1001> conftool action : set/pooled=yes; selector: name=kubernetes2001.* [production]
11:45 <akosiaris@cumin1001> conftool action : set/weight=10; selector: service=echostore [production]
11:44 <vgutierrez> uploaded varnish 5.1.3-1wm12 to apt.wikimedia.org (buster) - T242093 [production]
11:44 <akosiaris@cumin1001> conftool action : set/weight=10; selector: name=kubernetes1001.* [production]
11:44 <akosiaris@cumin1001> conftool action : set/pooled=yes; selector: name=kubernetes1001.* [production]
11:07 <moritzm> test failover of Ganeti master in eqsin T228099 [production]
11:00 <moritzm> drain ganeti5003 to test new Ganeti setup in eqsin T228099 [production]
10:53 <aborrero@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
10:53 <aborrero@cumin1001> START - Cookbook sre.hosts.downtime [production]
10:41 <moritzm> rebooting netflow5001 to pick up microcode [production]
10:08 <moritzm> enabling spec-ctr, ssbd. md-clear passthrough for new eqsin cluster T228099 [production]
09:27 <moritzm> installing urldownloader1002 T241979 [production]
09:11 <marostegui@cumin1001> dbctl commit (dc=all): 'Fully repool db1085', diff saved to https://phabricator.wikimedia.org/P10088 and previous config saved to /var/cache/conftool/dbconfig/20200108-091124-marostegui.json [production]
09:00 <moritzm> installing urldownloader1001 T241979 [production]
08:29 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1085', diff saved to https://phabricator.wikimedia.org/P10087 and previous config saved to /var/cache/conftool/dbconfig/20200108-082930-marostegui.json [production]
08:20 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1085', diff saved to https://phabricator.wikimedia.org/P10086 and previous config saved to /var/cache/conftool/dbconfig/20200108-082050-marostegui.json [production]
08:09 <marostegui> Upgrade db1085 [production]
08:08 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1085', diff saved to https://phabricator.wikimedia.org/P10085 and previous config saved to /var/cache/conftool/dbconfig/20200108-080853-marostegui.json [production]
08:07 <marostegui> Deploy schema change on s1 codfw, there will be lag on s1 codfw - T234052 [production]
07:57 <marostegui> Deploy schema change on clouddb2001-dev.labtestwiki - T234052 [production]
07:20 <marostegui@cumin1001> dbctl commit (dc=all): 'Fully repool db1079', diff saved to https://phabricator.wikimedia.org/P10084 and previous config saved to /var/cache/conftool/dbconfig/20200108-072017-marostegui.json [production]
07:13 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1079', diff saved to https://phabricator.wikimedia.org/P10083 and previous config saved to /var/cache/conftool/dbconfig/20200108-071312-marostegui.json [production]
07:07 <marostegui> Remove partitions from dewiki.revision on db1097:3315 T239453 [production]
07:07 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1097:3315', diff saved to https://phabricator.wikimedia.org/P10082 and previous config saved to /var/cache/conftool/dbconfig/20200108-070712-marostegui.json [production]
07:06 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1079', diff saved to https://phabricator.wikimedia.org/P10081 and previous config saved to /var/cache/conftool/dbconfig/20200108-070614-marostegui.json [production]
07:00 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1079', diff saved to https://phabricator.wikimedia.org/P10080 and previous config saved to /var/cache/conftool/dbconfig/20200108-070009-marostegui.json [production]
06:56 <marostegui> Upgrade db1079 [production]
06:44 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1079', diff saved to https://phabricator.wikimedia.org/P10079 and previous config saved to /var/cache/conftool/dbconfig/20200108-064404-marostegui.json [production]
06:42 <marostegui> Remove partitions from revision table on s6 for db1096:3316 - T239453 [production]
06:41 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1096:3316 - T239453', diff saved to https://phabricator.wikimedia.org/P10078 and previous config saved to /var/cache/conftool/dbconfig/20200108-064144-marostegui.json [production]
06:35 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1098:3316 - T239453', diff saved to https://phabricator.wikimedia.org/P10077 and previous config saved to /var/cache/conftool/dbconfig/20200108-063550-marostegui.json [production]
05:41 <XioNoX> enable netflow in eqsin [production]
03:54 <volker-e@deploy1001> Finished deploy [design/style-guide@ad595d5]: Deploy design/style-guide: (duration: 00m 08s) [production]
03:54 <volker-e@deploy1001> Started deploy [design/style-guide@ad595d5]: Deploy design/style-guide: [production]
00:38 <ebernhardson@deploy1001> Finished deploy [wikimedia/discovery/analytics@024488f]: airflow: set mjolnir dag start date to today (20200108) (duration: 00m 42s) [production]
00:37 <ebernhardson@deploy1001> Started deploy [wikimedia/discovery/analytics@024488f]: airflow: set mjolnir dag start date to today (20200108) [production]
00:21 <reedy@deploy1001> Synchronized wmf-config/throttle.php: T240845 (duration: 01m 04s) [production]
2020-01-07 §
23:53 <ebernhardson@deploy1001> Finished deploy [wikimedia/discovery/analytics@cb228ae]: Force python to use python3.5 dependencies (take two) (duration: 00m 10s) [production]
23:53 <ebernhardson@deploy1001> Started deploy [wikimedia/discovery/analytics@cb228ae]: Force python to use python3.5 dependencies (take two) [production]
23:36 <mutante> [puppetmaster2001:/var/run/confd-template] $ sudo rm .cloudceph*.err [production]
23:02 <cdanis> cp3055.mgmt% racadm serveraction powercycle T240425 [production]
20:42 <ebernhardson@deploy1001> Finished deploy [search/mjolnir/deploy@6c1f455]: Bump to master: Allow cli to load without pyspark (duration: 05m 55s) [production]