1701-1750 of 10000 results (31ms)
2020-06-16 §
07:31 <liw@deploy1001> Pruned MediaWiki: 1.35.0-wmf.34 (duration: 11m 52s) [production]
07:23 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.prepare-upgrade (exit_code=0) [production]
07:08 <ayounsi@cumin1001> START - Cookbook sre.network.prepare-upgrade [production]
07:07 <liw> 1.35.0-wmf.37 was branched at f856960f17b2a477640c5d848926c04f0d56196c for T254174 [production]
07:06 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1148', diff saved to https://phabricator.wikimedia.org/P11526 and previous config saved to /var/cache/conftool/dbconfig/20200616-070651-marostegui.json [production]
07:04 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1148', diff saved to https://phabricator.wikimedia.org/P11525 and previous config saved to /var/cache/conftool/dbconfig/20200616-070450-marostegui.json [production]
07:04 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1084', diff saved to https://phabricator.wikimedia.org/P11524 and previous config saved to /var/cache/conftool/dbconfig/20200616-070429-marostegui.json [production]
07:02 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1084', diff saved to https://phabricator.wikimedia.org/P11523 and previous config saved to /var/cache/conftool/dbconfig/20200616-070209-marostegui.json [production]
06:57 <marostegui> Compress InnoDB on db1134 T254462 [production]
06:56 <marostegui@cumin2001> dbctl commit (dc=all): 'Depool db1134 for InnoDB compression T254462', diff saved to https://phabricator.wikimedia.org/P11522 and previous config saved to /var/cache/conftool/dbconfig/20200616-065600-marostegui.json [production]
06:55 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.prepare-upgrade (exit_code=0) [production]
06:54 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1093', diff saved to https://phabricator.wikimedia.org/P11521 and previous config saved to /var/cache/conftool/dbconfig/20200616-065412-marostegui.json [production]
06:40 <ayounsi@cumin1001> START - Cookbook sre.network.prepare-upgrade [production]
06:25 <elukey> roll restart memcached on mc-gp* (gutter pools) to pick up new slab size distribution setting - T252391 [production]
06:04 <hashar> Restarted Zuul scheduler and merger on contint2001 a couple hotfixes # T252310 T255424 [production]
05:54 <volker-e@deploy1001> Finished deploy [design/style-guide@37c67dd]: Deploy design/style-guide: (duration: 00m 05s) [production]
05:54 <volker-e@deploy1001> Started deploy [design/style-guide@37c67dd]: Deploy design/style-guide: [production]
05:04 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
05:01 <marostegui@cumin1001> START - Cookbook sre.hosts.downtime [production]
04:59 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1146:3314', diff saved to https://phabricator.wikimedia.org/P11520 and previous config saved to /var/cache/conftool/dbconfig/20200616-045958-marostegui.json [production]
04:57 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1146:3314', diff saved to https://phabricator.wikimedia.org/P11519 and previous config saved to /var/cache/conftool/dbconfig/20200616-045744-marostegui.json [production]
04:56 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1147', diff saved to https://phabricator.wikimedia.org/P11518 and previous config saved to /var/cache/conftool/dbconfig/20200616-045636-marostegui.json [production]
04:55 <marostegui> Deploy schema change on db1147 [production]
04:54 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1147', diff saved to https://phabricator.wikimedia.org/P11517 and previous config saved to /var/cache/conftool/dbconfig/20200616-045451-marostegui.json [production]
04:46 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1149', diff saved to https://phabricator.wikimedia.org/P11516 and previous config saved to /var/cache/conftool/dbconfig/20200616-044612-marostegui.json [production]
04:44 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1149', diff saved to https://phabricator.wikimedia.org/P11515 and previous config saved to /var/cache/conftool/dbconfig/20200616-044409-marostegui.json [production]
04:43 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1143', diff saved to https://phabricator.wikimedia.org/P11514 and previous config saved to /var/cache/conftool/dbconfig/20200616-044326-marostegui.json [production]
04:41 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1143', diff saved to https://phabricator.wikimedia.org/P11513 and previous config saved to /var/cache/conftool/dbconfig/20200616-044126-marostegui.json [production]
04:40 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1138', diff saved to https://phabricator.wikimedia.org/P11512 and previous config saved to /var/cache/conftool/dbconfig/20200616-044036-marostegui.json [production]
04:37 <marostegui> Deploy schema change on db1138 [production]
04:37 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1138', diff saved to https://phabricator.wikimedia.org/P11511 and previous config saved to /var/cache/conftool/dbconfig/20200616-043748-marostegui.json [production]
00:28 <tstarling@deploy1001> Synchronized wmf-config/CommonSettings.php: limit HTTP client timeout T245170 (duration: 00m 56s) [production]
00:25 <tstarling@deploy1001> Synchronized wmf-config/set-time-limit.php: expose excimer timeout as a global variable T245170 (duration: 00m 56s) [production]
00:16 <ebernhardson@deploy1001> Finished deploy [wikimedia/discovery/analytics@17212bb]: airflow: migrate leven-dist to edit-dist (duration: 00m 45s) [production]
00:16 <volker-e@deploy1001> Finished deploy [design/style-guide@37c67dd]: Deploy design/style-guide: (duration: 00m 04s) [production]
00:16 <volker-e@deploy1001> Started deploy [design/style-guide@37c67dd]: Deploy design/style-guide: [production]
00:16 <ebernhardson@deploy1001> Started deploy [wikimedia/discovery/analytics@17212bb]: airflow: migrate leven-dist to edit-dist [production]
2020-06-15 §
23:56 <tstarling@deploy1001> Synchronized wmf-config/PoolCounterSettings.php: reducing connect timeout per T105378 (duration: 01m 00s) [production]
23:31 <ebernhardson@deploy1001> Finished deploy [wikimedia/discovery/analytics@eb0ac12]: Ship templatad table names in HivePartitionRangeSensor (duration: 00m 49s) [production]
23:30 <ebernhardson@deploy1001> Started deploy [wikimedia/discovery/analytics@eb0ac12]: Ship templatad table names in HivePartitionRangeSensor [production]
22:58 <krinkle@deploy1001> Synchronized wmf-config/PhpAutoPrepend.php: If7e1613cbcf8 (duration: 00m 56s) [production]
22:57 <krinkle@deploy1001> Synchronized wmf-config/profiler.php: If7e1613cbcf8 (duration: 00m 59s) [production]
22:02 <bstorm_> downtimed puppet alerts for testing some changes on labstore1004/5 [production]
20:59 <ebernhardson@deploy1001> Finished deploy [search/airflow@62a024b]: Add pydruid to airflow (duration: 00m 50s) [production]
20:58 <ebernhardson@deploy1001> Started deploy [search/airflow@62a024b]: Add pydruid to airflow [production]
20:55 <shdubsh> update mtail to 3.0.0~rc35 on the rest of the hosts - eqiad and esams [production]
20:44 <shdubsh> update mtail to 3.0.0~rc35 on cp nodes in eqiad and esams [production]
20:30 <shdubsh> update mtail to 3.0.0~rc35 on wtp in eqiad [production]
19:35 <shdubsh> update mtail to 3.0.0~rc35 on mw in eqiad [production]
18:50 <ebernhardson@deploy1001> Finished deploy [wikimedia/discovery/analytics@41186c8]: port glent from oozie to airflow (duration: 00m 39s) [production]