|
2017-09-27
§
|
| 14:23 |
<akosiaris@puppetmaster1001> |
conftool action : set/weight=5; selector: name=wtp1008.eqiad.wmnet |
[production] |
| 14:23 |
<akosiaris@puppetmaster1001> |
conftool action : set/weight=5; selector: name=wtp1007.eqiad.wmnet |
[production] |
| 14:22 |
<akosiaris@puppetmaster1001> |
conftool action : set/weight=5; selector: name=wtp1006.eqiad.wmnet |
[production] |
| 14:22 |
<akosiaris@puppetmaster1001> |
conftool action : set/weight=5; selector: name=wtp1005.eqiad.wmnet |
[production] |
| 14:22 |
<akosiaris@puppetmaster1001> |
conftool action : set/weight=5; selector: name=wtp1004.eqiad.wmnet |
[production] |
| 14:22 |
<akosiaris@puppetmaster1001> |
conftool action : set/weight=5; selector: name=wtp1003.eqiad.wmnet |
[production] |
| 14:22 |
<akosiaris@puppetmaster1001> |
conftool action : set/weight=5; selector: name=wtp1002.eqiad.wmnet |
[production] |
| 14:22 |
<akosiaris@puppetmaster1001> |
conftool action : set/weight=5; selector: name=wtp1001.eqiad.wmnet |
[production] |
| 14:17 |
<akosiaris> |
T175242 restart eventstreams across the fleet to pick up the change in a rolling restart manner with a batch size of 2 |
[production] |
| 14:16 |
<akosiaris> |
T175242 restart parsoid across the fleet to pick up the change in a rolling restart manner with a batch size of 5 |
[production] |
| 14:03 |
<akosiaris> |
T175242 restart tilerator, tileratorui, restbase across the fleet to pick up the change in a rolling restart manner with a batch size of 2 |
[production] |
| 13:43 |
<akosiaris> |
T175242 re-enable puppet across aqs kafka maps maps-test ores restbase restbase-dev sca scb wtp clusters for merging https://gerrit.wikimedia.org/r/#/c/376500/. Run puppet as well in a batched execution |
[production] |
| 13:42 |
<anomie@tin> |
Synchronized php-1.31.0-wmf.1/includes/specials/SpecialWatchlist.php: SWAT: {{gerrit|380968}} Fix watchlist "in the last X hours" display (duration: 00m 48s) |
[production] |
| 13:42 |
<elukey> |
raised Hadoop HDFS namenode master daemon max heap size to 6G (prev 4G) on analytics100[12] |
[production] |
| 13:31 |
<akosiaris> |
T175242 eventstreams requires manual restart |
[production] |
| 13:25 |
<akosiaris> |
T175242 parsoid requires manual restart |
[production] |
| 13:15 |
<akosiaris> |
T175242 restbase requires manual restart |
[production] |
| 13:11 |
<addshore> |
SWAT done |
[production] |
| 13:11 |
<addshore@tin> |
Synchronized php-1.31.0-wmf.1/extensions/TwoColConflict/modules/ext.TwoColConflict.BaseVersionSelector.css: SWAT: [[gerrit:380930|Address changes in the label style in OOUI]] (duration: 00m 46s) |
[production] |
| 13:09 |
<zfilipin@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:380689|Add autopatrolled user group to dty.wikipedia (T176709)]] (duration: 00m 47s) |
[production] |
| 13:01 |
<akosiaris> |
T175242 tilerator and tileratorui need manually restart |
[production] |
| 12:54 |
<akosiaris> |
T175242 enabled puppet in aqs kafka maps maps-test selected hosts and ran puppet manually. |
[production] |
| 12:47 |
<akosiaris> |
T175242 disable puppet across aqs kafka maps maps-test ores restbase restbase-dev sca scb wtp clusters for merging https://gerrit.wikimedia.org/r/#/c/376500/ |
[production] |
| 12:20 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Add db1103 to the array of hosts (duration: 00m 48s) |
[production] |
| 12:19 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Add db1103 to the array of hosts (duration: 00m 49s) |
[production] |
| 12:14 |
<moritzm> |
installing apache updates on einsteinium/tegmen |
[production] |
| 12:06 |
<hoo@tin> |
Synchronized wmf-config/InitialiseSettings.php: Enable the ArticlePlaceholder on bnwiki (T176771) (duration: 00m 49s) |
[production] |
| 12:05 |
<hoo@tin> |
Synchronized wmf-config/InitialiseSettings.php: Enable the ArticlePlaceholder on bnwiki (T176771) (duration: 01m 00s) |
[production] |
| 09:45 |
<marostegui> |
Stop mysql on db1035 to copy its data to db1103 - T172679 |
[production] |
| 09:42 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Depool db1035 to transfer its data to db1103 - T172679 (duration: 00m 48s) |
[production] |
| 08:55 |
<mobrovac@tin> |
Finished deploy [changeprop/deploy@7a3dc66]: Use the /page/title/{title}/{revision} end point for revision-visibility-change - T158100 (duration: 01m 26s) |
[production] |
| 08:53 |
<mobrovac@tin> |
Started deploy [changeprop/deploy@7a3dc66]: Use the /page/title/{title}/{revision} end point for revision-visibility-change - T158100 |
[production] |
| 08:43 |
<mobrovac@tin> |
Finished deploy [restbase/deploy@1cc530b]: Introduce the /page/title/{title}/{revision} end point - T158100 (duration: 10m 01s) |
[production] |
| 08:34 |
<elukey> |
raise traffic weights to 30 for mw13[19-28] incrementally - T165519 |
[production] |
| 08:33 |
<mobrovac@tin> |
Started deploy [restbase/deploy@1cc530b]: Introduce the /page/title/{title}/{revision} end point - T158100 |
[production] |
| 08:16 |
<marostegui> |
Optimize tables pagelinks templatelinks on db2064 and db2063 - T174509 |
[production] |
| 08:16 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Depool db2064 db2063 to optimize templatelinks and pagelinks tables - T174509 (duration: 00m 48s) |
[production] |
| 07:55 |
<marostegui> |
Optimize pagelinks and template links tables on db2076 db2067 db2060 - T174509 |
[production] |
| 07:52 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Depool db2076 db2067 db2060 to optimize templatelinks and pagelinks tables - T174509 (duration: 00m 48s) |
[production] |
| 07:37 |
<marostegui> |
Optimize pagelinks and template links tables on db2070 db2069 db2042 db2016 - T174509 |
[production] |
| 07:27 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Depool db2070, db2069 and db2042 to optimize templatelinks and pagelinks tables - T174509 (duration: 00m 48s) |
[production] |
| 07:17 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Repool db2071 and db2072 - T174509 (duration: 00m 47s) |
[production] |
| 06:57 |
<marostegui> |
Deploy alter table on s6 codfw - T174509 |
[production] |
| 06:55 |
<marostegui> |
Deploy alter table on db1052 (enwiki master) - T174509 |
[production] |
| 06:37 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Add task number to db2044 line (duration: 00m 48s) |
[production] |
| 06:37 |
<ema> |
restart varnish-be on cp3040 |
[production] |
| 06:36 |
<moritzm> |
installing git security updates (our config is not affected, but still fixing the underlying issue) |
[production] |
| 06:33 |
<ema> |
restart varnish-be on cp3041 |
[production] |
| 06:29 |
<marosteg1i> |
Reboot db2044 after storage failure - T174764 |
[production] |
| 06:15 |
<elukey> |
restart varnish backend on cp3043 |
[production] |