801-850 of 10000 results (51ms)
2017-09-27 ยง
14:45 <elukey> rolling restart of all the Yarn nodemanager daemons on analytics1028-1068 [production]
14:43 <bblack> cp1008/pinkunicorn upgraded to test build of nginx-1.13.5-1+wmf1 [production]
14:28 <volans> uploaded cumin_1.2.1-1_amd64.deb to apt.wikimedia.org jessie-wikimedia [production]
14:24 <akosiaris> change wtp1001 to wtp1024 weights to 5 from 15 in preparation for deprecation [production]
14:24 <akosiaris@puppetmaster1001> conftool action : set/weight=5; selector: name=wtp1024.eqiad.wmnet [production]
14:24 <mlitn@tin> Started scap: Enable 3D extension [production]
14:23 <akosiaris@puppetmaster1001> conftool action : set/weight=5; selector: name=wtp1023.eqiad.wmnet [production]
14:23 <akosiaris@puppetmaster1001> conftool action : set/weight=5; selector: name=wtp1022.eqiad.wmnet [production]
14:23 <akosiaris@puppetmaster1001> conftool action : set/weight=5; selector: name=wtp1021.eqiad.wmnet [production]
14:23 <akosiaris@puppetmaster1001> conftool action : set/weight=5; selector: name=wtp1020.eqiad.wmnet [production]
14:23 <akosiaris@puppetmaster1001> conftool action : set/weight=5; selector: name=wtp1019.eqiad.wmnet [production]
14:23 <akosiaris@puppetmaster1001> conftool action : set/weight=5; selector: name=wtp1018.eqiad.wmnet [production]
14:23 <akosiaris@puppetmaster1001> conftool action : set/weight=5; selector: name=wtp1017.eqiad.wmnet [production]
14:23 <akosiaris@puppetmaster1001> conftool action : set/weight=5; selector: name=wtp1016.eqiad.wmnet [production]
14:23 <akosiaris@puppetmaster1001> conftool action : set/weight=5; selector: name=wtp1015.eqiad.wmnet [production]
14:23 <akosiaris@puppetmaster1001> conftool action : set/weight=5; selector: name=wtp1014.eqiad.wmnet [production]
14:23 <akosiaris@puppetmaster1001> conftool action : set/weight=5; selector: name=wtp1013.eqiad.wmnet [production]
14:23 <akosiaris@puppetmaster1001> conftool action : set/weight=5; selector: name=wtp1012.eqiad.wmnet [production]
14:23 <akosiaris@puppetmaster1001> conftool action : set/weight=5; selector: name=wtp1011.eqiad.wmnet [production]
14:23 <akosiaris@puppetmaster1001> conftool action : set/weight=5; selector: name=wtp1010.eqiad.wmnet [production]
14:23 <akosiaris@puppetmaster1001> conftool action : set/weight=5; selector: name=wtp1009.eqiad.wmnet [production]
14:23 <akosiaris@puppetmaster1001> conftool action : set/weight=5; selector: name=wtp1008.eqiad.wmnet [production]
14:23 <akosiaris@puppetmaster1001> conftool action : set/weight=5; selector: name=wtp1007.eqiad.wmnet [production]
14:22 <akosiaris@puppetmaster1001> conftool action : set/weight=5; selector: name=wtp1006.eqiad.wmnet [production]
14:22 <akosiaris@puppetmaster1001> conftool action : set/weight=5; selector: name=wtp1005.eqiad.wmnet [production]
14:22 <akosiaris@puppetmaster1001> conftool action : set/weight=5; selector: name=wtp1004.eqiad.wmnet [production]
14:22 <akosiaris@puppetmaster1001> conftool action : set/weight=5; selector: name=wtp1003.eqiad.wmnet [production]
14:22 <akosiaris@puppetmaster1001> conftool action : set/weight=5; selector: name=wtp1002.eqiad.wmnet [production]
14:22 <akosiaris@puppetmaster1001> conftool action : set/weight=5; selector: name=wtp1001.eqiad.wmnet [production]
14:17 <akosiaris> T175242 restart eventstreams across the fleet to pick up the change in a rolling restart manner with a batch size of 2 [production]
14:16 <akosiaris> T175242 restart parsoid across the fleet to pick up the change in a rolling restart manner with a batch size of 5 [production]
14:03 <akosiaris> T175242 restart tilerator, tileratorui, restbase across the fleet to pick up the change in a rolling restart manner with a batch size of 2 [production]
13:43 <akosiaris> T175242 re-enable puppet across aqs kafka maps maps-test ores restbase restbase-dev sca scb wtp clusters for merging https://gerrit.wikimedia.org/r/#/c/376500/. Run puppet as well in a batched execution [production]
13:42 <anomie@tin> Synchronized php-1.31.0-wmf.1/includes/specials/SpecialWatchlist.php: SWAT: {{gerrit|380968}} Fix watchlist "in the last X hours" display (duration: 00m 48s) [production]
13:42 <elukey> raised Hadoop HDFS namenode master daemon max heap size to 6G (prev 4G) on analytics100[12] [production]
13:40 <elukey> manual failover of HDFS namenode from an1002 to an1001 [analytics]
13:31 <akosiaris> T175242 eventstreams requires manual restart [production]
13:25 <akosiaris> T175242 parsoid requires manual restart [production]
13:17 <elukey> manual failover of HDFS namenode from an1001 to an1002 to test 6G max heap size [analytics]
13:15 <akosiaris> T175242 restbase requires manual restart [production]
13:14 <elukey> restart mapreduce history server on analytics1001 after crash (java.lang.OutOfMemoryError: GC overhead limit exceeded) [analytics]
13:11 <addshore> SWAT done [production]
13:11 <addshore@tin> Synchronized php-1.31.0-wmf.1/extensions/TwoColConflict/modules/ext.TwoColConflict.BaseVersionSelector.css: SWAT: [[gerrit:380930|Address changes in the label style in OOUI]] (duration: 00m 46s) [production]
13:09 <zfilipin@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:380689|Add autopatrolled user group to dty.wikipedia (T176709)]] (duration: 00m 47s) [production]
13:01 <akosiaris> T175242 tilerator and tileratorui need manually restart [production]
12:54 <akosiaris> T175242 enabled puppet in aqs kafka maps maps-test selected hosts and ran puppet manually. [production]
12:47 <akosiaris> T175242 disable puppet across aqs kafka maps maps-test ores restbase restbase-dev sca scb wtp clusters for merging https://gerrit.wikimedia.org/r/#/c/376500/ [production]
12:38 <addshore> Reloading Zuul to deploy - Add lintr-docker-non-voting [integration/config] - https://gerrit.wikimedia.org/r/380746 [releng]
12:27 <hasharAway> docker push wmfreleng/tox:v2017.09.27.12.26 https://gerrit.wikimedia.org/r/#/c/380926/ [releng]
12:20 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Add db1103 to the array of hosts (duration: 00m 48s) [production]