4751-4800 of 10000 results (43ms)
2017-01-24 ยง
20:49 <twentyafterfour@tin> Started scap: test wikis to 1.29.0-wmf.9 refs T155525 [production]
20:49 <volans> disabled puppet on ruthenium to avoid the restart of parsoid-vd and parsoid-vd-client processes T156177 [production]
20:09 <demon@tin> Synchronized docroot: Adding new wikimediafoundation.org docroot (duration: 01m 05s) [production]
19:51 <volans> ruthenium: stopped parsoid-vd and parsoid-vd-client to avoid uncontrolled spawning of phantomjs childs [production]
19:39 <volans> sudo service parsoid-vd stop on ruthenium [production]
19:37 <twentyafterfour> branching 1.29.0-wmf.9 refs T154683 [production]
19:35 <volans> killed 822 "/srv/visualdiff/node_modules/phantomjs/lib/phantom/bin/phantomjs" processes on ruthenium. RAM and swap full, host unresponsive [production]
19:29 <jynus> change replication master of db1095 to db1065 [production]
19:07 <jynus> change replication master of db1095 to db1052 [production]
19:07 <demon@tin> Synchronized docroot/foundation/logos: rm some old junk logos (duration: 00m 42s) [production]
18:58 <arlolra> Updated Parsoid to version d000fdb4 (T58846, T154804, T152633) [production]
18:45 <arlolra@tin> Finished deploy [parsoid/deploy@c1a14c0]: Retry updating Parsoid to d000fdb4 (duration: 04m 14s) [production]
18:41 <arlolra@tin> Starting deploy [parsoid/deploy@c1a14c0]: Retry updating Parsoid to d000fdb4 [production]
18:40 <arlolra@tin> Finished deploy [parsoid/deploy@c1a14c0]: Updating Parsoid to d000fdb4 (duration: 21m 28s) [production]
18:37 <demon@tin> Synchronized docroot: tidying up mobileportal docroot stuff (duration: 00m 41s) [production]
18:24 <demon@tin> Synchronized docroot: Removing old wikidata docroot (duration: 00m 46s) [production]
18:19 <arlolra@tin> Starting deploy [parsoid/deploy@c1a14c0]: Updating Parsoid to d000fdb4 [production]
18:10 <marostegui> restart mysql db1065 maintenance - https://phabricator.wikimedia.org/T155999) [production]
18:07 <mutante> planet2001 - re-adding to puppet, revoke old cert, sign new cert, initial run [production]
18:02 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1065 - T156006 (duration: 00m 49s) [production]
16:54 <andrewbogott> tools deleting tools-mail-01 [production]
16:52 <mutante> planet2001 - reinstalling to test DHCP/TFTP from install2001 [production]
16:37 <elukey> upgrading aqs1004 to node6 [production]
16:26 <marostegui> Restart mysql db1072 [production]
16:22 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1072 - T156006 (duration: 00m 41s) [production]
16:18 <paravoid> removing lvs4002_T151273 policy from cr1/2-ulsfo [production]
16:15 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1072 - T156006 (duration: 00m 47s) [production]
16:12 <godog> kill stray swift-proxy processes from ms-fe1* T156143 [production]
16:07 <filippo@puppetmaster1001> conftool action : set/pooled=yes; selector: name=ms-fe1001.eqiad.wmnet [production]
16:04 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1073 - T155999 (duration: 00m 48s) [production]
15:58 <moritzm> upgraded nodejs on thorium to 6.9 / restarted pivot [production]
15:57 <papaul> shutting down ms-be2002 for maintenance [production]
15:54 <chasemp> drbdadm adjust tools for 1004/1005 w/ 192.168.0.0/30 [production]
15:49 <moritzm> installing tomcat7 security updates on trusty hosts (jessie already fixed a while ago) [production]
15:14 <godog> bounce pybal on lvs1003 - T134893 [production]
15:10 <chasemp> drbdadm adjust misc for 1004/1005 w/ 192.168.0.0/30 [production]
15:09 <filippo@puppetmaster1001> conftool action : set/pooled=no; selector: name=ms-fe1001.eqiad.wmnet [production]
15:08 <filippo@puppetmaster1001> conftool action : set/pooled=yes; selector: name=ms-fe1001.eqiad.wmnet [production]
15:07 <chasemp> drbdadm adjust test for 1004/1005 w/ 192.168.0.0/30 [production]
15:04 <chasemp> recabling labstore1004/1005 eth1 [production]
14:55 <marostegui> Stop replication on db1052 and db1073 for maintenance - T156006 [production]
14:54 <filippo@puppetmaster1001> conftool action : set/pooled=no; selector: name=ms-fe1001.eqiad.wmnet [production]
14:50 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1073 - T155999 (duration: 00m 39s) [production]
14:41 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1051 with less weight - T156004 (duration: 00m 41s) [production]
14:26 <dcausse> EU SWAT Done [production]
14:23 <dcausse@tin> Synchronized wmf-config/InitialiseSettings.php: T155515 [cirrus] properly set wgCirrusSearchUseIcuFolding (duration: 00m 39s) [production]
14:13 <dcausse@tin> Synchronized wmf-config/InitialiseSettings.php: T155142 [cirrus] Increase weigths for content namespaces on mw.org (duration: 00m 39s) [production]
13:49 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Change db1052 IP - T156006 (duration: 00m 39s) [production]
13:48 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Change db1052 IP - T156006 (duration: 00m 39s) [production]
13:41 <marostegui> Shutdown db1052 for maintenance - T156006 [production]