2901-2950 of 10000 results (41ms)
2016-07-06 ยง
22:18 <maxsem@tin> Synchronized php-1.28.0-wmf.9/includes/diff: T139526 (duration: 00m 38s) [production]
20:44 <urandom> Restarting Cassandra instance restbase1008-b.eqiad.wmnet : T126629 [production]
20:41 <bearND> deployed mobileapps 7a73789 [production]
20:38 <bearND> starting mobileapps deploy [production]
20:37 <urandom> Restarting Cassandra instance restbase1008-a.eqiad.wmnet : T126629 [production]
20:23 <urandom> Disable Puppet on restbase1009.eqiad.wmnet : T126629 [production]
20:13 <urandom> Upgrade of restbase1013.eqiad.wmnet instances complete : T126629 [production]
20:06 <urandom> Restarting Cassandra instance restbase1013-b.eqiad.wmnet : T126629 [production]
20:00 <urandom> Restarting Cassandra instance restbase1013-a.eqiad.wmnet : T126629 [production]
19:58 <twentyafterfour> deployed 1.28.0-wmf.9 to group1 wikis: T138555 [production]
19:57 <urandom> Upgrading Cassandra package to 2.2.6-wmf1 on restbase1013.eqiad.wmnet : T126629 [production]
19:56 <twentyafterfour@tin> rebuilt wikiversions.php and synchronized wikiversions files: group1 wikis to 1.28.0-wmf.9 [production]
19:30 <urandom> Upgrade of restbase1012.eqiad.wmnet instances complete : T126629 [production]
19:24 <urandom> Restarting Cassandra instance restbase1012-c.eqiad.wmnet : T126629 [production]
19:18 <urandom> Restarting Cassandra instance restbase1012-b.eqiad.wmnet : T126629 [production]
19:09 <urandom> Restarting Cassandra instance restbase1012-a.eqiad.wmnet : T126629 [production]
19:07 <urandom> Upgrading Cassandra package to 2.2.6-wmf1 on restbase1012.eqiad.wmnet : T126629 [production]
18:57 <mutante> mw1133 puppet fail because out of memory, stop hhvm, run puppet [production]
18:55 <urandom> Cassandra upgrade of restbase1008.eqiad.wmnet instances complete : T126629 [production]
18:54 <mutante> labstore1001 - failed backup [production]
18:54 <mutante> mw1261 syntax error in Apache config [production]
18:52 <urandom> Restarting Cassandra instance restbase1008-c : T126629 [production]
18:51 <mutante> labstore2001 - RAID failure in Icinga (is it T102626 ?) [production]
18:47 <urandom> Restarting Cassandra instance restbase1008-b : T126629 [production]
18:46 <mutante> mw1261 restart hhvm service [production]
18:42 <urandom> Restarting Cassandra instance restbase1008-a : T126629 [production]
18:40 <urandom> Upgrading Cassandra package to 2.2.6-wmf1 on restbase1008 : T126629 [production]
17:14 <urandom> Disabling Puppet on restbase{1008,1012,1013}.eqiad.wmnet in preparation for rack 'b' Cassandra upgrade : T126629 [production]
16:53 <urandom> Upgrade of restbase1011.eqiad.wmnet instances to Cassandra 2.2.6 complete : T126629 [production]
16:50 <urandom> Restarting Cassandra for restbase1011-c.eqiad.wmnet : T126629 [production]
16:45 <urandom> Restarting Cassandra for restbase1011-b.eqiad.wmnet : T126629 [production]
16:41 <urandom> Restarting Cassandra fro restbase1011-a.eqiad.wmnet : T126629 [production]
16:39 <urandom> Upgrading Cassandra package to 2.2.6-wmf1 on restbase1011.eqiad.wmnet : T126629 [production]
16:26 <awight> update orphan rectifier from 2fc573cbb94e833c4144aa9dad79de8ec374bb09 to 70a7baa9f77c2510739bab0ff9d1b51578a59a6e [production]
16:25 <urandom> Upgrade of restbase1010.eqiad.wmnet instances complete : T126629 [production]
16:25 <awight> update orphan rectifier config to add payments 4 to the Redis pool [production]
16:22 <urandom> Restarting Cassandra for restbase1010-c.eqiad.wmnet : T126629 [production]
15:59 <urandom> Restarting Cassandra for restbase1010-b.eqiad.wmnet : T126629 [production]
15:47 <urandom> Restarting Cassandra for restbase1010-a.eqiad.wmnet : T126629 [production]
15:45 <urandom> Re-enabling Puppet on restbase1010 : T126629 [production]
15:44 <urandom> Upgrading Cassandra to 2.2.6-wmf1 on restbase1010 : T126629 [production]
15:36 <thcipriani@tin> Synchronized php-1.28.0-wmf.9/extensions/Echo/modules/styles: SWAT: [[gerrit:297594|Set width to Special:Notifications (T138433)]] (duration: 00m 30s) [production]
15:29 <elukey> restarting the hdfs datanode on each analytics* Hadoop server to force the new -Xmx2048 heap setting to be picked up [production]
15:27 <thcipriani@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:297438|Enable Echo transition flags everywhere]] (duration: 00m 26s) [production]
15:22 <thcipriani@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:297283|Enable autopatrolled user group at urwiki (T139302)]] (duration: 00m 30s) [production]
15:18 <thcipriani@tin> Synchronized php-1.28.0-wmf.9/includes/diff/DifferenceEngine.php: [[gerrit:297547|Show parser output for diffs unless extension aborts (T139433)]] (duration: 00m 30s) [production]
15:08 <urandom> Disabling puppet on restbase101[0-1].eqiad.wmnet in preparation for 2.2.6 upgrade : T126629 [production]
15:02 <akosiaris> poweroff prometheus2002 from dbrb -> plain conversion [production]
15:00 <_joe_> depooling mw1261, installing an apache package with additional fixes (T73487) [production]
14:19 <moritzm> rebooting californium for kernel update (hosting horizon.wikimedia.org) [production]