2101-2150 of 10000 results (16ms)
2015-01-08 §
15:44 <_joe_> restarting hhvm on mw1226, TC full [production]
15:37 <_joe_> restarting hhvm on mw1113, stuck in parsing the ini file (HPHP::is_valid_var_name) [production]
15:08 <aude> Synchronized wmf-config/Wikibase.php: Bump cache epoch for test.wikidata (duration: 00m 06s) [production]
15:01 <aude> Finished scap: Update group0 to wmf/1.25wmf14 Wikidata extension branch (duration: 26m 43s) [production]
14:35 <aude> Started scap: Update group0 to wmf/1.25wmf14 Wikidata extension branch [production]
14:34 <Jeff_Green> samarium package updates and reboot [production]
11:37 <godog> reboot ms-be1011, xfs hosed :( [production]
11:07 <_joe_> repooled the canary servers [production]
10:55 <_joe_> installing a new hhvm package (with the correct libicu dependence) on canary hosts [production]
10:02 <godog> removing backend hosts from LVS for search pools [production]
09:42 <godog> restart uwsgi on tungsten [production]
08:15 <_joe_> depooled the canary appservers while a new package version is rebuilt [production]
08:11 <_joe_> installing a new hhvm package version on the canary pools [production]
03:06 <springle> xtrabackup clone db1037 to db1050 [production]
01:04 <bd808> cleaned up logstash indices dated 2014-01-* and 2015-12-* that look to have been created by some sort of syslog input parsing bug [production]
01:01 <bd808> accidentally deleted 2015-01-07 logstash index when cleaning up rogue indices for 2014-01-* [production]
00:40 <bd808> restarted elasticsearch on logstash1002 to heal split brain in cluster [production]
00:38 <bd808> elasticsearch cluster for logstash is split brain. [production]
00:38 <maxsem> Synchronized php-1.25wmf13/extensions/WikiGrok/: https://gerrit.wikimedia.org/r/#/c/183186/ (duration: 00m 07s) [production]
00:37 <maxsem> Synchronized php-1.25wmf14/extensions/WikiGrok/: https://gerrit.wikimedia.org/r/#/c/183186/ (duration: 00m 08s) [production]
00:34 <bd808> restarted logstash on logstash1001 [production]
00:11 <K4-713> updated payments settings [production]
2015-01-07 §
21:11 <subbu> deployed parsoid version 904fab9e [production]
19:51 <reedy> Synchronized wmf-config/InitialiseSettings.php: And disable error log again (duration: 00m 06s) [production]
19:49 <reedy> Synchronized wmf-config/InitialiseSettings.php: Enabling error log for a few minutes (duration: 00m 15s) [production]
19:44 <reedy> rebuilt wikiversions.cdb and synchronized wikiversions files: group0 to 1.25wmf14 [production]
19:42 <reedy> rebuilt wikiversions.cdb and synchronized wikiversions files: wikipedias to 1.25wmf13 [production]
19:36 <reedy> Finished scap: testwiki to 1.25wmf14... (duration: 28m 32s) [production]
19:08 <reedy> Started scap: testwiki to 1.25wmf14... [production]
18:42 <godog> reboot ms-be2011, megacli in a funny state and unable to bring new drive in service [production]
17:20 <ori> Synchronized php-1.25wmf13/extensions/EventLogging/modules/ext.eventLogging.core.js: I5470424: Correct events to send schema name (duration: 00m 05s) [production]
17:20 <ori> Synchronized php-1.25wmf12/extensions/EventLogging/modules/ext.eventLogging.core.js: I5470424: Correct events to send schema name (duration: 00m 06s) [production]
17:15 <godog> reboot ms-be2003 [production]
15:37 <springle> xtrabackup clone codfw slaves db2034 db2035 db2036 db2037 db2038 db2039 db2040 from other codfw slaves [production]
14:40 <_joe_> upgrading hhvm on testwiki [production]
14:16 <springle> xtrabackup clone db1027 to db1015 [production]
11:42 <_joe_> reimaging mw1009-mw1012 [production]
10:19 <godog> reboot ms-be2003, deleted LD should disappear [production]
09:47 <hashar> restarting Jenkins to resolve a deadlocks with the beta cluster jobs [production]
07:53 <_joe_> reimaging jobrunners mw1013-mw1016 (in batch of two) [production]
06:50 <springle> xtrabackup clone es2008 to es2010 [production]
06:50 <springle> xtrabackup clone es2006 to es2007 [production]
02:05 <kaldari> Synchronized php-1.25wmf13/extensions/WikiGrok/: Fixing campaign generation in WikiGrok (duration: 00m 05s) [production]
01:57 <ori> Synchronized php-1.25wmf13/extensions/EventLogging: I69c8daf: Update EventLogging for cherry-picks (duration: 00m 05s) [production]
01:57 <ori> Synchronized php-1.25wmf12/extensions/EventLogging: I07d9bc8: Update EventLogging for cherry-picks (duration: 00m 06s) [production]
01:33 <springle> xtrabackup clone es2008 to es2009 [production]
01:24 <kaldari> Synchronized php-1.25wmf13/extensions/MobileFrontend/: Sync MobileFrontend in 1.25wmf13 for VE fix (duration: 00m 05s) [production]
01:11 <springle> xtrabackup clone es2006 to es2005 [production]
2015-01-06 §
21:49 <awight> update crm from 80241fd2a43f03796b416d728661470f875a590a to 8ded33737337d0c842d8c194b5cb15b25fc99c2e [production]
20:24 <reedy> Synchronized wmf-config/: (no message) (duration: 00m 06s) [production]