|
2015-01-08
§
|
| 10:55 |
<_joe_> |
installing a new hhvm package (with the correct libicu dependence) on canary hosts |
[production] |
| 10:02 |
<godog> |
removing backend hosts from LVS for search pools |
[production] |
| 09:42 |
<godog> |
restart uwsgi on tungsten |
[production] |
| 08:15 |
<_joe_> |
depooled the canary appservers while a new package version is rebuilt |
[production] |
| 08:11 |
<_joe_> |
installing a new hhvm package version on the canary pools |
[production] |
| 03:06 |
<springle> |
xtrabackup clone db1037 to db1050 |
[production] |
| 01:04 |
<bd808> |
cleaned up logstash indices dated 2014-01-* and 2015-12-* that look to have been created by some sort of syslog input parsing bug |
[production] |
| 01:01 |
<bd808> |
accidentally deleted 2015-01-07 logstash index when cleaning up rogue indices for 2014-01-* |
[production] |
| 00:40 |
<bd808> |
restarted elasticsearch on logstash1002 to heal split brain in cluster |
[production] |
| 00:38 |
<bd808> |
elasticsearch cluster for logstash is split brain. |
[production] |
| 00:38 |
<maxsem> |
Synchronized php-1.25wmf13/extensions/WikiGrok/: https://gerrit.wikimedia.org/r/#/c/183186/ (duration: 00m 07s) |
[production] |
| 00:37 |
<maxsem> |
Synchronized php-1.25wmf14/extensions/WikiGrok/: https://gerrit.wikimedia.org/r/#/c/183186/ (duration: 00m 08s) |
[production] |
| 00:34 |
<bd808> |
restarted logstash on logstash1001 |
[production] |
| 00:11 |
<K4-713> |
updated payments settings |
[production] |
|
2015-01-07
§
|
| 21:11 |
<subbu> |
deployed parsoid version 904fab9e |
[production] |
| 19:51 |
<reedy> |
Synchronized wmf-config/InitialiseSettings.php: And disable error log again (duration: 00m 06s) |
[production] |
| 19:49 |
<reedy> |
Synchronized wmf-config/InitialiseSettings.php: Enabling error log for a few minutes (duration: 00m 15s) |
[production] |
| 19:44 |
<reedy> |
rebuilt wikiversions.cdb and synchronized wikiversions files: group0 to 1.25wmf14 |
[production] |
| 19:42 |
<reedy> |
rebuilt wikiversions.cdb and synchronized wikiversions files: wikipedias to 1.25wmf13 |
[production] |
| 19:36 |
<reedy> |
Finished scap: testwiki to 1.25wmf14... (duration: 28m 32s) |
[production] |
| 19:08 |
<reedy> |
Started scap: testwiki to 1.25wmf14... |
[production] |
| 18:42 |
<godog> |
reboot ms-be2011, megacli in a funny state and unable to bring new drive in service |
[production] |
| 17:20 |
<ori> |
Synchronized php-1.25wmf13/extensions/EventLogging/modules/ext.eventLogging.core.js: I5470424: Correct events to send schema name (duration: 00m 05s) |
[production] |
| 17:20 |
<ori> |
Synchronized php-1.25wmf12/extensions/EventLogging/modules/ext.eventLogging.core.js: I5470424: Correct events to send schema name (duration: 00m 06s) |
[production] |
| 17:15 |
<godog> |
reboot ms-be2003 |
[production] |
| 15:37 |
<springle> |
xtrabackup clone codfw slaves db2034 db2035 db2036 db2037 db2038 db2039 db2040 from other codfw slaves |
[production] |
| 14:40 |
<_joe_> |
upgrading hhvm on testwiki |
[production] |
| 14:16 |
<springle> |
xtrabackup clone db1027 to db1015 |
[production] |
| 11:42 |
<_joe_> |
reimaging mw1009-mw1012 |
[production] |
| 10:19 |
<godog> |
reboot ms-be2003, deleted LD should disappear |
[production] |
| 09:47 |
<hashar> |
restarting Jenkins to resolve a deadlocks with the beta cluster jobs |
[production] |
| 07:53 |
<_joe_> |
reimaging jobrunners mw1013-mw1016 (in batch of two) |
[production] |
| 06:50 |
<springle> |
xtrabackup clone es2008 to es2010 |
[production] |
| 06:50 |
<springle> |
xtrabackup clone es2006 to es2007 |
[production] |
| 02:05 |
<kaldari> |
Synchronized php-1.25wmf13/extensions/WikiGrok/: Fixing campaign generation in WikiGrok (duration: 00m 05s) |
[production] |
| 01:57 |
<ori> |
Synchronized php-1.25wmf13/extensions/EventLogging: I69c8daf: Update EventLogging for cherry-picks (duration: 00m 05s) |
[production] |
| 01:57 |
<ori> |
Synchronized php-1.25wmf12/extensions/EventLogging: I07d9bc8: Update EventLogging for cherry-picks (duration: 00m 06s) |
[production] |
| 01:33 |
<springle> |
xtrabackup clone es2008 to es2009 |
[production] |
| 01:24 |
<kaldari> |
Synchronized php-1.25wmf13/extensions/MobileFrontend/: Sync MobileFrontend in 1.25wmf13 for VE fix (duration: 00m 05s) |
[production] |
| 01:11 |
<springle> |
xtrabackup clone es2006 to es2005 |
[production] |
|
2015-01-06
§
|
| 21:49 |
<awight> |
update crm from 80241fd2a43f03796b416d728661470f875a590a to 8ded33737337d0c842d8c194b5cb15b25fc99c2e |
[production] |
| 20:24 |
<reedy> |
Synchronized wmf-config/: (no message) (duration: 00m 06s) |
[production] |
| 20:16 |
<Reedy> |
Ran namespaceDupes.php on ndswiktionary |
[production] |
| 20:16 |
<reedy> |
Synchronized wmf-config/: Config updates (duration: 00m 06s) |
[production] |
| 20:00 |
<reedy> |
Synchronized docroot and w: update noc index (duration: 00m 06s) |
[production] |
| 19:42 |
<demon> |
Finished scap: mwsearch is no more (duration: 35m 40s) |
[production] |
| 19:06 |
<demon> |
Started scap: mwsearch is no more |
[production] |
| 19:03 |
<reedy> |
rebuilt wikiversions.cdb and synchronized wikiversions files: nooop |
[production] |
| 19:01 |
<reedy> |
rebuilt wikiversions.cdb and synchronized wikiversions files: Non wikipedias to 1.25wmf13 |
[production] |
| 18:30 |
<godog> |
upload txstatsd 1.0.0-2 to trusty-wikimedia |
[production] |