|
2015-05-14
§
|
| 23:20 |
<ori> |
Depooled mw1169; HHVM deadlock à la T89912. Leaving it depooled to investigate. |
[production] |
| 23:05 |
<demon> |
Synchronized wmf-config/InitialiseSettings.php: (no message) (duration: 00m 11s) |
[production] |
| 23:05 |
<demon> |
Synchronized w/static/images/project-logos/urwikiquote.png: (no message) (duration: 00m 14s) |
[production] |
| 23:03 |
<demon> |
Synchronized wmf-config/InitialiseSettings.php: (no message) (duration: 00m 17s) |
[production] |
| 22:26 |
<ori> |
Synchronized wmf-config/StartProfiler.php: Icbf826a7: 1:1000 request profiling via xhprof (duration: 00m 12s) |
[production] |
| 22:23 |
<gwicke> |
deployed RESTBase v0.6.3 (fd942ac38ad) |
[production] |
| 22:20 |
<ori> |
Synchronized php-1.26wmf6/extensions/CirrusSearch/includes/ElasticsearchIntermediary.php: (no message) (duration: 00m 15s) |
[production] |
| 21:39 |
<manybubbles> |
I'm going to be done doing rolling restarts for a couple of hours. If someone wants to pick them up and do the next one after the cluster goes green again then be my guest. |
[production] |
| 21:35 |
<manybubbles> |
es-tool restart-fast on elastic1016 |
[production] |
| 21:27 |
<ori> |
Synchronized php-1.26wmf6/extensions/CirrusSearch/includes/ElasticsearchIntermediary.php: (no message) (duration: 00m 12s) |
[production] |
| 21:27 |
<ori> |
Synchronized php-1.26wmf5/extensions/CirrusSearch/includes/ElasticsearchIntermediary.php: (no message) (duration: 00m 12s) |
[production] |
| 21:14 |
<ori> |
Synchronized php-1.26wmf6/extensions/CirrusSearch/includes/ElasticsearchIntermediary.php: I3df6713a1: Log request times to StatsD (duration: 00m 13s) |
[production] |
| 21:14 |
<ori> |
Synchronized php-1.26wmf5/extensions/CirrusSearch/includes/ElasticsearchIntermediary.php: I3df6713a1: Log request times to StatsD (duration: 00m 15s) |
[production] |
| 21:11 |
<manybubbles> |
elastic1015 es-tool restart-fast |
[production] |
| 19:43 |
<robh> |
mass unsubcription in listadmins list, resulting in unsupressed mass unsubscribe notices to all listadmin email address (sorry about the emails!) |
[production] |
| 19:24 |
<legoktm> |
Synchronized php-1.26wmf5/skins/Nostalgia/skin.json: touch (duration: 00m 17s) |
[production] |
| 19:15 |
<legoktm> |
debugging on tin / mw1017 for nostalgiawiki issue |
[production] |
| 16:59 |
<^d> |
elasticsearch: set transient cluster.routing.allocation.node_concurrent_recoveries on prod cluster to 8 (default: 2) to speed up recoveries. |
[production] |
| 16:52 |
<kartik> |
Finished scap: Update ContentTranslation (duration: 44m 07s) |
[production] |
| 16:29 |
<andrewbogott> |
disabling puppet on labnet1001 for testing |
[production] |
| 16:14 |
<godog> |
es-tool restart-fast on elastic1014 |
[production] |
| 16:08 |
<kartik> |
Started scap: Update ContentTranslation |
[production] |
| 15:46 |
<thcipriani> |
Synchronized php-1.26wmf5/extensions/Translate: SWAT update translate to a6f0a63 [[gerrit:210919]] (duration: 00m 15s) |
[production] |
| 15:12 |
<thcipriani> |
Synchronized wmf-config/InitialiseSettings.php: SWAT enable new article campaign except bawiki [[gerrit:210916]] (duration: 00m 12s) |
[production] |
| 15:04 |
<thcipriani> |
Synchronized wmf-config/InitialiseSettings.php: Open external links on votewiki in new tab [[gerrit:210849]] (duration: 00m 12s) |
[production] |
| 15:00 |
<godog> |
es-tool restart-fast on elastic1013 |
[production] |
| 14:48 |
<andyrussg> |
Synchronized php-1.26wmf6/extensions/CentralNotice/: Update CentralNotice (duration: 00m 13s) |
[production] |
| 14:34 |
<paravoid> |
reimaging multatuli |
[production] |
| 14:34 |
<jynus> |
migrating data db from virt1000 to db1009 |
[production] |
| 14:23 |
<bblack> |
restarted ganglia-monitor on eeden |
[production] |
| 14:21 |
<andyrussg> |
Synchronized php-1.26wmf5/extensions/CentralNotice/: Update CentralNotice (duration: 00m 12s) |
[production] |
| 14:16 |
<godog> |
es-tool restart-fast on elastic1012 |
[production] |
| 14:12 |
<paravoid> |
switching ns2 back to eeden |
[production] |
| 13:56 |
<cmjohnson1> |
upgrading tellurium to trusty |
[production] |
| 13:41 |
<cmjohnson1> |
power cycling barium |
[production] |
| 13:40 |
<godog> |
es-root restart-fast on elastic1011 |
[production] |
| 13:21 |
<paravoid> |
reimaging eeden with jessie |
[production] |
| 12:59 |
<paravoid> |
switching ns2 to multatuli |
[production] |
| 12:53 |
<jynus> |
disabling temporarily Ichinga check for MySQL running on db1009 until data is migrated from virt1000 and host sent to production |
[production] |
| 12:40 |
<akosiaris> |
uploaded to apt.wikimedia.org jessie-wikimedia: apertium-pt-gl_0.9.2~r60358-1 |
[production] |
| 12:36 |
<godog> |
es-tool restart-fast on elastic1010 |
[production] |
| 11:40 |
<manybubbles> |
restarting elasticsearch on elastic1009 |
[production] |
| 05:07 |
<LocalisationUpdate> |
ResourceLoader cache refresh completed at Thu May 14 05:06:09 UTC 2015 (duration 6m 8s) |
[production] |
| 02:55 |
<manybubbles> |
restarting elasticsearch on elastic1008 |
[production] |
| 02:51 |
<LocalisationUpdate> |
completed (1.26wmf6) at 2015-05-14 02:49:53+00:00 |
[production] |
| 02:47 |
<l10nupdate> |
Synchronized php-1.26wmf6/cache/l10n: (no message) (duration: 04m 16s) |
[production] |
| 02:44 |
<springle> |
xtrabackup clone db1056 to db1019 |
[production] |
| 02:29 |
<LocalisationUpdate> |
completed (1.26wmf5) at 2015-05-14 02:28:02+00:00 |
[production] |
| 02:24 |
<l10nupdate> |
Synchronized php-1.26wmf5/cache/l10n: (no message) (duration: 05m 51s) |
[production] |
| 01:48 |
<manybubbles> |
sorry - restarting elasticsearch on elastic1007 |
[production] |