|
2015-08-13
§
|
| 21:16 |
<mutante> |
torrus broken - doing https://wikitech.wikimedia.org/wiki/Torrus#Deadlock_problem |
[production] |
| 21:14 |
<mutante> |
service gitblit restart on antimony (maybe that should be paging :) |
[production] |
| 21:06 |
<bd808> |
`sudo /etc/init.d/ganglia-monitor restart` on logstash100[1-6] fixed ganglia data loss |
[production] |
| 20:46 |
<mutante> |
killed ganglia aggregator for logstash on carbon |
[production] |
| 20:40 |
<bd808> |
ganglia not getting elasticsearch jvm data for logstash cluster since 2015-08-13T12:00 -- https://ganglia.wikimedia.org/latest/?c=Logstash+cluster+eqiad&&m=es_heap_used |
[production] |
| 19:56 |
<twentyafterfour@tin> |
rebuilt wikiversions.cdb and synchronized wikiversions files: all wikis to 1.26wmf18 |
[production] |
| 19:38 |
<demon@tin> |
Synchronized php-1.26wmf18/extensions/CirrusSearch/: (no message) (duration: 00m 11s) |
[production] |
| 19:35 |
<demon@tin> |
Synchronized php-1.26wmf18/extensions/Graph: (no message) (duration: 00m 10s) |
[production] |
| 19:31 |
<demon@tin> |
Synchronized php-1.26wmf18/extensions/Graph: (no message) (duration: 00m 11s) |
[production] |
| 18:32 |
<ori@tin> |
Synchronized php-1.26wmf18/extensions/SyntaxHighlight_GeSHi/extension.json: If0851400: Fix-up for I2de8a400d: explicitly declare module position (duration: 00m 12s) |
[production] |
| 17:47 |
<kaldari@tin> |
Synchronized wmf-config/InitialiseSettings.php: syncing InitialiseSettings for WikidataPageBanner (duration: 00m 12s) |
[production] |
| 17:46 |
<kaldari@tin> |
Finished scap: (no message) (duration: 50m 05s) |
[production] |
| 16:55 |
<kaldari@tin> |
Started scap: (no message) |
[production] |
| 16:54 |
<kaldari@tin> |
Synchronized wmf-config/InitialiseSettings.php: syncing InitialiseSettings for WikidataPageBanner off (duration: 00m 11s) |
[production] |
| 16:51 |
<kaldari@tin> |
Synchronized wmf-config/CommonSettings.php: syncing CommonSettings for WikidataPageBanner (duration: 00m 12s) |
[production] |
| 16:50 |
<kaldari@tin> |
Synchronized wmf-config/InitialiseSettings.php: syncing InitialiseSettings for WikidataPageBanner (duration: 00m 12s) |
[production] |
| 16:50 |
<kaldari@tin> |
Synchronized wmf-config/extension-list: syncing extension-list for WikidataPageBanner (duration: 00m 11s) |
[production] |
| 16:31 |
<kaldari@tin> |
Synchronized php-1.26wmf18/.gitmodules: (no message) (duration: 00m 11s) |
[production] |
| 16:30 |
<kaldari@tin> |
Synchronized php-1.26wmf17/.gitmodules: (no message) (duration: 00m 13s) |
[production] |
| 16:29 |
<kaldari@tin> |
Synchronized php-1.26wmf17/extensions/WikidataPageBanner: (no message) (duration: 00m 12s) |
[production] |
| 16:29 |
<kaldari@tin> |
Synchronized php-1.26wmf18/extensions/WikidataPageBanner: (no message) (duration: 00m 12s) |
[production] |
| 16:24 |
<demon@tin> |
Synchronized wmf-config/: undeploy wikigrok (duration: 00m 12s) |
[production] |
| 16:12 |
<yurik> |
sync deployed tilerator |
[production] |
| 15:20 |
<thcipriani@tin> |
Synchronized php-1.26wmf17/extensions/ContentTranslation/modules/tools/ext.cx.tools.images.js: SWAT: Images: validate image id before adapting to prevent js error [[gerrit:231229]] (duration: 00m 11s) |
[production] |
| 15:10 |
<thcipriani@tin> |
Synchronized php-1.26wmf18/extensions/ContentTranslation/modules/tools/ext.cx.tools.images.js: SWAT: Images: validate image id before adapting to prevent js error [[gerrit:231230]] (duration: 00m 12s) |
[production] |
| 15:04 |
<andrewbogott> |
rebooting labvirt1002 |
[production] |
| 13:35 |
<jynus> |
kill custom query hiting s6 master from terbium. Use of a slave is required. |
[production] |
| 13:11 |
<andrewbogott> |
graceful’d apache2 on labcontrol1001 |
[production] |
| 12:42 |
<andrewbogott> |
restarted keystone on labcontrol1001 |
[production] |
| 12:39 |
<hoo> |
Restarted apache2 on silver |
[production] |
| 09:35 |
<akosiaris> |
restarting apertium on sca1001 |
[production] |
| 08:16 |
<_joe_> |
removing all stale aggregator configs from netmon1001 |
[production] |
| 08:15 |
<godog> |
upgrade cassandra on restbase1009 |
[production] |
| 08:11 |
<godog> |
upgrade cassandra on restbase1006 |
[production] |
| 08:07 |
<godog> |
upgrade cassandra on restbase1005 |
[production] |
| 08:00 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Thu Aug 13 08:00:40 UTC 2015 (duration 0m 39s) |
[production] |
| 07:36 |
<_joe_> |
killing all gmond instances on netmon1001, trying to fix ganglia-monitor-aggregator |
[production] |
| 06:48 |
<matt_flaschen> |
Stopped Support desk LQT->Flow conversion for tonight |
[production] |
| 05:03 |
<ori@tin> |
Synchronized php-1.26wmf17/includes/cache/MessageCache.php: 5f1ab59d31: MessageCache: derive the hash from the cache contents (duration: 00m 12s) |
[production] |
| 05:02 |
<ori@tin> |
Synchronized php-1.26wmf18/includes/cache/MessageCache.php: 5f1ab59d31: MessageCache: derive the hash from the cache contents (duration: 00m 12s) |
[production] |
| 03:04 |
<l10nupdate@tin> |
LocalisationUpdate completed (1.26wmf18) at 2015-08-13 03:04:52+00:00 |
[production] |
| 03:01 |
<l10nupdate@tin> |
Synchronized php-1.26wmf18/cache/l10n: l10nupdate for 1.26wmf18 (duration: 06m 14s) |
[production] |
| 02:44 |
<l10nupdate@tin> |
LocalisationUpdate completed (1.26wmf17) at 2015-08-13 02:44:49+00:00 |
[production] |
| 02:38 |
<l10nupdate@tin> |
Synchronized php-1.26wmf17/cache/l10n: l10nupdate for 1.26wmf17 (duration: 10m 47s) |
[production] |
| 01:26 |
<matt_flaschen> |
Restarted conversion of support desk from LQT->Flow using convertLqtPageOnLocalWiki.php, using hhvm on mw1041 |
[production] |
| 01:16 |
<ori@tin> |
Synchronized wmf-config/StartProfiler.php: I482b120289: Ensure all Xenon records begin with the script base name (duration: 00m 12s) |
[production] |
| 01:07 |
<ori> |
Depooled mw1041 so it can be set aside for LQT->Flow conversion script (T108601) |
[production] |