651-700 of 10000 results (16ms)
2013-09-16 §
07:40 <springle> rebooted neon. icinga pegged at max concurrent connections for 48h. root ext3 fs read-only as of 2013-09-14 06:45 detected aborted journal [production]
02:24 <LocalisationUpdate> ResourceLoader cache refresh completed at Mon Sep 16 02:23:57 UTC 2013 [production]
02:11 <LocalisationUpdate> completed (1.22wmf17) at Mon Sep 16 02:11:46 UTC 2013 [production]
02:06 <LocalisationUpdate> completed (1.22wmf16) at Mon Sep 16 02:06:34 UTC 2013 [production]
2013-09-15 §
02:07 <LocalisationUpdate> ResourceLoader cache refresh completed at Sun Sep 15 02:07:26 UTC 2013 [production]
02:02 <LocalisationUpdate> completed (1.22wmf17) at Sun Sep 15 02:02:16 UTC 2013 [production]
02:01 <LocalisationUpdate> completed (1.22wmf16) at Sun Sep 15 02:01:36 UTC 2013 [production]
2013-09-14 §
23:34 <springle> throttling back db1045 pt-table-sync jobs to avoid blocking source-slave sql threads [production]
23:25 <springle_away> restarted db1049 slave sql thread after lock wait timeout. investigating cause [production]
02:21 <LocalisationUpdate> ResourceLoader cache refresh completed at Sat Sep 14 02:21:42 UTC 2013 [production]
02:13 <LocalisationUpdate> completed (1.22wmf17) at Sat Sep 14 02:13:11 UTC 2013 [production]
02:05 <LocalisationUpdate> completed (1.22wmf16) at Sat Sep 14 02:05:31 UTC 2013 [production]
2013-09-13 §
17:48 <apergos> testing incr dump code on snapshot1003 in screen; if it falls over it won't break anything [production]
15:38 <greg-g> ugh, it's intermittent, 503's now [production]
15:34 <greg-g> etherpad.wikimedia seems better to me [production]
15:28 <Nemo_bis> etherpad currently serving error 503 Service Temporarily Unavailable [production]
02:54 <LocalisationUpdate> ResourceLoader cache refresh completed at Fri Sep 13 02:54:31 UTC 2013 [production]
02:33 <LocalisationUpdate> completed (1.22wmf17) at Fri Sep 13 02:33:49 UTC 2013 [production]
02:15 <LocalisationUpdate> completed (1.22wmf16) at Fri Sep 13 02:15:07 UTC 2013 [production]
2013-09-12 §
21:50 <LeslieCarr> upgrading to 11.4r9 on cr1-ulsfo/cr2-ulsfo [production]
21:29 <reedy> synchronized wmf-config/ [production]
21:29 <reedy> Finished syncing Wikimedia installation... : Update l10n cache for CleanChanges [production]
21:28 <reedy> synchronized wmf-config/ [production]
21:19 <reedy> Started syncing Wikimedia installation... : Update l10n cache for CleanChanges [production]
21:15 <reedy> synchronized wmf-config/extension-list 'Enable CleanChanges' [production]
20:49 <reedy> synchronized php-1.22wmf16/extensions/MoodBar/ [production]
19:35 <mark> Rebalanced eqiad apaches in PyBal weight, according to machine specs [production]
18:59 <LeslieCarr> restarting pybal on lvs's [production]
18:57 <LeslieCarr> runnign ntpdate on lvs servers [production]
18:33 <reedy> rebuilt wikiversions.cdb and synchronized wikiversions files: loginwiki, mediawikiwiki, test2wiki and testwikidatawiki to 1.22wmf17 [production]
18:28 <reedy> Finished syncing Wikimedia installation... : testwiki to 1.22wmf17 and build localisation cache [production]
18:11 <reedy> Started syncing Wikimedia installation... : testwiki to 1.22wmf17 and build localisation cache [production]
18:02 <reedy> synchronized php-1.22wmf16/extensions/Wikibase [production]
17:56 <reedy> synchronized docroot and w [production]
17:55 <reedy> synchronized php-1.22wmf17 'Initial deploy of code files' [production]
17:19 <hashar> gallium : killed some long lasting java Jenkins thread [production]
17:18 <reedy> synchronized php-1.22wmf16/extensions/Wikibase [production]
17:16 <reedy> synchronized php-1.22wmf16/extensions/DataValues/ [production]
04:18 <reedy> synchronized php-1.22wmf16/extensions/TemplateData [production]
04:00 <catrope> synchronized php-1.22wmf16/extensions/VisualEditor/modules/ve-mw/init/ve.init.mw.Target.js 'touch' [production]
03:49 <reedy> synchronized php-1.22wmf16/extensions/TemplateData/TemplateData.php [production]
02:51 <LocalisationUpdate> ResourceLoader cache refresh completed at Thu Sep 12 02:51:54 UTC 2013 [production]
02:43 <reedy> rebuilt wikiversions.cdb and synchronized wikiversions files: Wikipedias to 1.22wmf16 [production]
02:32 <LocalisationUpdate> completed (1.22wmf15) at Thu Sep 12 02:32:02 UTC 2013 [production]
02:16 <LocalisationUpdate> completed (1.22wmf16) at Thu Sep 12 02:16:32 UTC 2013 [production]
2013-09-11 §
23:22 <paravoid> powercycling neon, swapdeath [production]
23:10 <mwalker> synchronized wmf-config/CommonSettings.php 'Do not run Translate message group job synchronously for CentralNotice' [production]
22:50 <mwalker> synchronized php-1.22wmf15/extensions/CentralNotice 'Updating CentralNotice to master' [production]
22:50 <mwalker> synchronized php-1.22wmf16/extensions/CentralNotice 'Updating CentralNotice to master' [production]
22:48 <springle> upgraded packages on db1020 to get ganglia-monitor mysql metrics working [production]