251-300 of 10000 results (20ms)
2014-12-08 §
17:02 <ori> Synchronized wmf-config/CommonSettings.php: enable tidy extension on mw1081 (duration: 00m 06s) [production]
16:56 <ottomata> doing controlled restart of kafka broker analytics1021, and then initiating replica election to bring it back into leadership [production]
16:21 <hashar> Jenkins: disconnected / reconnected gallium slave from the web interface. It was locked not being able to run the mediawiki/vagrant postmerge doc job [production]
16:08 <demon> Synchronized php-1.25wmf11/extensions/VisualEditor: (no message) (duration: 00m 06s) [production]
16:08 <demon> Synchronized php-1.25wmf10/extensions/VisualEditor: (no message) (duration: 00m 09s) [production]
15:03 <hashar> Broke zuul-cloner by mistake [production]
14:36 <godog> reboot graphite1001 for kernel upgrade [production]
13:11 <hashar> Restarting zuul and zuul-merger on gallium [production]
13:10 <hashar> Zuul: rebasing our fork to bring some upstream changes [production]
10:41 <godog> upload diamond 3.5-2 to trusty-wikimedia [production]
09:18 <andrewbogott> the failure looked like this: "Unexpected error in mod_passenger: Could not connect to the ApplicationPool server: Broken pipe (32)" [production]
09:18 <andrewbogott> graceful'd apache on virt1000 -- resolving a mysterious puppetmaster outage [production]
05:08 <springle> Synchronized wmf-config/db-eqiad.php: repool db1049, warm up (duration: 00m 06s) [production]
04:41 <springle> upgrade db1049 trusty [production]
04:17 <springle> Synchronized wmf-config/db-eqiad.php: depool db1049 (duration: 00m 06s) [production]
04:16 <springle> also truncated puppet fact_values, see http://projects.puppetlabs.com/issues/9225 and https://tickets.puppetlabs.com/browse/PUP-1173 [production]
04:11 <springle> puppet fact_values hit auto_inc limit. altered table to restart from 1 to get puppet running (seems safe, but needs checking, maybe also truncate) [production]
03:42 <LocalisationUpdate> ResourceLoader cache refresh completed at Mon Dec 8 03:42:28 UTC 2014 (duration 42m 27s) [production]
02:15 <LocalisationUpdate> completed (1.25wmf11) at 2014-12-08 02:15:53+00:00 [production]
02:15 <l10nupdate> Synchronized php-1.25wmf11/cache/l10n: (no message) (duration: 00m 01s) [production]
02:10 <LocalisationUpdate> completed (1.25wmf10) at 2014-12-08 02:10:20+00:00 [production]
02:10 <l10nupdate> Synchronized php-1.25wmf10/cache/l10n: (no message) (duration: 00m 03s) [production]
2014-12-07 §
03:41 <LocalisationUpdate> ResourceLoader cache refresh completed at Sun Dec 7 03:41:52 UTC 2014 (duration 41m 51s) [production]
02:16 <LocalisationUpdate> completed (1.25wmf11) at 2014-12-07 02:16:30+00:00 [production]
02:16 <l10nupdate> Synchronized php-1.25wmf11/cache/l10n: (no message) (duration: 00m 02s) [production]
02:11 <LocalisationUpdate> completed (1.25wmf10) at 2014-12-07 02:11:07+00:00 [production]
02:11 <l10nupdate> Synchronized php-1.25wmf10/cache/l10n: (no message) (duration: 00m 01s) [production]
2014-12-06 §
22:51 <ori> restarted apache on palladium [production]
19:48 <Krinkle> Made trivial edit to Jenkins language config to purge the French invasion (default language: en-us -> en-US) [production]
19:39 <Krinkle> Jenkins has been conquered by the French again [production]
03:42 <LocalisationUpdate> ResourceLoader cache refresh completed at Sat Dec 6 03:42:37 UTC 2014 (duration 42m 36s) [production]
02:18 <LocalisationUpdate> completed (1.25wmf11) at 2014-12-06 02:18:52+00:00 [production]
02:18 <l10nupdate> Synchronized php-1.25wmf11/cache/l10n: (no message) (duration: 00m 01s) [production]
02:13 <LocalisationUpdate> completed (1.25wmf10) at 2014-12-06 02:13:12+00:00 [production]
02:13 <l10nupdate> Synchronized php-1.25wmf10/cache/l10n: (no message) (duration: 00m 01s) [production]
01:00 <demon> Synchronized w/robots.php: better mtime (duration: 00m 06s) [production]
00:49 <ori> Synchronized wmf-config/InitialiseSettings.php: Add preview log group (duration: 00m 06s) [production]
2014-12-05 §
18:22 <YuviPanda> restart gitblit on antimony [production]
18:03 <akosiaris> uploaded apertium-eo-en, apertium-id-ms to apt.wikimedia.org [production]
16:44 <ottomata> rebooting analytics1021 [production]
15:51 <mutante> hack-fixed http://noc.wikimedia.org/db.php [production]
15:46 <_joe_> repooling all the servers [production]
15:06 <_joe_> depooling mw1209-1220, enabling hyperthreading and upgrading [production]
14:11 <paravoid> rebooting copper [production]
13:01 <_joe_> repooling all appservers [production]
12:32 <Krinkle> Reloading Zuul to deploy I9515542a1ac2ff [production]
11:48 <springle> Synchronized wmf-config/db-eqiad.php: repool db1059, warm up (duration: 00m 07s) [production]
11:46 <_joe_> repooled mw1161-mw1170, depooling mw1171-80 [production]
10:58 <springle> upgrade db1059 trusty [production]
10:56 <_joe_> depooling mw1161-mw1170 for enabling hyperthreading [production]