8351-8400 of 10000 results (48ms)
2015-07-15 §
03:03 <manybubbles> es1.6 upgrade: raised limits on shard migration rate - should speed up the restart. we should lower it before we do restarts during europe's morning [production]
02:10 <Reedy> Running LU manually to see what's wrong with it [production]
02:07 <LocalisationUpdate> ResourceLoader cache refresh completed at Wed Jul 15 02:07:48 UTC 2015 (duration 7m 47s) [production]
02:02 <LocalisationUpdate> failed (1.26wmf13) at 2015-07-15 02:02:55+00:00 [production]
2015-07-14 §
23:46 <manybubbles> es1.6 upgrade: upgraded elastic1011 [production]
23:22 <bblack> updating nginx to 1.9.3-1+wmf1 on cp* [production]
23:17 <bblack> reprepro: nginx for jessie-wikimedia/main bumped to 1.9.3-1+wmf1 [production]
22:22 <ejegg> updated civicrm from 04efc7d5c7bbb068f907125f2184692aee676123 to 6560cefa8d7e68e35e30b310d6691ab57798a4c9 [production]
21:30 <Reedy> mw1090 fs is ro [production]
21:28 <reedy> rebuilt wikiversions.cdb and synchronized wikiversions files: Fix testwiki [production]
21:05 <_joe|AFK> depooling mw1090, ext4 errors in syslog, filesystem mounted read-only [production]
21:01 <twentyafterfour> Synchronized wmf-config/CommonSettings.php: revert LCStoreStaticArray (duration: 00m 12s) [production]
20:59 <twentyafterfour> Finished scap: testwiki to 1.26wmf14 and rebuild localization cache (duration: 72m 45s) [production]
20:42 <bblack> undoing LCStoreStaticArray because appservers look unhealthy, using ori's command: 'salt -G deployment_target:scap/scap cmd.run "rm /etc/lcstore"' [production]
19:46 <twentyafterfour> Started scap: testwiki to 1.26wmf14 and rebuild localization cache [production]
19:23 <manybubbles> es1.6 step iforget: upgrade elasticsearch on elastic1010 [production]
17:41 <mutante> terbium: /usr/local/bin/foreachwiki extensions/Echo/maintenance/processEchoEmailBatch.php [production]
17:10 <dcausse> es1.6 step 10: upgrade elastic1009 [production]
16:23 <mutante> bromine - apt-get upgrade [production]
15:08 <manybubbles> Synchronized php-1.26wmf13/extensions/UniversalLanguageSelector/: SWAT add some hooks to extension.json (duration: 00m 13s) [production]
14:34 <gwicke> started RESTBase revision thin-out script for html and data-parsoid on wikimedia domains [production]
14:01 <dcausse> es1.6 step 9: upgrade elastic1008 [production]
12:48 <_joe_> reimaging mw1155 [production]
12:17 <ori> Logging a message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log. [production]
11:28 <dcausse> es1.6 step 8: upgrade elastic1007 [production]
11:25 <_joe_> repooling mw1154 with HHVM [production]
10:12 <_joe_> stopped poolcounter on mw1154 [production]
10:06 <_joe_> reimaging mw1154 [production]
07:49 <dcausse> es1.6 step 7: upgrade elastic1006 [production]
07:09 <LocalisationUpdate> ResourceLoader cache refresh completed at Tue Jul 14 07:09:10 UTC 2015 (duration 9m 9s) [production]
06:48 <dcausse> es1.6 step 6: upgrade elastic1005 [production]
06:41 <ori> Synchronized wmf-config/CommonSettings.php: I9c9bf0f4: Use LCStoreStaticArray unconditionally (duration: 03m 02s) [production]
05:27 <ori> Cleaned up now-unused hhbc files from /run/hhvm/cache on job runners [production]
04:58 <ori> Enabling LCStoreStaticArray in production. May be reverted by running: 'salt -G deployment_target:scap/scap cmd.run "rm /etc/lcstore"' on palladium. [production]
04:48 <ori> Synchronized wmf-config/CommonSettings.php: Follow-up for Ieb62ee050e: allow LCStoreStaticArray in server mode (duration: 00m 13s) [production]
02:35 <LocalisationUpdate> completed (1.26wmf13) at 2015-07-14 02:35:21+00:00 [production]
02:31 <l10nupdate> Synchronized php-1.26wmf13/cache/l10n: (no message) (duration: 07m 27s) [production]
02:07 <LocalisationUpdate> ResourceLoader cache refresh completed at Tue Jul 14 02:07:32 UTC 2015 (duration 7m 30s) [production]
02:02 <LocalisationUpdate> failed (1.26wmf13) at 2015-07-14 02:02:33+00:00 [production]
01:22 <springle> Synchronized wmf-config/db-eqiad.php: repool db1037; depool db1030 (duration: 00m 13s) [production]
2015-07-13 §
23:22 <catrope> Synchronized php-1.26wmf13/extensions/VisualEditor: SWAT (duration: 00m 11s) [production]
23:11 <catrope> Synchronized php-1.26wmf13/extensions/Flow/includes/Parsoid/Utils.php: Add title to Parsoid exception logging (duration: 00m 12s) [production]
22:45 <legoktm> Synchronized wmf-config: Revert "Set $wgCentralAuthStrict = true;" (duration: 00m 13s) [production]
22:41 <legoktm> Synchronized wmf-config/CommonSettings.php: Set $wgCentralAuthStrict = true; (duration: 00m 13s) [production]
22:41 <legoktm> Synchronized wmf-config/InitialiseSettings.php: Set $wgCentralAuthStrict = true; (duration: 00m 12s) [production]
22:16 <legoktm> Synchronized php-1.26wmf13/includes/User.php: Add 'AuthPluginStrict' log to identify users who are unable to authenticate (duration: 00m 13s) [production]
22:15 <legoktm> Synchronized php-1.26wmf13/includes/api/ApiMain.php: Revert "Revert "Revert Count API module instantiations and Hook runs"" (duration: 00m 12s) [production]
22:15 <legoktm> Synchronized php-1.26wmf13/includes/Hooks.php: Revert "Revert "Revert Count API module instantiations and Hook runs"" (duration: 00m 13s) [production]
22:13 <ejegg> updated payments from ec34ebf61e5962f66b807abdcb519ff323d41e8e to 4ca95d55a9745c05ccfbb16ee6f23a6f75328824 [production]
22:00 <manybubbles> es1.6 step 4: upgrade elastic1003 [production]