| 2014-11-20
      
      ยง | 
    
  | 23:13 | <maxsem> | Synchronized php-1.25wmf9/extensions/MobileFrontend/: https://gerrit.wikimedia.org/r/#/c/174749/ (duration: 00m 04s) | [production] | 
            
  | 22:49 | <ejegg> | rolled back payments-wiki from 1e533d6dfc200e6a84f0a8418a8a1ecddb2b3aed to e3d235f881282120409e1a6ed1a3908ce9a63c26 | [production] | 
            
  | 22:31 | <demon> | Synchronized wmf-config/: globaluserpage on beta, no-op sync (duration: 00m 07s) | [production] | 
            
  | 22:27 | <LocalisationUpdate> | completed (1.25wmf9) at 2014-11-20 22:27:08+00:00 | [production] | 
            
  | 22:23 | <bd808> | Synchronized php-1.25wmf9/cache/l10n: (no message) (duration: 08m 05s) | [production] | 
            
  | 22:03 | <LocalisationUpdate> | completed (1.25wmf8) at 2014-11-20 22:03:06+00:00 | [production] | 
            
  | 21:59 | <bd808> | Synchronized php-1.25wmf8/cache/l10n: (no message) (duration: 05m 05s) | [production] | 
            
  | 21:40 | <bd808|deploy> | Testing l10nupdate changes | [production] | 
            
  | 21:38 | <ejegg> | updated crm from ed3f3f8e31119eb7d52d5730ece4e22ac1dd055a to e13cae8c418d29ef444899e0a70bbe03f4b7079d | [production] | 
            
  | 21:33 | <ejegg> | updated payments-wiki e3d235f881282120409e1a6ed1a3908ce9a63c26 to 1e533d6dfc200e6a84f0a8418a8a1ecddb2b3aed | [production] | 
            
  | 21:28 | <aude> | Synchronized php-1.25wmf8/extensions/Wikidata: Update Wikidata - property suggester (duration: 00m 10s) | [production] | 
            
  | 21:26 | <aude> | Synchronized php-1.25wmf9/extensions/Wikidata: Update test.wikidata - property suggester (duration: 00m 10s) | [production] | 
            
  | 21:00 | <ori> | Updated EventLogging to 39de1d3faacc8463db7532405e8fc003b80ecb79 | [production] | 
            
  | 20:54 | <ejegg> | updated crm from ff89895638a0dd0600b2e4c0b6adfd1b8e402df5 to ed3f3f8e31119eb7d52d5730ece4e22ac1dd055a | [production] | 
            
  | 20:10 | <ejegg> | updated tools from fe9b463379fac35ad5e71a57fbbb95ae39e2356e to b537e2ec80d16b84f8e0539d4e3d78c8afef1b63 | [production] | 
            
  | 20:09 | <yuvipanda> | run chown l10nupdate:wikidev /var/lock/scap on tin, for https://gerrit.wikimedia.org/r/#/c/174784/1 | [production] | 
            
  | 19:42 | <demon> | Synchronized wmf-config/CommonSettings.php: (no message) (duration: 00m 04s) | [production] | 
            
  | 19:34 | <jgage> | restarted puppetmasters | [production] | 
            
  | 19:30 | <demon> | Finished scap: (no message) (duration: 23m 37s) | [production] | 
            
  | 19:06 | <demon> | Started scap: (no message) | [production] | 
            
  | 18:51 | <LocalisationUpdate> | completed (1.25wmf9) at 2014-11-20 18:51:39+00:00 | [production] | 
            
  | 18:39 | <LocalisationUpdate> | completed (1.25wmf8) at 2014-11-20 18:39:00+00:00 | [production] | 
            
  | 18:27 | <andrewbogott> | updated the python-openstack-wikistatus on carbon to 2014.11 | [production] | 
            
  | 18:22 | <demon> | Synchronized php-1.25wmf9/extensions/ExtensionDistributor/: (no message) (duration: 00m 07s) | [production] | 
            
  | 17:01 | <godog> | reboot ms-be1007, xfs-induced high load | [production] | 
            
  | 16:59 | <_joe_> | restart apache on mw1218, stuck in a apc futex | [production] | 
            
  | 16:38 | <demon> | Synchronized php-1.25wmf9/extensions/Math: (no message) (duration: 00m 06s) | [production] | 
            
  | 16:26 | <_joe_> | puppet reenabled everywhere, change tested and live on all varnishes within the next 20 minutes | [production] | 
            
  | 16:15 | <demon> | Synchronized php-1.25wmf9/extensions/CirrusSearch: (no message) (duration: 00m 04s) | [production] | 
            
  | 16:15 | <demon> | Synchronized php-1.25wmf8/extensions/CirrusSearch: (no message) (duration: 00m 05s) | [production] | 
            
  | 15:52 | <_joe_> | disabling puppet on all caches, before a pretty large change, will be reeanbled after a few tests | [production] | 
            
  | 15:01 | <hashar> | Restarting Jenkins AND Zuul.  Beta cluster jobs are still deadlocked. | [production] | 
            
  | 14:00 | <godog> | restart txstatsd on tungsten to stop receiving jenkins metrics | [production] | 
            
  | 13:04 | <hashar> | Jenkins: restarting to remove a deadlock and unload the Statsd plugin | [production] | 
            
  | 12:30 | <godog> | upload carbon-c-relay to trusty-wikimedia | [production] | 
            
  | 12:12 | <qchris> | Restarted EventLogging mysql-m2 consumer to empty its caches | [production] | 
            
  | 05:41 | <bblack> | amssq31-62, cp300[12], lvs300[34], ssl300[123] all shut down for esams power event (and downtimed) | [production] | 
            
  | 05:28 | <bblack> | ~30m to esams power out, starting equipment shutdown and such for OE13/OE15 | [production] | 
            
  | 05:15 | <Tim> | made myself an administrator on phabricator | [production] | 
            
  | 04:27 | <LocalisationUpdate> | ResourceLoader cache refresh completed at Thu Nov 20 04:27:25 UTC 2014 (duration 27m 24s) | [production] | 
            
  | 02:34 | <LocalisationUpdate> | completed (1.25wmf9) at 2014-11-20 02:34:12+00:00 | [production] | 
            
  | 02:21 | <LocalisationUpdate> | completed (1.25wmf8) at 2014-11-20 02:21:35+00:00 | [production] | 
            
  | 00:50 | <maxsem> | Synchronized php-1.25wmf9/extensions/MobileFrontend/: https://gerrit.wikimedia.org/r/#/c/174613/ (duration: 00m 04s) | [production] | 
            
  | 00:41 | <catrope> | Synchronized wmf-config/InitialiseSettings.php: Change mobile wordmark image to relative URL (duration: 00m 04s) | [production] | 
            
  | 00:34 | <catrope> | Synchronized php-1.25wmf9/extensions/VisualEditor: SWAT (duration: 00m 04s) | [production] | 
            
  | 00:34 | <catrope> | Synchronized php-1.25wmf8/extensions/VisualEditor: SWAT (duration: 00m 04s) | [production] | 
            
  | 00:26 | <catrope> | Synchronized php-1.25wmf8/includes/media/: SWAT: don't apply EXIF rotation to chained thumbnails (duration: 00m 04s) | [production] | 
            
  | 00:13 | <catrope> | Synchronized wmf-config/: SWAT: temp debugging for SecurePoll (duration: 00m 04s) | [production] | 
            
  | 00:10 | <catrope> | Synchronized wmf-config/: SWAT (duration: 00m 04s) | [production] | 
            
  | 00:09 | <catrope> | Synchronized images/mobile/: SWAT: new Wikipedia wordmark for mobile (duration: 00m 03s) | [production] |