| 2014-12-08
      
      § | 
    
  | 23:15 | <K4-713> | revlocked payments wiki to 30f15865bc4efe3b2b | [production] | 
            
  | 22:09 | <awight> | update crm from c9b733f0963a04ab1174ede0d5641e9b884747c8 to 77e99a530b7c3910ca521923d97830df08a4d1b1 | [production] | 
            
  | 21:52 | <awight> | updated tools from 06e69f0bd1a1f74eb8055f5300b48ad3b78eedea to 88b57fea517d2232e8ae906df550f426b6574f24 | [production] | 
            
  | 20:20 | <awight> | updated crm adfbbecbf949932932a3b6bc8c20c15e2a8054b2 to c9b733f0963a04ab1174ede0d5641e9b884747c8 | [production] | 
            
  | 19:40 | <krinkle> | Synchronized php-1.25wmf11/resources/src/startup.js: touch (duration: 00m 06s) | [production] | 
            
  | 19:19 | <csteipp> | deployed patches for T77028 and T76686 | [production] | 
            
  | 19:13 | <ori> | Finished scap: I5a7e258d2: Optimize how user options are delivered to the client (duration: 26m 45s) | [production] | 
            
  | 18:46 | <ori> | Started scap: I5a7e258d2: Optimize how user options are delivered to the client | [production] | 
            
  | 18:04 | <YuviPanda> | removed restbase/ from graphite for T77172 on tungsten | [production] | 
            
  | 17:54 | <ori> | Synchronized wmf-config/CommonSettings.php: Unset \\$wgTidyInternal (duration: 00m 07s) | [production] | 
            
  | 17:52 | <manybubbles> | rebuilding eswiki's cirrus index to pick up fix for slow prefix searches | [production] | 
            
  | 17:02 | <ori> | Synchronized wmf-config/CommonSettings.php: enable tidy extension on mw1081 (duration: 00m 06s) | [production] | 
            
  | 16:56 | <ottomata> | doing controlled restart of kafka broker analytics1021, and then initiating replica election to bring it back into leadership | [production] | 
            
  | 16:21 | <hashar> | Jenkins: disconnected / reconnected gallium slave from the web interface. It was locked not being able to run the mediawiki/vagrant postmerge doc job | [production] | 
            
  | 16:08 | <demon> | Synchronized php-1.25wmf11/extensions/VisualEditor: (no message) (duration: 00m 06s) | [production] | 
            
  | 16:08 | <demon> | Synchronized php-1.25wmf10/extensions/VisualEditor: (no message) (duration: 00m 09s) | [production] | 
            
  | 15:03 | <hashar> | Broke zuul-cloner by mistake | [production] | 
            
  | 14:36 | <godog> | reboot graphite1001 for kernel upgrade | [production] | 
            
  | 13:11 | <hashar> | Restarting zuul and zuul-merger on gallium | [production] | 
            
  | 13:10 | <hashar> | Zuul: rebasing our fork to bring some upstream changes | [production] | 
            
  | 10:41 | <godog> | upload diamond 3.5-2 to trusty-wikimedia | [production] | 
            
  | 09:18 | <andrewbogott> | the failure looked like this:  "Unexpected error in mod_passenger: Could not connect to the ApplicationPool server: Broken pipe (32)" | [production] | 
            
  | 09:18 | <andrewbogott> | graceful'd apache on virt1000 -- resolving a mysterious puppetmaster outage | [production] | 
            
  | 05:08 | <springle> | Synchronized wmf-config/db-eqiad.php: repool db1049, warm up (duration: 00m 06s) | [production] | 
            
  | 04:41 | <springle> | upgrade db1049 trusty | [production] | 
            
  | 04:17 | <springle> | Synchronized wmf-config/db-eqiad.php: depool db1049 (duration: 00m 06s) | [production] | 
            
  | 04:16 | <springle> | also truncated puppet fact_values, see http://projects.puppetlabs.com/issues/9225 and https://tickets.puppetlabs.com/browse/PUP-1173 | [production] | 
            
  | 04:11 | <springle> | puppet fact_values hit auto_inc limit. altered table to restart from 1 to get puppet running (seems safe, but needs checking, maybe also truncate) | [production] | 
            
  | 03:42 | <LocalisationUpdate> | ResourceLoader cache refresh completed at Mon Dec  8 03:42:28 UTC 2014 (duration 42m 27s) | [production] | 
            
  | 02:15 | <LocalisationUpdate> | completed (1.25wmf11) at 2014-12-08 02:15:53+00:00 | [production] | 
            
  | 02:15 | <l10nupdate> | Synchronized php-1.25wmf11/cache/l10n: (no message) (duration: 00m 01s) | [production] | 
            
  | 02:10 | <LocalisationUpdate> | completed (1.25wmf10) at 2014-12-08 02:10:20+00:00 | [production] | 
            
  | 02:10 | <l10nupdate> | Synchronized php-1.25wmf10/cache/l10n: (no message) (duration: 00m 03s) | [production] |