| 2013-10-15
      
      § | 
    
  | 16:31 | <bd808> | synchronized php-1.22wmf20/maintenance/purgeChangedPages.php | [production] | 
            
  | 16:28 | <bd808> | synchronized php-1.22wmf20/maintenance/purgeChangedPages.php | [production] | 
            
  | 16:23 | <bd808> | synchronized php-1.22wmf20/maintenance/purgeChangedPages.php | [production] | 
            
  | 15:04 | <reedy> | synchronized php-1.22wmf21/extensions/Wikibase | [production] | 
            
  | 14:35 | <reedy> | synchronized multiversion/  'Changing away from docroot based site deduction' | [production] | 
            
  | 13:31 | <ariel> | synchronized wmf-config/db-eqiad.php  'db1006 (s6) back to full weight in pool' | [production] | 
            
  | 11:37 | <hashar> | jenkins refreshing all mediawiki extensions jobs so they log Junit results under /logs/ | [production] | 
            
  | 10:29 | <ariel> | synchronized wmf-config/db-eqiad.php  'db1006 (s6) repooled, warming up after upgrade/conversion' | [production] | 
            
  | 06:56 | <ariel> | synchronized wmf-config/db-eqiad.php  'db1022 (s6) depooled to use as clone source' | [production] | 
            
  | 05:18 | <apergos> | powercycled cp1052, it was unresponsive and unreachable via mgmt | [production] | 
            
  | 02:37 | <LocalisationUpdate> | ResourceLoader cache refresh completed at Tue Oct 15 02:37:39 UTC 2013 | [production] | 
            
  | 02:20 | <LocalisationUpdate> | completed (1.22wmf21) at Tue Oct 15 02:20:18 UTC 2013 | [production] | 
            
  | 02:14 | <LocalisationUpdate> | completed (1.22wmf20) at Tue Oct 15 02:14:53 UTC 2013 | [production] | 
            
  | 01:53 | <Tim> | rebooting mw1035 for init testing | [production] | 
            
  | 00:41 | <Tim> | manually created MW cgroups on all apaches since apparently the init script is totally broken | [production] | 
            
  | 00:29 | <Tim> | on mw1035,mw1145,mw1078,mw1152,mw1150: running "start cgconfig" to fix cgroups | [production] | 
            
  | 00:21 | <Tim> | some apaches are missing /sys/fs/cgroup/* so shell execution from MW fails. Stopped apache on mw1035 during investigation | [production] | 
            
  
    | 2013-10-14
      
      § | 
    
  | 23:46 | <tstarling> | synchronized wmf-config/InitialiseSettings.php | [production] | 
            
  | 23:42 | <tstarling> | synchronized php-1.22wmf20/extensions/Math | [production] | 
            
  | 23:41 | <Tim> | pushed out temporary checkout of extension/Math 679ce7fe2fe, will update submodule soon | [production] | 
            
  | 23:40 | <tstarling> | synchronized php-1.22wmf20/extensions/Math/MathTexvc.php | [production] | 
            
  | 23:14 | <olivneh> | synchronized wmf-config/InitialiseSettings.php  'Disable Math debug log group (found to be not pertinent & too verbose)' | [production] | 
            
  | 22:21 | <olivneh> | synchronized wmf-config/InitialiseSettings.php  'Enable Math debug log group' | [production] | 
            
  | 16:11 | <mark> | Setup LVS service IP range aggregates on the core routers | [production] | 
            
  | 06:45 | <apergos> | resized /var/lib/puppet on stafford, it ran out of room last night (but recovered after cron job reports cleanup) | [production] | 
            
  | 05:18 | <springle> | synchronized wmf-config/db-pmtpa.php  'update s6 master' | [production] | 
            
  | 05:17 | <springle> | synchronized wmf-config/db-eqiad.php  'repool db1007' | [production] | 
            
  | 04:34 | <springle> | synchronized wmf-config/db-pmtpa.php  'update s6 master' | [production] | 
            
  | 04:24 | <springle> | synchronized wmf-config/db-eqiad.php  'depool db1006 to investigate connection errors. promote db1027' | [production] | 
            
  | 03:33 | <springle> | synchronized wmf-config/db-eqiad.php  'depool db1027 before promotion' | [production] | 
            
  | 02:25 | <LocalisationUpdate> | ResourceLoader cache refresh completed at Mon Oct 14 02:25:24 UTC 2013 | [production] | 
            
  | 02:15 | <LocalisationUpdate> | completed (1.22wmf21) at Mon Oct 14 02:15:08 UTC 2013 | [production] | 
            
  | 02:08 | <LocalisationUpdate> | completed (1.22wmf20) at Mon Oct 14 02:08:37 UTC 2013 | [production] |