| 
      
        2014-09-08
      
      §
     | 
  
    
  | 15:27 | 
  <manybubbles> | 
  sync logging was down so it missed some syncing I just did. | 
  [production] | 
            
  | 15:25 | 
  <manybubbles> | 
  Synchronized php-1.24wmf20/extensions/WikiLove/: (no message) (duration: 00m 05s) | 
  [production] | 
            
  | 15:20 | 
  <manybubbles> | 
  Synchronized wmf-config: SWAT another cirrus setting update (duration: 00m 04s) | 
  [production] | 
            
  | 15:10 | 
  <manybubbles> | 
  Synchronized wmf-config: SWAT finish updating Cirrus settings (duration: 00m 05s) | 
  [production] | 
            
  | 15:10 | 
  <manybubbles> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT update some cirrus settings (duration: 00m 04s) | 
  [production] | 
            
  | 15:10 | 
  <cmjohnson1> | 
  shutting down neon for memory upgrade  | 
  [production] | 
            
  | 14:41 | 
  <springle> | 
  Synchronized wmf-config/db-eqiad.php: repool db1072 (duration: 00m 09s) | 
  [production] | 
            
  | 12:23 | 
  <springle> | 
  Synchronized wmf-config/db-eqiad.php: repool db1073, depool db1072 (duration: 00m 06s) | 
  [production] | 
            
  | 11:07 | 
  <springle> | 
  Synchronized wmf-config/db-eqiad.php: depool db1073wq (duration: 00m 09s) | 
  [production] | 
            
  | 10:55 | 
  <_joe_> | 
  re-enabled puppet, the change results in a no-op as expected | 
  [production] | 
            
  | 10:42 | 
  <_joe_> | 
  disabling puppet on all appservers while updating apache config. | 
  [production] | 
            
  | 04:58 | 
  <springle> | 
  Synchronized wmf-config/db-eqiad.php: move enwiki api traffic to db1051/db1066 (duration: 00m 09s) | 
  [production] | 
            
  | 03:37 | 
  <LocalisationUpdate> | 
  ResourceLoader cache refresh completed at Mon Sep  8 03:36:13 UTC 2014 (duration 36m 12s) | 
  [production] | 
            
  | 02:45 | 
  <LocalisationUpdate> | 
  completed (1.24wmf20) at 2014-09-08 02:44:47+00:00 | 
  [production] | 
            
  | 02:33 | 
  <LocalisationUpdate> | 
  completed (1.24wmf19) at 2014-09-08 02:32:37+00:00 | 
  [production] | 
            
  | 02:21 | 
  <LocalisationUpdate> | 
  completed (1.24wmf15) at 2014-09-08 02:19:52+00:00 | 
  [production] | 
            
  
    | 
      
        2014-09-07
      
      §
     | 
  
    
  | 23:35 | 
  <Tim> | 
  upgrading liblua everywhere | 
  [production] | 
            
  | 20:36 | 
  <ori> | 
  mw1017: upgraded HHVM from 3.3-dev+20140728+wmf5 to 3.3-dev+20140728+wmf6 | 
  [production] | 
            
  | 15:12 | 
  <apergos> | 
  manually changed /etc/hosts entry on analytics1004 from having "analyticas1004.eqiad.wmnet" to "analytics1004.eqiad.wmnet" | 
  [production] | 
            
  | 06:15 | 
  <godog> | 
  powercycle ms-be1005, not even responsive on console | 
  [production] | 
            
  | 03:31 | 
  <LocalisationUpdate> | 
  ResourceLoader cache refresh completed at Sun Sep  7 03:29:51 UTC 2014 (duration 29m 50s) | 
  [production] | 
            
  | 02:43 | 
  <LocalisationUpdate> | 
  completed (1.24wmf20) at 2014-09-07 02:42:12+00:00 | 
  [production] | 
            
  | 02:31 | 
  <LocalisationUpdate> | 
  completed (1.24wmf19) at 2014-09-07 02:30:15+00:00 | 
  [production] | 
            
  | 02:19 | 
  <LocalisationUpdate> | 
  completed (1.24wmf15) at 2014-09-07 02:17:44+00:00 | 
  [production] | 
            
  
    | 
      
        2014-09-05
      
      §
     | 
  
    
  | 23:28 | 
  <kaldari> | 
  Synchronized wmf-config/mobile-labs.php: enabling wikigrok on beta labs (en only) (duration: 00m 03s) | 
  [production] | 
            
  | 23:28 | 
  <kaldari> | 
  Synchronized wmf-config/InitialiseSettings-labs.php: enabling wikigrok on beta labs (en only) (duration: 00m 04s) | 
  [production] | 
            
  | 23:28 | 
  <kaldari> | 
  updated /a/common to {{Gerrit|Iec209bde0}}: Map config var for $wgMFEnableWikiGrok | 
  [production] | 
            
  | 22:25 | 
  <kaldari> | 
  Synchronized wmf-config/InitialiseSettings-labs.php: enabling wikigrok on beta labs (en only) (duration: 00m 05s) | 
  [production] | 
            
  | 22:25 | 
  <kaldari> | 
  updated /a/common to {{Gerrit|I6039956eb}}: Enable Wikigrok prototype for beta labs (enwiki only) | 
  [production] | 
            
  | 22:24 | 
  <awight> | 
  Deleted Light User and Merkle roles from the CRM | 
  [production] | 
            
  | 20:20 | 
  <RobH> | 
  coms folks still accessing blog data on holmium, powering back up | 
  [production] | 
            
  | 20:18 | 
  <bblack> | 
  restarted cp1056 bits cache and re-enabled in pybal | 
  [production] | 
            
  | 18:34 | 
  <mark> | 
  Depooled cp1056 for testing | 
  [production] | 
            
  | 17:50 | 
  <ori> | 
  Synchronized docroot and w: Iaa7518613: Fix spelling in symlink (duration: 00m 15s) | 
  [production] | 
            
  | 17:45 | 
  <ori> | 
  Synchronized docroot and w: I55a01a712: Fix relative symlinks for bits/static-master (duration: 00m 13s) | 
  [production] | 
            
  | 13:00 | 
  <Jeff_Green> | 
  lutetium dist-upgrade and reboot | 
  [production] | 
            
  | 12:04 | 
  <legoktm> | 
  running extensions/GlobalCssJs/removeOldManualUserPages.php for [[m:GlobalCssJs]] | 
  [production] | 
            
  | 07:59 | 
  <springle> | 
  dump es1007 to db1004, tokudb external storage page compression test. ok to kill in emergency | 
  [production] | 
            
  | 06:40 | 
  <springle> | 
  Synchronized wmf-config/db-eqiad.php: depool es1007 (duration: 00m 07s) | 
  [production] | 
            
  | 04:36 | 
  <LocalisationUpdate> | 
  ResourceLoader cache refresh completed at Fri Sep  5 04:35:11 UTC 2014 (duration 35m 10s) | 
  [production] | 
            
  | 04:27 | 
  <springle> | 
  Synchronized wmf-config/db-eqiad.php: repool es1002 (duration: 00m 06s) | 
  [production] | 
            
  | 04:01 | 
  <springle> | 
  reboot es1002, fs check | 
  [production] | 
            
  | 03:47 | 
  <LocalisationUpdate> | 
  completed (1.24wmf20) at 2014-09-05 03:46:28+00:00 | 
  [production] | 
            
  | 03:46 | 
  <springle> | 
  Synchronized wmf-config/db-eqiad.php: depool es1002 for upgrade (duration: 00m 07s) | 
  [production] | 
            
  | 03:37 | 
  <springle> | 
  Synchronized wmf-config/db-eqiad.php: repool db1062 and db1068 (duration: 02m 06s) | 
  [production] | 
            
  | 03:10 | 
  <LocalisationUpdate> | 
  completed (1.24wmf19) at 2014-09-05 03:09:20+00:00 | 
  [production] |