| 2014-09-11
      
      § | 
    
  | 10:00 | <_joe_> | enabled puppet on mw1053 | [production] | 
            
  | 09:38 | <_joe_> | gracefulling mw1200 mw1196 and mw1186 as they have APC issues | [production] | 
            
  | 09:21 | <_joe_> | upgrading hhvm and hhvm-luasandbox across the production cluster | [production] | 
            
  | 09:00 | <akosiaris> | upgrading php5 to 5.3.10-1ubuntu3.14+wmf1 on mw1212 | [production] | 
            
  | 08:34 | <_joe_> | updating php-pear php5 php5-cli php5-common php5-curl php5-dev php5-intl php5-mysql php5-xmlrpc libapache2-mod-php5 on mw1018, see USN 2344-1 | [production] | 
            
  | 03:41 | <LocalisationUpdate> | ResourceLoader cache refresh completed at Thu Sep 11 03:41:03 UTC 2014 (duration 41m 2s) | [production] | 
            
  | 02:49 | <LocalisationUpdate> | completed (1.24wmf20) at 2014-09-11 02:49:26+00:00 | [production] | 
            
  | 02:36 | <LocalisationUpdate> | completed (1.24wmf19) at 2014-09-11 02:36:37+00:00 | [production] | 
            
  | 02:23 | <LocalisationUpdate> | completed (1.24wmf15) at 2014-09-11 02:23:29+00:00 | [production] | 
            
  | 00:28 | <mutante> | graceful'ed Apaches on mw1171, mw1187 | [production] | 
            
  | 00:25 | <ori> | Synchronized wmf-config: Id607bf36d: Update remaining references to /u/l/a/common-local (duration: 00m 03s) | [production] | 
            
  | 00:25 | <ori> | Synchronized multiversion: Id607bf36d: Update remaining references to /u/l/a/common-local (duration: 00m 04s) | [production] | 
            
  | 00:22 | <ori> | Synchronized docroot and w: Id607bf36d: Update remaining references to /u/l/a/common-local (duration: 00m 04s) | [production] | 
            
  | 00:08 | <ori> | updated /a/common to {{Gerrit|Id607bf36d}}: Update remaining references to /u/l/a/common-local | [production] | 
            
  
    | 2014-09-10
      
      § | 
    
  | 23:44 | <mutante> | graceful'ed mw1202 apache | [production] | 
            
  | 23:29 | <mutante> | deleted labstore1003.eqiad.wmnet.org from puppet stored resource db, fixes puppet runs on hosts with ssh host key collection | [production] | 
            
  | 23:26 | <oblivian> | gracefulled all apaches | [production] | 
            
  | 23:22 | <maxsem> | Synchronized php-1.24wmf20/includes/specialpage/SpecialPageFactory.php: https://gerrit.wikimedia.org/r/#/c/159526/ (duration: 00m 03s) | [production] | 
            
  | 23:22 | <maxsem> | Synchronized php-1.24wmf19/includes/specialpage/SpecialPageFactory.php: https://gerrit.wikimedia.org/r/#/c/159526/ (duration: 00m 03s) | [production] | 
            
  | 23:21 | <maxsem> | Synchronized php-1.24wmf20/extensions/CentralAuth/: (no message) (duration: 00m 03s) | [production] | 
            
  | 23:21 | <maxsem> | Synchronized php-1.24wmf19/extensions/CentralAuth/: (no message) (duration: 00m 04s) | [production] | 
            
  | 23:19 | <maxsem> | Synchronized php-1.24wmf10/resources/: https://gerrit.wikimedia.org/r/#/c/159513/ (duration: 00m 05s) | [production] | 
            
  | 22:52 | <mutante> | labstore1003 - (earlier) revoked salt and puppet key and signed new after hostname fix - same salt-minion puppet errors that happen after reinstalls | [production] | 
            
  | 19:52 | <Reedy> | Created Echo tables on extension1 for cawikimedia | [production] | 
            
  | 19:52 | <RobH> | puppet disabled on carbon (install server) for a livehack test of config setting | [production] | 
            
  | 18:51 | <yurikR> | yurik CommonSettings.php - zerowiki perm changes | [production] | 
            
  | 18:51 | <yurik> | Synchronized wmf-config/CommonSettings.php: (no message) (duration: 01m 05s) | [production] | 
            
  | 18:26 | <yurik> | Synchronized php-1.24wmf20/extensions/ZeroBanner: (no message) (duration: 01m 09s) | [production] | 
            
  | 18:22 | <yurik> | Synchronized php-1.24wmf19/extensions/ZeroBanner: (no message) (duration: 01m 11s) | [production] | 
            
  | 18:00 | <manybubbles> | cirrus index rebuild for test2wiki went well - doing the rest of group0 | [production] | 
            
  | 17:35 | <manybubbles> | rebuilding cirrus index for test2wiki to test some performance enhancements don't break anything.  test2wiki is too small to see any gain from the enhancements though. | [production] | 
            
  | 17:25 | <Reedy> | mw1126, mw1116, mw1122, mw1146, mw1121, mw1136, mw1114, mw1068 have been gracefulled | [production] | 
            
  | 17:10 | <bd808> | Restarted logstash on logstash1001 | [production] | 
            
  | 16:03 | <demon> | Synchronized wmf-config/InitialiseSettings.php: nlwiki cirrus (duration: 00m 04s) | [production] | 
            
  | 15:44 | <reedy> | Synchronized docroot and w: (no message) (duration: 00m 15s) | [production] | 
            
  | 15:02 | <demon> | Synchronized wmf-config/wikitech.php: no-op (duration: 00m 06s) | [production] | 
            
  | 09:13 | <godog> | rolling restart swift-proxy on ms-fe1* | [production] | 
            
  | 04:17 | <LocalisationUpdate> | ResourceLoader cache refresh completed at Wed Sep 10 04:17:36 UTC 2014 (duration 17m 35s) | [production] | 
            
  | 03:08 | <LocalisationUpdate> | completed (1.24wmf20) at 2014-09-10 03:07:59+00:00 | [production] | 
            
  | 02:36 | <LocalisationUpdate> | completed (1.24wmf19) at 2014-09-10 02:36:00+00:00 | [production] | 
            
  | 02:28 | <ori> | updated salt key for iridium and restarted salt-minion | [production] | 
            
  | 02:18 | <mutante> | started salt-minion on iridium | [production] |