| 2012-04-24
      
      § | 
    
  | 23:48 | <logmsgbot_> | aaron synchronized php-1.19/includes/Setup.php  'Hacked out session request stats.' | [production] | 
            
  | 23:46 | <logmsgbot_> | aaron synchronized php-1.20wmf1/includes/Setup.php  'Deployed 42fcd43299246ecd1b265fcfcdd01a60319cf378' | [production] | 
            
  | 23:19 | <AaronSchulz> | Running 'mwscriptwikiset maintenance/populateRevisionSha1.php all.dblist' on hume | [production] | 
            
  | 22:43 | <logmsgbot_> | aaron synchronized wmf-config/CommonSettings.php  'Enabled file change journal on wikis using the new backend config.' | [production] | 
            
  | 22:20 | <AaronSchulz> | Tables added | [production] | 
            
  | 22:18 | <binasher> | rebooting db16 with updated kernel.  it's probably still hopeless (dimm errors) | [production] | 
            
  | 22:18 | <AaronSchulz> | Creating the filejournal table on all wikis | [production] | 
            
  | 21:59 | <logmsgbot_> | aaron synchronized wmf-config/CommonSettings.php  'Switched commonswiki to the new backend config format.' | [production] | 
            
  | 21:48 | <logmsgbot_> | asher synchronized wmf-config/db.php  'pulling db16, memory errors' | [production] | 
            
  | 20:13 | <apergos> | re-enabled replication via cron on ms7, it should catch up within an hour or so | [production] | 
            
  | 20:10 | <binasher> | reimaged db58 with fixed raid setup, imaging db59 | [production] | 
            
  | 19:51 | <notpeter> | starting innobackupex from db1034 to db57 for new s2 slave | [production] | 
            
  | 19:50 | <Ryan_Lane> | repooling ssl3001 | [production] | 
            
  | 19:28 | <Ryan_Lane> | depooling ssl3001 | [production] | 
            
  | 18:18 | <LeslieCarr> | deploying to frontend | [production] | 
            
  | 17:48 | <notpeter> | deploying new squid conf to cp1001 frontend. is just a udp2log port change. | [production] | 
            
  | 17:19 | <logmsgbot_> | aaron synchronized wmf-config/CommonSettings.php  'Using newer backend for shared repos for testwiki, test2wiki, and mediawikiwiki.' | [production] | 
            
  | 16:55 | <logmsgbot_> | nikerabbit synchronized wmf-config/CommonSettings.php  'Translate extension configuration changes' | [production] | 
            
  | 11:54 | <apergos> | after much cursing and kicking zfs, a manual snapshot replication is running in screen as root on ms7 to ms8, expect it to take at least a day | [production] | 
            
  | 11:44 | <mark> | Sending all non-european upload traffic back to pmtpa to prepare for eqiad varnish storage rework | [production] | 
            
  | 08:56 | <mutante> | updated blog theme per guillaume (April commits) | [production] | 
            
  | 08:05 | <apergos> | temporarily disabled automatic zfs replication from ms7 -> ms8, cleared out space on ms8, catching up by hand | [production] | 
            
  | 04:00 | <Ryan_Lane> | powercycling ssl1 | [production] | 
            
  | 02:47 | <logmsgbot_> | aaron synchronized php-1.19/extensions/MobileFrontend/MobileFrontend.body.php  'Fixed notice spam.' | [production] | 
            
  | 02:45 | <logmsgbot_> | aaron synchronized php-1.20wmf1/extensions/MobileFrontend/MobileFrontend.body.php  'Fixed notice spam.' | [production] | 
            
  | 02:37 | <logmsgbot_> | aaron synchronized wmf-config/CommonSettings.php  'Restructed filerepo a config a bit; nothing changed yet.' | [production] | 
            
  | 02:28 | <logmsgbot_> | LocalisationUpdate completed (1.20wmf1) at Tue Apr 24 02:28:47 UTC 2012 | [production] | 
            
  | 02:15 | <logmsgbot_> | LocalisationUpdate completed (1.19) at Tue Apr 24 02:15:00 UTC 2012 | [production] | 
            
  | 00:15 | <logmsgbot_> | awjrichards synchronized php-1.20wmf1/extensions/MobileFrontend/stylesheets/common.css  '0be2dc1288361c51f91533f1f77e78d9279b86e0' | [production] | 
            
  | 00:13 | <logmsgbot_> | awjrichards synchronized php/extensions/MobileFrontend/stylesheets/common.css  '[[rev:115019|r115019]]' | [production] | 
            
  
    | 2012-04-23
      
      § | 
    
  | 23:35 | <logmsgbot_> | awjrichards synchronized wmf-config/CommonSettings.php  'Bumpging MobileFrontend resource version' | [production] | 
            
  | 23:07 | <logmsgbot_> | awjrichards synchronizing Wikimedia installation... : | [production] | 
            
  | 23:02 | <logmsgbot_> | catrope synchronized wmf-config/CommonSettings.php  'Add code for new URL scheme based on version_compare() logic' | [production] | 
            
  | 22:51 | <logmsgbot_> | awjrichards synchronizing Wikimedia installation... : MobileFrontend updates per http://www.mediawiki.org/wiki/Extension:MobileFrontend/Deployments#23_April.2C_2012 | [production] | 
            
  | 22:33 | <logmsgbot_> | awjrichards synchronized wmf-config/CommonSettings.php  'bumping mobile frontend resource version' | [production] | 
            
  | 21:49 | <logmsgbot_> | catrope synchronized php-1.20wmf1/resources/mediawiki/mediawiki.js  'Deploy 6e55a770b26b17b8fc9b5b4fe943dcc2867df4f3' | [production] | 
            
  | 21:27 | <logmsgbot_> | catrope synchronized php-1.20wmf1/extensions/ArticleFeedbackv5/modules/jquery.articleFeedbackv5/jquery.articleFeedbackv5.js  'Deploy 93d470b' | [production] | 
            
  | 20:41 | <mutante> | neon - upgraded libssl, started icinga after adding monitor group | [production] | 
            
  | 20:32 | <logmsgbot_> | aaron synchronized php-1.20wmf1/includes/filerepo/FileRepo.php  'Disabled write checks in the cleanDir() function.' | [production] | 
            
  | 20:31 | <logmsgbot_> | aaron synchronized php-1.20wmf1/includes/filerepo/FileRepo.php  'Disabled write checks in the quickImport/quickPurge functions.' | [production] | 
            
  | 19:43 | <logmsgbot_> | catrope synchronized php-1.20wmf1/includes/specials/SpecialListgrouprights.php  'Deploy 047543b6805a268c8d689a7a1ce12ec545ef79a9' | [production] | 
            
  | 18:44 | <logmsgbot_> | reedy synchronized wmf-config/InitialiseSettings.php  'touch' | [production] | 
            
  | 18:43 | <logmsgbot_> | reedy synchronized flaggedrevs.dblist  'Seems I never added ukwiki to the dblist... Oh well' | [production] | 
            
  | 18:32 | <logmsgbot_> | aaron synchronized wikiversions.dat | [production] | 
            
  | 18:32 | <logmsgbot_> | aaron rebuilt wikiversions.cdb and synchronized wikiversions files: Moved enwiki to 1.20wmf1 | [production] | 
            
  | 18:28 | <logmsgbot_> | aaron synchronized php-1.20wmf1/includes/specials/SpecialContributions.php  'Deployed 72969cf8c9a403430c8c93fc20ab3118328c4d9c' | [production] | 
            
  | 17:06 | <logmsgbot_> | aaron synchronized wmf-config/CommonSettings.php  'Made mediawikiwiki use the newer backend config.' | [production] | 
            
  | 14:33 | <notpeter> | stopping puppet on cp1041 as well | [production] | 
            
  | 14:18 | <notpeter> | temp stopping puppet on cp1042-1044 | [production] | 
            
  | 13:09 | <mutante> | powercycling frozen mw25, looks like mw21 above but no console output to paste here | [production] |