| 2013-01-17
      
      § | 
    
  | 11:43 | <paravoid> | "mwscriptwikiset cleanupUploadStash.php all.dblist" on hume (kill it if swift overloads) | [production] | 
            
  | 11:37 | <Tim> | installed rsyncd on 6 apache servers for network-aware scap testing | [production] | 
            
  | 03:56 | <binasher> | resumed replication on db67 | [production] | 
            
  | 03:49 | <binasher> | stopped replication on db67.pmtpa (enwiki research slave), re-replicating off the pmtpa master instead of cross datacenter. original config isn't well supported by mha. | [production] | 
            
  | 02:45 | <LocalisationUpdate> | completed (1.21wmf8) at Thu Jan 17 02:45:26 UTC 2013 | [production] | 
            
  | 02:27 | <LocalisationUpdate> | completed (1.21wmf7) at Thu Jan 17 02:26:58 UTC 2013 | [production] | 
            
  | 01:12 | <mutante> | DNS update to remove some useless stuff from esams zone (RT-4331) | [production] | 
            
  | 00:44 | <mutante> | installing package upgrades on ms1002 | [production] | 
            
  | 00:38 | <mutante> | powercycling ms1002 | [production] | 
            
  | 00:37 | <LeslieCarr> | reloading unresponsive ms1002 | [production] | 
            
  | 00:00 | <reedy> | synchronized php-1.21wmf7/maintenance/mcc.php | [production] | 
            
  
    | 2013-01-16
      
      § | 
    
  | 23:59 | <reedy> | synchronized php-1.21wmf7/maintenance/mctest.php | [production] | 
            
  | 23:59 | <reedy> | synchronized php-1.21wmf8/maintenance/mctest.php | [production] | 
            
  | 23:49 | <laner> | synchronized wmf-config/lucene.php  'Switching search prefix pool to pmtpa' | [production] | 
            
  | 22:25 | <LeslieCarr> | removing ganglios requirements to try to make it happily run in precise with icinga | [production] | 
            
  | 22:22 | <reedy> | synchronized wmf-config/InitialiseSettings.php | [production] | 
            
  | 22:21 | <reedy> | synchronized php-1.21wmf8/resources/startup.js | [production] | 
            
  | 21:59 | <reedy> | rebuilt wikiversions.cdb and synchronized wikiversions files: wikidatawiki to 1.21wmf8 | [production] | 
            
  | 21:58 | <reedy> | synchronized php-1.21wmf8/extensions/ | [production] | 
            
  | 21:52 | <reedy> | rebuilt wikiversions.cdb and synchronized wikiversions files: testwiki to 1.21wmf8 | [production] | 
            
  | 21:48 | <reedy> | rebuilt wikiversions.cdb and synchronized wikiversions files: mediawikiwiki to wmf8 | [production] | 
            
  | 21:46 | <reedy> | synchronized php-1.21wmf8/extensions/Wikibase | [production] | 
            
  | 21:43 | <LeslieCarr> | restarted nginx on ssl3001 (was depooled) | [production] | 
            
  | 21:42 | <reedy> | synchronized php-1.21wmf8/cache/trusted-xff.cdb | [production] | 
            
  | 21:41 | <reedy> | synchronized php-1.21wmf8/cache/interwiki.cdb | [production] | 
            
  | 21:39 | <reedy> | synchronized php-1.21wmf8/cache/l10n/ | [production] | 
            
  | 21:17 | <binasher> | https://twitter.com/ashbash/status/291655249075240960 | [production] | 
            
  | 21:16 | <RobH> | authdns-update | [production] | 
            
  | 21:13 | <reedy> | synchronized php-1.21wmf7/extensions/Wikibase | [production] | 
            
  | 21:13 | <binasher> | set global read_only=0; on enwiki master | [production] | 
            
  | 21:13 | <asher> | synchronized wmf-config/db.php  'taking s1 out of read-only' | [production] | 
            
  | 21:10 | <binasher> | set global read_only=1; on enwiki master for "we have no unit tests, so lets test read-only in production"� testing | [production] | 
            
  | 21:09 | <asher> | synchronized wmf-config/db.php  'setting s1 to read-only for several minutes' | [production] | 
            
  | 21:01 | <cmjohnson1> | reinstalling sq48 w/lucid | [production] | 
            
  | 20:53 | <mutante> | "bak" directory from unclean SVN copied to /root on sockpuppet as dns_bak.tar.gz just in case | [production] | 
            
  | 20:52 | <mutante> | removing uncommitted stuff from DNS SVN, creating RT for wikimedia.jp.net and softwarewikipedia.com | [production] | 
            
  | 20:42 | <reedy> | synchronized wmf-config/ | [production] | 
            
  | 20:30 | <reedy> | Started syncing Wikimedia installation... : Rebuild message cache for 1.21wmf8 | [production] | 
            
  | 20:17 | <reedy> | synchronized live-1.5/ | [production] | 
            
  | 20:16 | <reedy> | synchronized docroot | [production] | 
            
  | 20:15 | <reedy> | synchronized php-1.21wmf8 | [production] | 
            
  | 20:15 | <reedy> | synchronized php-1.21wmf8 | [production] | 
            
  | 20:13 | <reedy> | synchronized php-1.21wmf8 | [production] | 
            
  | 18:45 | <LeslieCarr> | turning up xe-1/1/2 on asw-c-eqiad (was disabled due ot faulty equipment) | [production] | 
            
  | 18:44 | <LeslieCarr> | turning up xe-1/1/0 on asw-c-eqiad (was disabled due to faulty equipment) | [production] | 
            
  | 18:41 | <mutante> | putting logging-only iptables rule on sanger to check out what rules we actually need | [production] | 
            
  | 18:37 | <mark> | restarted knsq19 earlier | [production] | 
            
  | 18:24 | <mark> | Rerouting 43821->14907 traffic away from AS1257 | [production] | 
            
  | 18:24 | <mutante> | updating pt.planet | [production] | 
            
  | 18:21 | <RobH> | praseodymium being odd, its coming down | [production] |