| 2013-03-14
      
      § | 
    
  | 23:48 | <mutante> | DNS update - add affcom in prep. to replace chapcom (bug 39482) | [production] | 
            
  | 23:47 | <awjrichards> | synchronized wmf-config/InitialiseSettings.php  'Updating MF copyright logo path for enwiki' | [production] | 
            
  | 23:46 | <awjrichards> | synchronized php-1.21wmf11/extensions/MobileFrontend/  'Updating MobileFrontend per https://www.mediawiki.org/wiki/Extension:MobileFrontend/Deployments/2013-03-14' | [production] | 
            
  | 23:43 | <mutante> | installing package upgrades on sockpuppet | [production] | 
            
  | 23:30 | <awjrichards> | synchronized wmf-config/InitialiseSettings.php  'Updating MF copyright logo for testwiki' | [production] | 
            
  | 22:52 | <reedy> | synchronized wmf-config/InitialiseSettings.php | [production] | 
            
  | 22:43 | <mutante> | pa.us.wikimedia.org now redirects to pa-us.wikimedia.org (Wikimedia Pennsylvania) (no sub.sub domains) | [production] | 
            
  | 22:41 | <dzahn> | gracefulled all apaches | [production] | 
            
  | 22:34 | <mutante> | disabling notifications for puppet freshness on celsus | [production] | 
            
  | 22:13 | <olivneh> | synchronized wmf-config/InitialiseSettings.php  'Enabling NavigationTiming at 1:10,000 sampling factor across cluster.' | [production] | 
            
  | 22:02 | <olivneh> | synchronized wmf-config  'Enable NavigationTiming on test2' | [production] | 
            
  | 21:57 | <olivneh> | synchronized php-1.21wmf11/extensions/NavigationTiming  'Update of extension to use EventLogging' | [production] | 
            
  | 21:51 | <hashar> | Gerrit took roughly 5 minutes to merge the change https://gerrit.wikimedia.org/r/#/c/53412/ ( mediawiki/core ) which means Zuul does nothing during that time waiting for the merge to happen. | [production] | 
            
  | 21:48 | <hashar> | apparently Gerrit takes ages to submit a change that in turn cause a hard lock on Zuul which is waiting for the merge to happen. | [production] | 
            
  | 21:39 | <hashar> | Zuul is hanging out not reporting changes :/ | [production] | 
            
  | 21:01 | <mutante> | DNS update - add pa-us wiki to replace pa.us | [production] | 
            
  | 20:57 | <reedy> | synchronized wmf-config/InitialiseSettings.php | [production] | 
            
  | 20:50 | <cmjohnson1> | authdns update (labsdb1002-3 vlan) | [production] | 
            
  | 20:45 | <Ryan_Lane> | deleting the jenkins user from ldap | [production] | 
            
  | 20:36 | <mutante> | DNS update - add zuul as CNAME for gallium | [production] | 
            
  | 20:34 | <Ryan_Lane> | installed WikiLove on wikitech | [production] | 
            
  | 20:30 | <ori-l> | Added article edit event to EventLogging, which upped events/sec from ~3.5 to ~30. Expect increased load on vanadium and db1047; bits caches unaffected. | [production] | 
            
  | 20:20 | <olivneh> | synchronized php-1.21wmf11/extensions/EventLogging  'Log ['HTTP_HOST'] as webHost' | [production] | 
            
  | 20:05 | <olivneh> | synchronized php-1.21wmf11/includes/WikiPage.php  'Adds CategoryAfterPageAdded / CategoryAfterPageRemoved hooks' | [production] | 
            
  | 19:32 | <aaron> | synchronized php-1.21wmf11/includes/job/jobs  'deployed 6f76ede163cb114724bce7a1c1b8938e1e30606f ' | [production] | 
            
  | 18:49 | <aaron> | synchronized wmf-config/InitialiseSettings.php  'Enable wgEnableAsyncUploads only on testwikis for now' | [production] | 
            
  | 18:44 | <mlitn> | synchronized php-1.21wmf11/extensions/ArticleFeedbackv5/  'Update ArticleFeedbackv5 to master' | [production] | 
            
  | 18:41 | <asher> | synchronized wmf-config/db-eqiad.php  'returning db1009 to full weight' | [production] | 
            
  | 18:31 | <asher> | synchronized wmf-config/db-eqiad.php  'returning db1009 at a low weight for warmup' | [production] | 
            
  | 18:12 | <aaron> | synchronized wmf-config/InitialiseSettings.php  'Enabled $wgEnableAsyncUploads on all wikis' | [production] | 
            
  | 18:08 | <binasher> | cleaned up myisam cruft (unused t���ables) on s2 | [production] | 
            
  | 17:49 | <aaron> | synchronized wmf-config  'Enabled redis job aggregator fully' | [production] | 
            
  | 17:47 | <cmjohnson1> | labsdb1001 powering down | [production] | 
            
  | 17:42 | <aaron> | synchronized wmf-config  'Set redis job aggregator on for testwiki.' | [production] | 
            
  | 17:27 | <reedy> | synchronized php-1.21wmf11/extensions/Math/ | [production] | 
            
  | 17:23 | <binasher> | shutting down mysql on db1009, upgrading to mariadb | [production] | 
            
  | 16:59 | <cmjohnson1> | powering down labsdb1002 and labsdb1003 | [production] | 
            
  | 16:59 | <asher> | synchronized wmf-config/db-eqiad.php  'pulling db1009 for mariadb migration' | [production] | 
            
  | 16:57 | <cmjohnson1> | addin mw1041 back to dsh groups | [production] | 
            
  | 16:26 | <mlitn> | synchronized wmf-config  'Prepare AFTv5 config for deployment new features' | [production] | 
            
  | 13:15 | <mark> | Set OSPF cost to 10 on csw1-esams:ve7 to facilitate ip multipath | [production] | 
            
  | 13:15 | <mark> | Fixed OSPF on cr2-knams:xe-0/0/0 - csw1-esams:e8/2 (earlier) | [production] | 
            
  | 12:16 | <hashar> | gallium setting up /srv/ as a copy of integration/docroot.git | [production] | 
            
  | 09:03 | <apergos> | restarted varnishncsa.vanadium on niobium, it was using 9gb memory or so | [production] | 
            
  | 02:25 | <LocalisationUpdate> | completed (1.21wmf11) at Thu Mar 14 02:25:19 UTC 2013 | [production] | 
            
  | 02:20 | <hashar> | jenkins: made Zuul to block changes on operations/debs/ircecho whenever pep8/pyflakes fails. | [production] | 
            
  | 01:35 | <mutante> | running puppet on celsus to investigate puppet freshness reports from icinga - it started parsoid, but also celsus is a Wikimedia DECOMMISSIONED server (base::decommissioned). | [production] | 
            
  | 01:10 | <reedy> | synchronized php-1.21wmf11/cache/l10n/ | [production] | 
            
  | 00:59 | <reedy> | synchronized php-1.21wmf11/extensions/Scribunto | [production] |