| 2013-03-15
      
      ยง | 
    
  | 21:14 | <hashar> | restarting Zuul, it is locked somehow. Definitely need to update it :( | [production] | 
            
  | 21:09 | <RobH> | professor services seem back up | [production] | 
            
  | 20:51 | <RobH> | professor shutting down for fan swap, short downtime (hopefully) | [production] | 
            
  | 20:47 | <hashar> | integration.mediawiki.org is not redirecting to the new integration.wikimedia.org (apache conf is disabled). Patch in {{gerrit|54068}} | [production] | 
            
  | 20:33 | <mutante> | puppet runs on neon broken due to mysql puppet issue - mysql-client-5.5 can not create alias mysql-client: object already exists at /var/lib/git/operations/puppet/manifests/mysql.pp:513 | [production] | 
            
  | 20:31 | <mutante> | restarting pdns on ns0 | [production] | 
            
  | 20:30 | <mutante> | DNS update - removing ipv4/ipv6/ipv6and4/results.labs.wm | [production] | 
            
  | 19:37 | <mutante> | maerlant - re-adding 2620:0:862:1::80:2 to eth0, starting nginx | [production] | 
            
  | 19:22 | <sbernardin> | taking down raskin for decommissioning | [production] | 
            
  | 19:13 | <mutante> | maerlant - dpkg: error processing ganglia-monitor | backing up /var/www/ to tridge /data/other then deleting contents | removing sites-enabled/ipv6and4 | nginx can't bind to [2620:0:862:1::80:2]:443 | [production] | 
            
  | 18:50 | <mutante> | installing more package upgrades on maerlant (wikimedia-lvs-realserver, libc6, nginx...) | [production] | 
            
  | 18:46 | <mutante> | installing package upgrades on formey | [production] | 
            
  | 18:44 | <mutante> | fixing broken dpkg/APT on maerlant - dpkg --configure -a , re-run puppet and let it install package upgrades | [production] | 
            
  | 18:33 | <mlitn> | synchronized php-1.21wmf11/extensions/ArticleFeedbackv5/ | [production] | 
            
  | 18:19 | <mlitn> | synchronized php-1.21wmf11/extensions/ArticleFeedbackv5/ | [production] | 
            
  | 18:19 | <notpeter> | ran puppetd --enable on all mw hosts | [production] | 
            
  | 18:15 | <mlitn> | synchronized php-1.21wmf11/extensions/ArticleFeedbackv5/ | [production] | 
            
  | 18:07 | <mlitn> | Finished syncing Wikimedia installation... : Update ArticleFeedbackv5 to master | [production] | 
            
  | 17:52 | <mlitn> | Started syncing Wikimedia installation... : Update ArticleFeedbackv5 to master | [production] | 
            
  | 17:36 | <hashar> | jenkins: updated jenkins configuration to have its URL default to wikimedia.org domain instead of the legacy mediawiki.org | [production] | 
            
  | 17:22 | <mlitn> | synchronized php-1.21wmf11/extensions/ArticleFeedbackv5/  'Update ArticleFeedbackv5 to master' | [production] | 
            
  | 17:21 | <hashar> | gallium : reloading Zuul so it reports the status url with the wikimedia.org domain | [production] | 
            
  | 17:19 | <hashar> | integration website going down while we deploy a new layout. | [production] | 
            
  | 17:03 | <hashar> | gallium : restarted puppet | [production] | 
            
  | 17:03 | <hashar> | gallium : update /srv/ to latest version of integration/docroot.git ( aaa4b0c ) and  moved all content from /srv/org/mediawiki/integration  to the new /srv/org/wikimedia/integration | [production] | 
            
  | 16:59 | <hashar> | stopped puppet on gallium to fix some permissions before puppet changes are merged in and applied. | [production] | 
            
  | 05:09 | <Tim> | restarting squid on cp1010 for squid redirector test | [production] | 
            
  | 05:06 | <Tim> | testing new squid redirector | [production] | 
            
  | 02:30 | <LocalisationUpdate> | completed (1.21wmf11) at Fri Mar 15 02:30:02 UTC 2013 | [production] | 
            
  | 02:16 | <reedy> | synchronized docroot | [production] | 
            
  | 02:13 | <dzahn> | gracefulled all apaches | [production] | 
            
  | 01:53 | <reedy> | synchronized wmf-config/ | [production] | 
            
  | 01:52 | <reedy> | rebuilt wikiversions.cdb and synchronized wikiversions files: | [production] | 
            
  | 01:52 | <reedy> | gracefulled all apaches | [production] | 
            
  | 01:44 | <olivneh> | synchronized php-1.21wmf11/extensions/GettingStarted/SpecialGettingStarted.php  'Fix deployed bug in check for editability' | [production] | 
            
  | 01:44 | <reedy> | synchronized wmf-config/ | [production] | 
            
  | 01:43 | <reedy> | rebuilt wikiversions.cdb and synchronized wikiversions files: | [production] | 
            
  | 01:35 | <reedy> | synchronized wmf-config/ | [production] | 
            
  | 01:34 | <reedy> | rebuilt wikiversions.cdb and synchronized wikiversions files: | [production] | 
            
  | 01:34 | <reedy> | synchronized docroot | [production] | 
            
  | 01:28 | <reedy> | rebuilt wikiversions.cdb and synchronized wikiversions files: | [production] | 
            
  | 01:27 | <reedy> | rebuilt wikiversions.cdb and synchronized wikiversions files: | [production] | 
            
  | 01:21 | <olivneh> | synchronized php-1.21wmf11/extensions/GettingStarted/CategoryRoulette.php  'Fix to use single-parameter version of SRANDMEMBER' | [production] | 
            
  | 01:13 | <reedy> | synchronized wmf-config/InitialiseSettings.php | [production] | 
            
  | 01:13 | <dzahn> | gracefulled all apaches | [production] | 
            
  | 01:12 | <reedy> | synchronized docroot | [production] | 
            
  | 01:10 | <olivneh> | synchronized php-1.21wmf11/extensions/NavigationTiming  'Missed a file in earlier sync' | [production] | 
            
  | 00:57 | <reedy> | synchronized wmf-config/InitialiseSettings.php  'chapcomwiki readonly' | [production] | 
            
  | 00:47 | <olivneh> | synchronized php-1.21wmf11/extensions/NavigationTiming/modules/ext.navigationTiming.js  'Additional fields for NavTiming' | [production] | 
            
  | 00:43 | <mflaschen> | Finished syncing Wikimedia installation... : Deployment for Mobile and E3 | [production] |