| 2013-04-18
      
      § | 
    
  | 07:06 | <maxsem> | synchronized wmf-config/mobile.php  'https://gerrit.wikimedia.org/r/#/c/59767/' | [production] | 
            
  | 05:59 | <tstarling> | synchronized wmf-config/InitialiseSettings.php | [production] | 
            
  | 05:21 | <tstarling> | synchronized php-1.22wmf1/includes/specials/SpecialSearch.php | [production] | 
            
  | 05:14 | <tstarling> | synchronized php-1.22wmf2/extensions/MWSearch/MWSearch_body.php | [production] | 
            
  | 05:12 | <tstarling> | synchronized php-1.22wmf1/extensions/MWSearch/MWSearch_body.php | [production] | 
            
  | 05:09 | <tstarling> | synchronized php-1.22wmf1/includes/specials/SpecialSearch.php | [production] | 
            
  | 03:57 | <tstarling> | synchronized php-1.22wmf2/extensions/MWSearch | [production] | 
            
  | 03:55 | <tstarling> | synchronized php-1.22wmf2/includes/HttpFunctions.php | [production] | 
            
  | 03:48 | <tstarling> | synchronized php-1.22wmf1/extensions/MWSearch | [production] | 
            
  | 03:45 | <tstarling> | synchronized php-1.22wmf1/includes/HttpFunctions.php | [production] | 
            
  | 03:26 | <LocalisationUpdate> | ResourceLoader cache refresh completed at Thu Apr 18 03:26:48 UTC 2013 | [production] | 
            
  | 02:24 | <LocalisationUpdate> | completed (1.22wmf1) at Thu Apr 18 02:23:54 UTC 2013 | [production] | 
            
  | 02:14 | <LocalisationUpdate> | completed (1.22wmf2) at Thu Apr 18 02:14:26 UTC 2013 | [production] | 
            
  | 01:03 | <mutante> | re-enabling Tomasz' RT account | [production] | 
            
  | 00:42 | <asher> | synchronized wmf-config/db-eqiad.php  'setting db1004 to full weight' | [production] | 
            
  | 00:37 | <asher> | synchronized wmf-config/db-eqiad.php  'adding db1004 at a warmup weight' | [production] | 
            
  | 00:09 | <demon> | synchronized docroot | [production] | 
            
  
    | 2013-04-17
      
      § | 
    
  | 23:39 | <asher> | synchronized wmf-config/db-eqiad.php  'pulling db1004' | [production] | 
            
  | 23:20 | <mwalker> | synchronized php-1.22wmf2/extensions/ContributionReporting  'Finished update of CN and CR to latest' | [production] | 
            
  | 23:19 | <mwalker> | synchronized php-1.22wmf2/extensions/CentralNotice/ | [production] | 
            
  | 23:13 | <hashar> | If jenkins/zuul goes wild overnight:  connect to gallium, killoff puppet in crontab then  /etc/init.d/zuul stop and drop me an email. Will take of it whenever I wake up. | [production] | 
            
  | 23:12 | <mwalker> | synchronized php-1.22wmf1/extensions/ContributionReporting/ | [production] | 
            
  | 23:11 | <mwalker> | synchronized php-1.22wmf1/extensions/CentralNotice  'Beginning update of CentralNotice and ContributionTracking to latest' | [production] | 
            
  | 22:59 | <hashar> | restarting Zuul | [production] | 
            
  | 22:20 | <hashar> | Jenkins repointing all jobs to use the new Zuul repo ( /srv/ssd/zuul/git ) {{gerrit|59744}} | [production] | 
            
  | 22:06 | <hashar> | jenkins restarted.  Restarting Zuul. | [production] | 
            
  | 21:20 | <hashar> | stopped Zuul. Will wait a bit till jenkins start up | [production] | 
            
  | 21:19 | <hashar> | restarted Jenkins | [production] | 
            
  | 21:19 | <hashar> | restarted Zuul | [production] | 
            
  | 21:16 | <hashar> | finished migrating zuul git repositories ( rsync -av /var/lib/zuul/git /srv/ssd/zuul  ) | [production] | 
            
  | 21:08 | <hashar> | Zuul ETA: it is copying MobileFrontend extension right now so half way done | [production] | 
            
  | 21:06 | <reedy> | rebuilt wikiversions.cdb and synchronized wikiversions files: wiktionaries to 1.22wmf2 | [production] | 
            
  | 21:03 | <reedy> | rebuilt wikiversions.cdb and synchronized wikiversions files: wikisource and wikiquote to 1.22wmf2 | [production] | 
            
  | 21:01 | <reedy> | rebuilt wikiversions.cdb and synchronized wikiversions files: wikibooks and wikiversity to 1.22wmf2 | [production] | 
            
  | 21:00 | <reedy> | rebuilt wikiversions.cdb and synchronized wikiversions files: wikidatawiki back to 1.22wmf1 | [production] | 
            
  | 20:59 | <hashar> | stopping Jenkins that somehow restarted | [production] | 
            
  | 20:59 | <reedy> | synchronized php-1.22wmf2/includes/db/DatabaseMysql.php  'moar' | [production] | 
            
  | 20:57 | <reedy> | synchronized wmf-config/InitialiseSettings.php | [production] | 
            
  | 20:54 | <reedy> | rebuilt wikiversions.cdb and synchronized wikiversions files: wikinews.dblist and special wikis to 1.22wmf2 | [production] | 
            
  | 20:51 | <reedy> | synchronized php-1.22wmf2/includes/db/DatabaseMysql.php  'debugging' | [production] | 
            
  | 20:49 | <reedy> | rebuilt wikiversions.cdb and synchronized wikiversions files: wikivoyage, wikimania and wikimedia to 1.22wmf2 | [production] | 
            
  | 20:44 | <reedy> | rebuilt wikiversions.cdb and synchronized wikiversions files: Some wikis to create some noise | [production] | 
            
  | 20:41 | <reedy> | synchronized php-1.22wmf2/includes/db/DatabaseMysql.php  'debugging' | [production] | 
            
  | 20:29 | <hashar> | Switching zuul dir to /srv/ssd/zuul ( {{gerrit|58898}} and {{gerrit|58899}} ) | [production] | 
            
  | 20:18 | <hashar> | stopping Zuul gracefully | [production] | 
            
  | 20:16 | <reedy> | rebuilt wikiversions.cdb and synchronized wikiversions files: Revert that due to large number of warnings... | [production] | 
            
  | 20:14 | <reedy> | rebuilt wikiversions.cdb and synchronized wikiversions files: fishbowl, private and special to 1.22wmf2 | [production] | 
            
  | 19:56 | <hashar> | gallium slowness is partly due to the ssd install.  The git repositories are on the slow raid where as the workspaces are on the ssd.  That means `git clone` can't do hardlink anymore :( | [production] | 
            
  | 19:43 | <binasher> | enwiki, dewiki, wikidata are fully on mariadb 5.5.30 | [production] | 
            
  | 19:33 | <hashar> | jenkins: reducing number of executors from 10 to 6. | [production] |