| 2014-02-13
      
      § | 
    
  | 22:54 | <ori> | synchronized php-1.23wmf14/extensions/NavigationTiming  'Update NavigationTiming to master for I4aa367e96: Round 'mediaWikiLoadComplete' to comply with schema' | [production] | 
            
  | 22:52 | <ori> | synchronized php-1.23wmf13/extensions/NavigationTiming  'Update NavigationTiming to master for I4aa367e96: Round 'mediaWikiLoadComplete' to comply with schema' | [production] | 
            
  | 22:33 | <reedy> | synchronized wmf-config/  'All of the changes' | [production] | 
            
  | 22:12 | <ori> | restarting EL on vanadium | [production] | 
            
  | 21:10 | <mark> | Reenabled OSPF on cr2-knams:xe-1/1/0.0 | [production] | 
            
  | 21:00 | <mark> | Disabling OSPF on cr2-knams:xe-1/1/0.0 | [production] | 
            
  | 20:23 | <reedy> | synchronized php-1.23wmf14/extensions/FlaggedRevs  'Fix syntax errors' | [production] | 
            
  | 20:15 | <MaxSem> | Rebuilding GeoData index | [production] | 
            
  | 19:14 | <reedy> | rebuilt wikiversions.cdb and synchronized wikiversions files: group0 wikis to 1.23wmf14 | [production] | 
            
  | 19:07 | <Reedy> | mw1163: ssh: connect to host mw1163 port 22: Connection timed out | [production] | 
            
  | 19:07 | <reedy> | rebuilt wikiversions.cdb and synchronized wikiversions files: Wikipedias to 1.23wmf13, testwiki back to 1.23wmf13 too | [production] | 
            
  | 19:05 | <Reedy> | mw1094 is segfaulting too, but not so much | [production] | 
            
  | 19:04 | <mwalker> | updated civicrm from 935b6dade2c230558c12538ae61dcb3ef18b3efd to bd973432c957b6253f82b7b0590251402e75a0de for some new submodules and thank you updates | [production] | 
            
  | 19:04 | <Reedy> | mw1185 is segfaulting a lot | [production] | 
            
  | 18:59 | <reedy> | finished scap: testwiki to 1.23wmf14 and build l10n cache (duration: 41m 59s) | [production] | 
            
  | 18:17 | <reedy> | started scap: testwiki to 1.23wmf14 and build l10n cache | [production] | 
            
  | 18:17 | <reedy> | scap aborted: testwiki to 1.23wmf14 and build l10n cache (duration: 04m 05s) | [production] | 
            
  | 18:13 | <reedy> | started scap: testwiki to 1.23wmf14 and build l10n cache | [production] | 
            
  | 18:09 | <reedy> | scap failed: CalledProcessError Command '/usr/local/bin/mw-update-l10n' returned non-zero exit status 1 (duration: 03m 04s) | [production] | 
            
  | 18:06 | <reedy> | started scap: testwiki to 1.23wmf14 and build l10n cache | [production] | 
            
  | 18:06 | <reedy> | scap aborted: testwiki to 1.23wmf14 and build l10n cache (duration: 00m 04s) | [production] | 
            
  | 18:06 | <reedy> | started scap: testwiki to 1.23wmf14 and build l10n cache | [production] | 
            
  | 17:58 | <reedy> | updated /a/common to {{Gerrit|I5cde3917b}}: db1056 and db1036 full steam | [production] | 
            
  | 15:17 | <manybubbles> | I'll start both this evening, time permitting. | [production] | 
            
  | 15:17 | <manybubbles> | all of this week's Cirrus index updates are done except those for the wikipedias to which cirrus is deployed and commons.  I | [production] | 
            
  | 04:42 | <springle> | synchronized wmf-config/db-eqiad.php  'db1056 db1036 full steam' | [production] | 
            
  | 04:10 | <springle> | synchronized wmf-config/db-eqiad.php  's2 repool db1036 as slave' | [production] | 
            
  | 03:51 | <springle> | synchronized wmf-config/db-eqiad.php  's1 repool db1056 as slave' | [production] | 
            
  | 03:28 | <LocalisationUpdate> | ResourceLoader cache refresh completed at 2014-02-13 03:28:37+00:00 | [production] | 
            
  | 02:57 | <Guest92179> | DNS update - Bugzilla TTL back to 1H, migration over | [production] | 
            
  | 02:47 | <LocalisationUpdate> | completed (1.23wmf12) at 2014-02-13 02:46:53+00:00 | [production] | 
            
  | 02:33 | <springle_> | db9 mysqld stopped for decom, db1001 slave stopped | [production] | 
            
  | 02:27 | <LocalisationUpdate> | completed (1.23wmf13) at 2014-02-13 02:27:05+00:00 | [production] | 
            
  | 02:04 | <Krinkle> | Jenkins has been unresponsive to urls that retrieve build results for the past few hours (e.g. https://integration.wikimedia.org/ci/job/mediawiki-core-jslint/11129/console) | [production] | 
            
  | 01:51 | <^d> | gerrit: turned BZ plugin back on since downtime is over. No less than 5 pings to do so ;-) | [production] | 
            
  | 01:36 | <awight> | tools updated from ad90b56ab7e71142a7e98825bad3febe0823920a to 946011f1db995ee73794c6bfa2c40bf8628f960d | [production] | 
            
  | 00:57 | <mutante> | Welcome to Bugzilla 4.4.1 in eqiad, served by puppet module bugzilla on zirconium | [production] | 
            
  | 00:55 | <mutante> | DNS update - switching Bugzilla to zirconium | [production] | 
            
  | 00:50 | <springle> | xtrabackup clone db1018 to db1036 | [production] | 
            
  | 00:19 | <awight> | checkout new phpmailer and drush | [production] | 
            
  | 00:15 | <awight> | checkout twig and DonationInterface into new dirs | [production] |