| 
      
        2015-07-15
      
      ยง
     | 
  
    
  | 20:20 | 
  <manybubbles> | 
  es1.6 upgrade: upgrade elastic1020 | 
  [production] | 
            
  | 20:18 | 
  <RoanKattouw> | 
  Running FlowCreateMentionTemplate.php on all Flow wikis | 
  [production] | 
            
  | 20:06 | 
  <twentyafterfour> | 
  rebuilt wikiversions.cdb and synchronized wikiversions files: group1 wikis to 1.26wmf14 | 
  [production] | 
            
  | 19:50 | 
  <ejegg> | 
  updated civicrm from e29cc5f20b5069afcaff794e628596c1f70d69a3 to 24e0fc854433ea4982e94a0fd2f8bdad8f8dcad7 | 
  [production] | 
            
  | 19:06 | 
  <krenair> | 
  Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/224408/ (duration: 00m 12s) | 
  [production] | 
            
  | 19:01 | 
  <krenair> | 
  Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/222792/ (duration: 00m 13s) | 
  [production] | 
            
  | 19:00 | 
  <krenair> | 
  Synchronized wmf-config/wikitech.php: https://gerrit.wikimedia.org/r/#/c/222792/ (duration: 00m 12s) | 
  [production] | 
            
  | 18:58 | 
  <krenair> | 
  Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/222776/ (duration: 00m 13s) | 
  [production] | 
            
  | 18:57 | 
  <krenair> | 
  Synchronized wmf-config/CommonSettings.php: https://gerrit.wikimedia.org/r/#/c/222776/ (duration: 00m 13s) | 
  [production] | 
            
  | 18:40 | 
  <ejegg> | 
  updated civicrm from f4219bc8eca5e4db633da07b6ac9e2505cfbae16 to e29cc5f20b5069afcaff794e628596c1f70d69a3 | 
  [production] | 
            
  | 18:39 | 
  <krenair> | 
  Synchronized wmf-config/throttle.php: throttle labswiki account creations from hackathon at 500 (duration: 00m 12s) | 
  [production] | 
            
  | 18:39 | 
  <twentyafterfour> | 
  Finished scap: group0 to 1.26wmf14 (duration: 32m 34s) | 
  [production] | 
            
  | 18:21 | 
  <manybubbles> | 
  es1.6 upgrade: upgrading elastic1019 | 
  [production] | 
            
  | 18:20 | 
  <Jeff_Green> | 
  authdns-update shifting to service-oriented hostnames for fundraising cluster | 
  [production] | 
            
  | 18:06 | 
  <twentyafterfour> | 
  Started scap: group0 to 1.26wmf14 | 
  [production] | 
            
  | 17:55 | 
  <ejegg> | 
  updated civicrm from 6560cefa8d7e68e35e30b310d6691ab57798a4c9 to f4219bc8eca5e4db633da07b6ac9e2505cfbae16 | 
  [production] | 
            
  | 17:34 | 
  <Jeff_Green> | 
  authdns-update to remove boron.wm.o | 
  [production] | 
            
  | 17:22 | 
  <krenair> | 
  Synchronized wmf-config/CommonSettings.php: partially revert https://gerrit.wikimedia.org/r/#/c/224420/1/wmf-config/CommonSettings.php - doesnt quite work (duration: 00m 13s) | 
  [production] | 
            
  | 17:17 | 
  <Jeff_Green> | 
  authdns-update to remove aluminium, also lanthanum by preexisting commit  | 
  [production] | 
            
  | 16:45 | 
  <andrewbogott> | 
  rebooting labvirt1005 | 
  [production] | 
            
  | 16:43 | 
  <mutante> | 
  accepting unaccepted salt keys for ganeti VMs ,planet, bromine, krypton | 
  [production] | 
            
  | 16:39 | 
  <mutante> | 
  krypton - signing puppet cert, initial run  | 
  [production] | 
            
  | 16:26 | 
  <andrewbogott> | 
  woo, first try! | 
  [production] | 
            
  | 16:23 | 
  <andrewbogott> | 
  trying to kill labvirt1005 via repeated instance suspend/resume | 
  [production] | 
            
  | 16:04 | 
  <krenair> | 
  Synchronized wmf-config/CommonSettings.php: https://gerrit.wikimedia.org/r/#/c/224420/ (duration: 00m 12s) | 
  [production] | 
            
  | 16:03 | 
  <krenair> | 
  Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/224420/ (duration: 00m 12s) | 
  [production] | 
            
  | 16:01 | 
  <krenair> | 
  Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/224808/ (duration: 00m 12s) | 
  [production] | 
            
  | 15:58 | 
  <krenair> | 
  Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/222581/ (duration: 00m 11s) | 
  [production] | 
            
  | 15:35 | 
  <krenair> | 
  Synchronized database lists: (no message) (duration: 00m 11s) | 
  [production] | 
            
  | 15:29 | 
  <krenair> | 
  Synchronized docroot/noc/createTxtFileSymlinks.sh: https://gerrit.wikimedia.org/r/#/c/139326/ (duration: 00m 12s) | 
  [production] | 
            
  | 15:27 | 
  <krenair> | 
  Synchronized wmf-config/CommonSettings.php: https://gerrit.wikimedia.org/r/#/c/139326/ (duration: 00m 12s) | 
  [production] | 
            
  | 15:20 | 
  <krenair> | 
  Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/139326/ (duration: 00m 11s) | 
  [production] | 
            
  | 14:33 | 
  <legoktm> | 
  Synchronized wmf-config/CommonSettings.php: Set $wgCentralAuthStrict = true; (duration: 00m 12s) | 
  [production] | 
            
  | 14:22 | 
  <legoktm> | 
  sync failed on mw1090.eqiad.wmnet, read only filesystem | 
  [production] | 
            
  | 14:20 | 
  <legoktm> | 
  Synchronized php-1.26wmf13/extensions/CentralAuth/includes/CentralAuthPlugin.php: Add log entry for $wgCentralAuthStrict failures if SULMigration is enabled (duration: 00m 13s) | 
  [production] | 
            
  | 13:55 | 
  <dcausse> | 
  es1.6 upgrade: upgrade elastic1018 | 
  [production] | 
            
  | 13:24 | 
  <springle> | 
  entry below not mw1216 fault, but r/o filesystem error on mw1090 | 
  [production] | 
            
  | 13:15 | 
  <springle> | 
  sync-common on mw1216 after sync-file from tin failed non-zero exit status 12 | 
  [production] | 
            
  | 13:12 | 
  <springle> | 
  Synchronized wmf-config/db-eqiad.php: depool db1022 T105879 (duration: 00m 12s) | 
  [production] | 
            
  | 11:43 | 
  <dcausse> | 
  es1.6 upgrade: upgrade elastic1017 | 
  [production] | 
            
  | 08:27 | 
  <dcausse> | 
  es1.6 upgrade: upgrade elastic1016 | 
  [production] | 
            
  | 06:31 | 
  <dcausse> | 
  es1.6 upgrade: upgrade elastic1015 | 
  [production] | 
            
  | 05:40 | 
  <dcausse> | 
  es1.6 upgrade: upgrade elastic1014 | 
  [production] | 
            
  | 05:10 | 
  <springle> | 
  db1030 busy removing table partitioning | 
  [production] | 
            
  | 04:28 | 
  <manybubbles> | 
  es1.6 upgrade: lowered the shard transfer settings back to our normal rate. going to bed. | 
  [production] | 
            
  | 04:12 | 
  <manybubbles> | 
  es1.6 upgrade: upgrade elastic1013 | 
  [production] | 
            
  | 03:49 | 
  <springle> | 
  upgrade db1030 trusty | 
  [production] | 
            
  | 03:29 | 
  <manybubbles> | 
  es1.6 upgrade: upgrade elastic1012 | 
  [production] | 
            
  | 03:14 | 
  <LocalisationUpdate> | 
  completed (1.26wmf13) at 2015-07-15 03:14:21+00:00 | 
  [production] | 
            
  | 03:10 | 
  <reedy> | 
  Synchronized php-1.26wmf13/cache/l10n: (no message) (duration: 13m 32s) | 
  [production] |