| 
      
        2019-01-16
      
      ยง
     | 
  
    
  | 21:35 | 
  <ppchelko@deploy1001> | 
  Finished deploy [recommendation-api/deploy@c1b6b32]: Rollback update to 1a1f824 (duration: 01m 59s) | 
  [production] | 
            
  | 21:33 | 
  <ppchelko@deploy1001> | 
  Started deploy [recommendation-api/deploy@c1b6b32]: Rollback update to 1a1f824 | 
  [production] | 
            
  | 21:29 | 
  <ppchelko@deploy1001> | 
  deploy aborted: log (duration: 00m 02s) | 
  [production] | 
            
  | 21:29 | 
  <ppchelko@deploy1001> | 
  Started deploy [recommendation-api/deploy@da83637]: log | 
  [production] | 
            
  | 21:28 | 
  <bmansurov@deploy1001> | 
  Finished deploy [recommendation-api/deploy@da83637]: Update to 1a1f824 (duration: 06m 14s) | 
  [production] | 
            
  | 21:22 | 
  <bmansurov@deploy1001> | 
  Started deploy [recommendation-api/deploy@da83637]: Update to 1a1f824 | 
  [production] | 
            
  | 21:17 | 
  <bsitzmann@deploy1001> | 
  Finished deploy [mobileapps/deploy@6b344ca]: Update mobileapps to 258d76b page summary changes (duration: 06m 31s) | 
  [production] | 
            
  | 21:10 | 
  <bsitzmann@deploy1001> | 
  Started deploy [mobileapps/deploy@6b344ca]: Update mobileapps to 258d76b page summary changes | 
  [production] | 
            
  | 20:20 | 
  <dduvall@deploy1001> | 
  Synchronized php: group1 wikis to 1.33.0-wmf.13 (duration: 00m 51s) | 
  [production] | 
            
  | 20:19 | 
  <dduvall@deploy1001> | 
  rebuilt and synchronized wikiversions files: group1 wikis to 1.33.0-wmf.13 | 
  [production] | 
            
  | 19:48 | 
  <gehel> | 
  switching wdqs categories traffic to new second instance, puppet will be disabled during the operation on all wdqs nodes - T213212 | 
  [production] | 
            
  | 19:29 | 
  <thcipriani> | 
  restarting ci jenkins for upgrade | 
  [production] | 
            
  | 19:13 | 
  <thcipriani> | 
  restarting gerrit on cobalt for 2.15.8 upgrade | 
  [production] | 
            
  | 19:12 | 
  <thcipriani@deploy1001> | 
  Finished deploy [gerrit/gerrit@cec7995]: Gerrit to 2.15.8 on cobalt (duration: 00m 10s) | 
  [production] | 
            
  | 19:12 | 
  <thcipriani@deploy1001> | 
  Started deploy [gerrit/gerrit@cec7995]: Gerrit to 2.15.8 on cobalt | 
  [production] | 
            
  | 19:09 | 
  <thcipriani@deploy1001> | 
  Finished deploy [gerrit/gerrit@cec7995]: Gerrit to 2.15.8 on gerrit2001 only (duration: 00m 11s) | 
  [production] | 
            
  | 19:09 | 
  <thcipriani@deploy1001> | 
  Started deploy [gerrit/gerrit@cec7995]: Gerrit to 2.15.8 on gerrit2001 only | 
  [production] | 
            
  | 19:04 | 
  <thcipriani> | 
  starting gerrit upgrade to 2.15.8 | 
  [production] | 
            
  | 18:55 | 
  <mutante> | 
  upgraded jenkins version for jessie and stretch in apt.wikimedia.org to latest LTS | 
  [production] | 
            
  | 18:16 | 
  <addshore> | 
  deploy slot done | 
  [production] | 
            
  | 18:13 | 
  <addshore@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: ConstraintsCheckJobs enabled on wikidatawiki (1% of edits)  T204031 (duration: 00m 51s) | 
  [production] | 
            
  | 18:07 | 
  <smalyshev@deploy1001> | 
  Finished deploy [wdqs/wdqs@0aa107a]: Re-deploy for fixing vars.sh (duration: 11m 49s) | 
  [production] | 
            
  | 18:03 | 
  <addshore@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: ConstraintsCheckJobs enabled on testwikidatawiki T204031 (duration: 00m 52s) | 
  [production] | 
            
  | 17:55 | 
  <smalyshev@deploy1001> | 
  Started deploy [wdqs/wdqs@0aa107a]: Re-deploy for fixing vars.sh | 
  [production] | 
            
  | 17:53 | 
  <jynus> | 
  stop upgrade and restart db1111 | 
  [production] | 
            
  | 17:36 | 
  <dcausse@deploy1001> | 
  Synchronized wmf-config/CirrusSearch-production.php: [cirrus] Start using replica group settings (take 2) (T210381) (duration: 00m 51s) | 
  [production] | 
            
  | 17:35 | 
  <dcausse@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: [cirrus] Start using replica group settings (take 2) (T210381) (duration: 00m 51s) | 
  [production] | 
            
  | 17:22 | 
  <vgutierrez> | 
  rolling NIC firmware upgrade cp[1077-1080] - T203194 | 
  [production] | 
            
  | 17:18 | 
  <dcausse@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: EditorJourney: Enable data collection for viwiki T213348 (duration: 00m 52s) | 
  [production] | 
            
  | 17:07 | 
  <anomie@deploy1001> | 
  Synchronized php-1.33.0-wmf.12/includes/page/WikiPage.php: Add temporary logging for T210739 (duration: 00m 53s) | 
  [production] | 
            
  | 17:05 | 
  <vgutierrez> | 
  upgrading NIC firmware in cp1076 - T203194 | 
  [production] | 
            
  | 17:01 | 
  <gehel@deploy1001> | 
  Finished deploy [wdqs/wdqs@6685dc0]: multi instance fixes (duration: 00m 27s) | 
  [production] | 
            
  | 17:01 | 
  <gehel@deploy1001> | 
  Started deploy [wdqs/wdqs@6685dc0]: multi instance fixes | 
  [production] | 
            
  | 16:58 | 
  <gehel@deploy1001> | 
  Finished deploy [wdqs/wdqs@6685dc0]: multi instance fixes (duration: 10m 29s) | 
  [production] | 
            
  | 16:53 | 
  <jynus> | 
  stop upgrade and restart db1112 | 
  [production] | 
            
  | 16:47 | 
  <gehel@deploy1001> | 
  Started deploy [wdqs/wdqs@6685dc0]: multi instance fixes | 
  [production] | 
            
  | 16:45 | 
  <jynus@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Repool db1123 (duration: 00m 52s) | 
  [production] | 
            
  | 16:45 | 
  <vgutierrez> | 
  upgrading NIC firmware on cp1075 - T203194 | 
  [production] | 
            
  | 16:08 | 
  <jynus> | 
  upgrade and stop db1123 | 
  [production] | 
            
  | 16:02 | 
  <jbond42> | 
  Import new debdeploy 0.0.99.7 packages for trusty T207845 | 
  [production] | 
            
  | 15:59 | 
  <jbond42> | 
  Import new debdeploy 0.0.99.7 packages for buster T207845 | 
  [production] | 
            
  | 15:59 | 
  <jynus@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Depool db1123 (duration: 00m 52s) | 
  [production] | 
            
  | 15:58 | 
  <otto@deploy1001> | 
  Finished deploy [analytics/superset/deploy@f73b897]: bump to 0.26.3-wikimedia2 with chart format string fix (duration: 00m 36s) | 
  [production] | 
            
  | 15:57 | 
  <otto@deploy1001> | 
  Started deploy [analytics/superset/deploy@f73b897]: bump to 0.26.3-wikimedia2 with chart format string fix | 
  [production] | 
            
  | 15:56 | 
  <jbond42> | 
  Import new debdeploy 0.0.99.7 packages for jessie T207845 | 
  [production] | 
            
  | 15:41 | 
  <jbond42> | 
  "Import new debdeploy 0.0.99.7 packages for stretch T207845 | 
  [production] | 
            
  | 15:35 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Repool db1078 T209815 (duration: 00m 52s) | 
  [production] | 
            
  | 15:12 | 
  <addshore> | 
  addshore@mwmaint1002:~$ mwscript extensions/OATHAuth/maintenance/disableOATHAuthForUser.php --wiki=labswiki Matthias_Geisler // T213928 | 
  [production] | 
            
  | 14:56 | 
  <jynus> | 
  stop upgrade db1125 (this may cause temp. lag on labsdb hosts for s7, s6, s4, s2) | 
  [production] | 
            
  | 14:35 | 
  <otto@deploy1001> | 
  Started deploy [analytics/superset/deploy@UNKNOWN]: attempt to deploy 0.26.3-wikimedia1 | 
  [production] |