| 2019-12-19
      
      § | 
    
  | 07:24 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Slowly repool db1076', diff saved to https://phabricator.wikimedia.org/P9948 and previous config saved to /var/cache/conftool/dbconfig/20191219-072413-marostegui.json | [production] | 
            
  | 07:19 | <jiji@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) | [production] | 
            
  | 07:17 | <jiji@cumin1001> | START - Cookbook sre.hosts.downtime | [production] | 
            
  | 07:15 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Depool db1076, s2 candidate master, for upgrade', diff saved to https://phabricator.wikimedia.org/P9947 and previous config saved to /var/cache/conftool/dbconfig/20191219-071514-marostegui.json | [production] | 
            
  | 07:10 | <marostegui> | Upgrade db1115 (this will make dbtree fail for a few minutes) | [production] | 
            
  | 06:51 | <XioNoX> | cr2-eqdfw:delete chassis alarm management-ethernet - T241105 | [production] | 
            
  | 06:49 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Repool pc1008 after upgrade (duration: 01m 02s) | [production] | 
            
  | 06:37 | <marostegui> | Upgrade pc1008 | [production] | 
            
  | 06:36 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool pc1008 for upgrade (duration: 01m 03s) | [production] | 
            
  | 06:15 | <jiji@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) | [production] | 
            
  | 06:13 | <jiji@cumin1001> | START - Cookbook sre.hosts.downtime | [production] | 
            
  | 06:13 | <marostegui> | Upgrade db2122, db2084 | [production] | 
            
  | 05:09 | <jiji@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) | [production] | 
            
  | 05:07 | <jiji@cumin1001> | START - Cookbook sre.hosts.downtime | [production] | 
            
  | 05:02 | <herron@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) | [production] | 
            
  | 05:00 | <herron@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) | [production] | 
            
  | 04:59 | <herron@cumin1001> | START - Cookbook sre.hosts.downtime | [production] | 
            
  | 04:58 | <herron@cumin1001> | START - Cookbook sre.hosts.downtime | [production] | 
            
  | 04:29 | <kart_> | Update cxserver to 2019-12-11-144337-production (T233405, T238118) | [production] | 
            
  | 04:25 | <kartik@deploy1001> | helmfile [EQIAD] Ran 'apply' command on namespace 'cxserver' for release 'production' . | [production] | 
            
  | 04:21 | <kartik@deploy1001> | helmfile [CODFW] Ran 'apply' command on namespace 'cxserver' for release 'production' . | [production] | 
            
  | 04:19 | <kartik@deploy1001> | helmfile [STAGING] Ran 'apply' command on namespace 'cxserver' for release 'staging' . | [production] | 
            
  | 04:12 | <herron@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) | [production] | 
            
  | 04:10 | <herron@cumin1001> | START - Cookbook sre.hosts.downtime | [production] | 
            
  | 04:03 | <mutante> | LDAP - added mstyles to archiva-deployers (T240865) | [production] | 
            
  | 03:48 | <volker-e@deploy1001> | Finished deploy [design/style-guide@5cecb37]: Deploy design/style-guide:  (duration: 00m 07s) | [production] | 
            
  | 03:48 | <volker-e@deploy1001> | Started deploy [design/style-guide@5cecb37]: Deploy design/style-guide: | [production] | 
            
  | 01:58 | <eileen> | - civicrm revision changed from 93037d6e35 to 6062da3ab5, config revision is 2e9bf6308b mostly eoy_summary stuff | [production] | 
            
  | 01:57 | <twentyafterfour> | phabricator update completed | [production] | 
            
  | 01:44 | <twentyafterfour> | deploying phabricator update (tagged release/2019-12-19/1) | [production] | 
            
  | 00:36 | <twentyafterfour@deploy1001> | Synchronized php-1.35.0-wmf.11/skins/MinervaNeue/resources/skins.minerva.scripts/menu/MainMenu.js: sync https://gerrit.wikimedia.org/r/c/mediawiki/skins/MinervaNeue/+/559226 for SWAT (duration: 01m 02s) | [production] | 
            
  
    | 2019-12-18
      
      § | 
    
  | 23:44 | <krinkle@deploy1001> | Synchronized php-1.35.0-wmf.11/includes/libs/objectcache/MemcachedPeclBagOStuff.php: Iacbc9ebda681 (duration: 01m 01s) | [production] | 
            
  | 23:27 | <krinkle@deploy1001> | Synchronized php-1.35.0-wmf.11/includes/resourceloader/ResourceLoaderFileModule.php: I3fe9f0a9ddc (duration: 01m 02s) | [production] | 
            
  | 23:17 | <krinkle@deploy1001> | Synchronized wmf-config/CommonSettings.php: If465c0ef cleanup (duration: 01m 01s) | [production] | 
            
  | 21:33 | <mholloway-shell@deploy1001> | Finished deploy [mobileapps/deploy@9dd8227]: Update mobileapps to cf2bb3b (duration: 05m 51s) | [production] | 
            
  | 21:27 | <mholloway-shell@deploy1001> | Started deploy [mobileapps/deploy@9dd8227]: Update mobileapps to cf2bb3b | [production] | 
            
  | 21:22 | <halfak@deploy1001> | Finished deploy [ores/deploy@80b1e62]: T240725 (duration: 22m 05s) | [production] | 
            
  | 21:01 | <ppchelko@deploy1001> | Finished deploy [cpjobqueue/deploy@7e68510]: Return low_traffic_jobs concurrency to normal after T240518 (duration: 01m 03s) | [production] | 
            
  | 21:00 | <halfak@deploy1001> | Started deploy [ores/deploy@80b1e62]: T240725 | [production] | 
            
  | 21:00 | <ppchelko@deploy1001> | Started deploy [cpjobqueue/deploy@7e68510]: Return low_traffic_jobs concurrency to normal after T240518 | [production] | 
            
  | 20:50 | <ppchelko@deploy1001> | Finished deploy [restbase/deploy@6e24349]: Disable all parsoid-php vs parsoid-js special cases T229015 (duration: 13m 56s) | [production] | 
            
  | 20:36 | <ppchelko@deploy1001> | Started deploy [restbase/deploy@6e24349]: Disable all parsoid-php vs parsoid-js special cases T229015 | [production] | 
            
  | 20:04 | <niharika29@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: Enable banner on Special:Block for selected wikis - T240300 (duration: 01m 01s) | [production] | 
            
  | 19:59 | <niharika29@deploy1001> | Synchronized php-1.35.0-wmf.11/extensions/WikimediaMessages/includes/WikimediaMessagesHooks.php: Remove messagebox class from partial block banner - T240300 (duration: 01m 02s) | [production] | 
            
  | 19:47 | <ebernhardson@deploy1001> | Finished deploy [wikimedia/discovery/analytics@4b174fd]: glent: Explicitly pass previous partition to m2run (duration: 00m 10s) | [production] | 
            
  | 19:47 | <ebernhardson@deploy1001> | Started deploy [wikimedia/discovery/analytics@4b174fd]: glent: Explicitly pass previous partition to m2run | [production] | 
            
  | 19:27 | <niharika29@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: Bump Parsoid/PHP cluster memory_limit - T239806, T236833 (duration: 01m 01s) | [production] | 
            
  | 18:58 | <otto@deploy1001> | helmfile [EQIAD] Ran 'apply' command on namespace 'eventgate-main' for release 'main' . | [production] | 
            
  | 18:56 | <otto@deploy1001> | helmfile [CODFW] Ran 'apply' command on namespace 'eventgate-main' for release 'main' . | [production] | 
            
  | 18:51 | <ebernhardson@deploy1001> | Finished deploy [wikimedia/discovery/analytics@20e4c16]: Update glent to spark 2.4.4 (duration: 00m 29s) | [production] |