| 2019-05-28
      
      § | 
    
  | 22:49 | <jforrester@deploy1001> | Synchronized wmf-config/CommonSettings.php: SWAT Fix order of edit tabs for multi-tabs on SET wikis T223793 (duration: 00m 57s) | [production] | 
            
  | 22:28 | <cstone_> | Re-enabled fundraising thank you mail job | [production] | 
            
  | 22:25 | <mutante> | cp3034 - sudo -i varnish-backend-restart | [production] | 
            
  | 22:18 | <cstone_> | Updated fundraising civicrm from 21afd001b6 to bb4acf3d8a | [production] | 
            
  | 22:14 | <mutante> | cp3035 - varnish-backend-restart | [production] | 
            
  | 22:13 | <bstorm_> | repooled labsdb1010 | [production] | 
            
  | 22:09 | <mutante> | cp3034 - restart varnish backend | [production] | 
            
  | 22:09 | <XioNoX> | restart varnish backend on cp3039 | [production] | 
            
  | 22:02 | <cstone_> | Disabled fundraising thank you mail job | [production] | 
            
  | 21:46 | <bstorm_> | depool labsdb1010 for view updates | [production] | 
            
  | 21:38 | <smalyshev@deploy1001> | Finished deploy [wdqs/wdqs@5a69072]: Deploy GUI & Blazegraph update (duration: 14m 37s) | [production] | 
            
  | 21:35 | <urandom> | decommissioning restbase1015-a -- T223976 | [production] | 
            
  | 21:24 | <smalyshev@deploy1001> | Started deploy [wdqs/wdqs@5a69072]: Deploy GUI & Blazegraph update | [production] | 
            
  | 21:23 | <ebernhardson> | restart elasticsearch on cloudelastic1001 to test sanely sized readahead on /dev/dm-0 | [production] | 
            
  | 21:11 | <gehel@cumin2001> | END (PASS) - Cookbook sre.elasticsearch.rolling-reboot (exit_code=0) | [production] | 
            
  | 20:57 | <mutante> | phab1003 / phab2001 - removing 'apache restart' from root's crontab (gerrit:512977) (T187790) | [production] | 
            
  | 20:28 | <mholloway-shell@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: WikimediaEditorTasks: Update caption edit target counts (duration: 00m 57s) | [production] | 
            
  | 19:17 | <gehel@cumin2001> | START - Cookbook sre.elasticsearch.rolling-reboot | [production] | 
            
  | 19:15 | <marostegui@deploy1001> | Synchronized wmf-config/db-codfw.php: Remove db1064 from config as it will be decommissioned T223217 (duration: 00m 55s) | [production] | 
            
  | 19:14 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Remove db1064 from config as it will be decommissioned T223217 (duration: 00m 56s) | [production] | 
            
  | 19:02 | <marostegui> | Reboot db2091 for full OS and MySQL upgrade - T224393 | [production] | 
            
  | 18:55 | <jforrester@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: Stop setting wgMediaInfoEnableFilePageDepicts, no longer read (duration: 00m 57s) | [production] | 
            
  | 18:51 | <jforrester@deploy1001> | Synchronized wmf-config/Wikibase.php: Add forwards-compatibility for dataCdnMaxAge (duration: 01m 00s) | [production] | 
            
  | 18:11 | <marostegui> | Start mysql for s2 and s4 on db2091 T224393 | [production] | 
            
  | 17:57 | <jbond@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) | [production] | 
            
  | 17:57 | <jbond@cumin1001> | START - Cookbook sre.hosts.downtime | [production] | 
            
  | 17:52 | <jmm@cumin2001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) | [production] | 
            
  | 17:52 | <jmm@cumin2001> | START - Cookbook sre.hosts.downtime | [production] | 
            
  | 17:48 | <jbond@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) | [production] | 
            
  | 17:48 | <jbond@cumin1001> | START - Cookbook sre.hosts.downtime | [production] | 
            
  | 17:42 | <moritzm> | rebooting yubiauth* servers for kernel update | [production] | 
            
  | 17:41 | <jmm@cumin2001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) | [production] | 
            
  | 17:41 | <jmm@cumin2001> | START - Cookbook sre.hosts.downtime | [production] | 
            
  | 17:35 | <mholloway-shell@deploy1001> | Finished deploy [mobileapps/deploy@0735c45]: Update mobileapps to ab67b78 (duration: 05m 56s) | [production] | 
            
  | 17:34 | <jbond@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) | [production] | 
            
  | 17:34 | <jbond@cumin1001> | START - Cookbook sre.hosts.downtime | [production] | 
            
  | 17:29 | <mholloway-shell@deploy1001> | Started deploy [mobileapps/deploy@0735c45]: Update mobileapps to ab67b78 | [production] | 
            
  | 17:26 | <jbond@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) | [production] | 
            
  | 17:26 | <jbond@cumin1001> | START - Cookbook sre.hosts.downtime | [production] | 
            
  | 17:11 | <jbond@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) | [production] | 
            
  | 17:11 | <jbond@cumin1001> | START - Cookbook sre.hosts.downtime | [production] | 
            
  | 17:03 | <jbond@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) | [production] | 
            
  | 17:03 | <jbond@cumin1001> | START - Cookbook sre.hosts.downtime | [production] | 
            
  | 16:57 | <jbond@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) | [production] | 
            
  | 16:57 | <jbond@cumin1001> | START - Cookbook sre.hosts.downtime | [production] | 
            
  | 16:49 | <jbond@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) | [production] | 
            
  | 16:49 | <jbond@cumin1001> | START - Cookbook sre.hosts.downtime | [production] | 
            
  | 16:41 | <jbond@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) | [production] | 
            
  | 16:41 | <jbond@cumin1001> | START - Cookbook sre.hosts.downtime | [production] | 
            
  | 16:35 | <hoo> | Ran scap pull on mw1240 (curl -H 'Host: www.wikidata.org' … mw1240.eqiad.wmnet/wiki/Special:SetEntitySchemaLabelDescriptionAliases/E10/en returned 404) | [production] |