| 2019-04-23
      
      ยง | 
    
  | 22:33 | <XioNoX> | push firewall rule to pfw3-codfw - T221475 | [production] | 
            
  | 21:53 | <reedy@deploy1001> | Synchronized php-1.34.0-wmf.1/extensions/ORES/includes/Specials/SpecialORESModels.php: T221696 (duration: 00m 55s) | [production] | 
            
  | 21:43 | <robh@cumin1001> | END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) | [production] | 
            
  | 21:43 | <robh@cumin1001> | START - Cookbook sre.hosts.decommission | [production] | 
            
  | 21:33 | <thcipriani> | restarting gerrit to pickup config changes | [production] | 
            
  | 20:55 | <smalyshev@deploy1001> | Finished deploy [wdqs/wdqs@51b4728]: Deploy new Updater fix for cnstraints (T221407) (duration: 13m 03s) | [production] | 
            
  | 20:43 | <andrewbogott> | updating designate pools on cloudservices1003 and 1004 using eqiad1_pool_config.yml template from the puppet repo | [production] | 
            
  | 20:42 | <smalyshev@deploy1001> | Started deploy [wdqs/wdqs@51b4728]: Deploy new Updater fix for cnstraints (T221407) | [production] | 
            
  | 20:26 | <urandom> | dropping disused restbase keyspaces -- T221530 | [production] | 
            
  | 19:57 | <robh@cumin1001> | END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) | [production] | 
            
  | 19:57 | <robh@cumin1001> | START - Cookbook sre.hosts.decommission | [production] | 
            
  | 19:32 | <mutante> | webperf* - running puppet to git pull docroot | [production] | 
            
  | 19:11 | <thcipriani> | gerrit restart | [production] | 
            
  | 18:59 | <krinkle@deploy1001> | Synchronized php-1.34.0-wmf.1/extensions/MassMessage: c640195 (duration: 00m 56s) | [production] | 
            
  | 18:09 | <SMalyshev> | depool wdqs1003 to let it catch up | [production] | 
            
  | 18:03 | <robh@cumin1001> | END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) | [production] | 
            
  | 18:03 | <robh@cumin1001> | START - Cookbook sre.hosts.decommission | [production] | 
            
  | 18:03 | <robh@cumin1001> | END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) | [production] | 
            
  | 18:02 | <robh@cumin1001> | START - Cookbook sre.hosts.decommission | [production] | 
            
  | 17:43 | <jijiki> | Restarting memcached on mc1029 - T208844 | [production] | 
            
  | 17:26 | <bsitzmann@deploy1001> | Finished deploy [mobileapps/deploy@78985fb]: Update mobileapps to 6d3a422 (T201382 T217837) (duration: 04m 06s) | [production] | 
            
  | 17:22 | <bsitzmann@deploy1001> | Started deploy [mobileapps/deploy@78985fb]: Update mobileapps to 6d3a422 (T201382 T217837) | [production] | 
            
  | 16:55 | <jijiki> | Depool thumbor2004 for 505759 and pool back - T187765 | [production] | 
            
  | 16:54 | <gehel> | restart wdqs for jvm ugprade | [production] | 
            
  | 16:49 | <jijiki> | Depool thumbor1004 for 505759 and pool back - T187765 | [production] | 
            
  | 16:43 | <jijiki> | Depool thumbor2003 for 505759 and pool back - T187765 | [production] | 
            
  | 16:39 | <jijiki> | Depool thumbor1003 for 505759 and pool back - T187765 | [production] | 
            
  | 16:38 | <otto@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: Enable api-request logging to eventgate-analytics for all wikis - T214080 (duration: 00m 53s) | [production] | 
            
  | 16:33 | <ottomata> | proceeding to enable api-request eventgate-analytics logging for all wikis | [production] | 
            
  | 16:31 | <herron> | added jfishback to wmf ldap group T221660 | [production] | 
            
  | 16:12 | <robh@cumin1001> | END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) | [production] | 
            
  | 16:12 | <robh@cumin1001> | START - Cookbook sre.hosts.decommission | [production] | 
            
  | 16:07 | <reedy@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: set wglocaltimezone for sqwikiquote T221627 (duration: 00m 54s) | [production] | 
            
  | 15:28 | <mlitn@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: SDC: Enable Depicts functionality on Commons (duration: 00m 54s) | [production] | 
            
  | 14:27 | <jijiki> | Depool thumbor2002 for 505759 and pool back - T187765 | [production] | 
            
  | 14:21 | <jijiki> | Depool thumbor1002 for 505759 and pool back - T187765 | [production] | 
            
  | 14:16 | <jijiki> | Depool thumbor2001 for 505759 and pool back - T187765 | [production] | 
            
  | 14:14 | <jijiki> | Depool thumbor1001 for 505759 and pool back - T187765 | [production] | 
            
  | 14:07 | <jijiki> | Disable puppet on thumbor* to merge 505759 | [production] | 
            
  | 13:54 | <ema> | depool cp4021 and reimage as upload_ats T219967 | [production] | 
            
  | 13:17 | <jijiki> | Restart nagios-nrpe-server on prometheus1003 | [production] | 
            
  | 12:15 | <godog> | swift eqiad-prod: fully decom ms-be1013 - T220590 | [production] | 
            
  | 11:59 | <moritzm> | installing clamav security updates on fermium | [production] | 
            
  | 11:56 | <kart_> | EU-Midday SWAT is done. | [production] | 
            
  | 11:54 | <kart_> | 'SWAT: [[gerrit:505059]] deployment-prep: Use new poolcounter instance, [[gerrit:505060]] deployment-prep: Use new ms-fe host.' | [production] | 
            
  | 11:53 | <kartik@deploy1001> | Synchronized wmf-config/LabsServices.php: SWAT: [[gerrit:505643]]   (duration: 00m 53s) | [production] | 
            
  | 11:45 | <jijiki> | Stop xenon-log, excimer-log and apache on mwlog* | [production] | 
            
  | 11:43 | <kartik@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:505643]] Turn off logging for CitationUsage and CitationUsagePageLoad (T213969) (duration: 00m 53s) | [production] | 
            
  | 11:29 | <kartik@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: SWAT: Fix undefined variable from last SWAT (duration: 00m 54s) | [production] | 
            
  | 11:27 | <moritzm> | installing clamav security updates on mendelevium (OTRS host) | [production] |