| 2019-04-23
      
      ยง | 
    
  | 19:57 | <robh@cumin1001> | END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) | [production] | 
            
  | 19:57 | <robh@cumin1001> | START - Cookbook sre.hosts.decommission | [production] | 
            
  | 19:32 | <mutante> | webperf* - running puppet to git pull docroot | [production] | 
            
  | 19:11 | <thcipriani> | gerrit restart | [production] | 
            
  | 18:59 | <krinkle@deploy1001> | Synchronized php-1.34.0-wmf.1/extensions/MassMessage: c640195 (duration: 00m 56s) | [production] | 
            
  | 18:09 | <SMalyshev> | depool wdqs1003 to let it catch up | [production] | 
            
  | 18:03 | <robh@cumin1001> | END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) | [production] | 
            
  | 18:03 | <robh@cumin1001> | START - Cookbook sre.hosts.decommission | [production] | 
            
  | 18:03 | <robh@cumin1001> | END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) | [production] | 
            
  | 18:02 | <robh@cumin1001> | START - Cookbook sre.hosts.decommission | [production] | 
            
  | 17:43 | <jijiki> | Restarting memcached on mc1029 - T208844 | [production] | 
            
  | 17:26 | <bsitzmann@deploy1001> | Finished deploy [mobileapps/deploy@78985fb]: Update mobileapps to 6d3a422 (T201382 T217837) (duration: 04m 06s) | [production] | 
            
  | 17:22 | <bsitzmann@deploy1001> | Started deploy [mobileapps/deploy@78985fb]: Update mobileapps to 6d3a422 (T201382 T217837) | [production] | 
            
  | 16:55 | <jijiki> | Depool thumbor2004 for 505759 and pool back - T187765 | [production] | 
            
  | 16:54 | <gehel> | restart wdqs for jvm ugprade | [production] | 
            
  | 16:49 | <jijiki> | Depool thumbor1004 for 505759 and pool back - T187765 | [production] | 
            
  | 16:43 | <jijiki> | Depool thumbor2003 for 505759 and pool back - T187765 | [production] | 
            
  | 16:39 | <jijiki> | Depool thumbor1003 for 505759 and pool back - T187765 | [production] | 
            
  | 16:38 | <otto@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: Enable api-request logging to eventgate-analytics for all wikis - T214080 (duration: 00m 53s) | [production] | 
            
  | 16:33 | <ottomata> | proceeding to enable api-request eventgate-analytics logging for all wikis | [production] | 
            
  | 16:31 | <herron> | added jfishback to wmf ldap group T221660 | [production] | 
            
  | 16:12 | <robh@cumin1001> | END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) | [production] | 
            
  | 16:12 | <robh@cumin1001> | START - Cookbook sre.hosts.decommission | [production] | 
            
  | 16:07 | <reedy@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: set wglocaltimezone for sqwikiquote T221627 (duration: 00m 54s) | [production] | 
            
  | 15:28 | <mlitn@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: SDC: Enable Depicts functionality on Commons (duration: 00m 54s) | [production] | 
            
  | 14:27 | <jijiki> | Depool thumbor2002 for 505759 and pool back - T187765 | [production] | 
            
  | 14:21 | <jijiki> | Depool thumbor1002 for 505759 and pool back - T187765 | [production] | 
            
  | 14:16 | <jijiki> | Depool thumbor2001 for 505759 and pool back - T187765 | [production] | 
            
  | 14:14 | <jijiki> | Depool thumbor1001 for 505759 and pool back - T187765 | [production] | 
            
  | 14:07 | <jijiki> | Disable puppet on thumbor* to merge 505759 | [production] | 
            
  | 13:54 | <ema> | depool cp4021 and reimage as upload_ats T219967 | [production] | 
            
  | 13:17 | <jijiki> | Restart nagios-nrpe-server on prometheus1003 | [production] | 
            
  | 12:15 | <godog> | swift eqiad-prod: fully decom ms-be1013 - T220590 | [production] | 
            
  | 11:59 | <moritzm> | installing clamav security updates on fermium | [production] | 
            
  | 11:56 | <kart_> | EU-Midday SWAT is done. | [production] | 
            
  | 11:54 | <kart_> | 'SWAT: [[gerrit:505059]] deployment-prep: Use new poolcounter instance, [[gerrit:505060]] deployment-prep: Use new ms-fe host.' | [production] | 
            
  | 11:53 | <kartik@deploy1001> | Synchronized wmf-config/LabsServices.php: SWAT: [[gerrit:505643]]   (duration: 00m 53s) | [production] | 
            
  | 11:45 | <jijiki> | Stop xenon-log, excimer-log and apache on mwlog* | [production] | 
            
  | 11:43 | <kartik@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:505643]] Turn off logging for CitationUsage and CitationUsagePageLoad (T213969) (duration: 00m 53s) | [production] | 
            
  | 11:29 | <kartik@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: SWAT: Fix undefined variable from last SWAT (duration: 00m 54s) | [production] | 
            
  | 11:27 | <moritzm> | installing clamav security updates on mendelevium (OTRS host) | [production] | 
            
  | 11:18 | <kartik@deploy1001> | Synchronized wmf-config: SWAT: [[gerrit:505220]] Use higher unmodified MT threshold for Indonesian Wikipedia (T221353) (duration: 00m 57s) | [production] | 
            
  | 10:44 | <moritzm> | uploaded ferm 2.4-1+wmf2+deb10u1 to buster-wikimedia (T153468) | [production] | 
            
  | 09:23 | <godog> | upgrade prometheus to v2 on bast5001, previous metrics will not be available until migration and backfill are complete - T187987 | [production] | 
            
  | 09:19 | <elukey> | dumping Kafka consumer offsets' history on logstash1012 for T221202 | [production] | 
            
  | 09:00 | <fdans@deploy1001> | Finished deploy [analytics/refinery@0d63671]: deploying changes to pageview definition brought in refinery source 0.0.87 (duration: 14m 09s) | [production] | 
            
  | 08:54 | <fsero> | synchronizing old docker_registry content into new one - T221101 | [production] | 
            
  | 08:46 | <fdans@deploy1001> | Started deploy [analytics/refinery@0d63671]: deploying changes to pageview definition brought in refinery source 0.0.87 | [production] | 
            
  | 08:14 | <moritzm> | removing debmonitor entries for labvirt* hosts | [production] | 
            
  | 08:06 | <moritzm> | installing wget security updates on jessie | [production] |