| 2019-04-23
      
      § | 
    
  | 17:26 | <bsitzmann@deploy1001> | Finished deploy [mobileapps/deploy@78985fb]: Update mobileapps to 6d3a422 (T201382 T217837) (duration: 04m 06s) | [production] | 
            
  | 17:22 | <bsitzmann@deploy1001> | Started deploy [mobileapps/deploy@78985fb]: Update mobileapps to 6d3a422 (T201382 T217837) | [production] | 
            
  | 16:55 | <jijiki> | Depool thumbor2004 for 505759 and pool back - T187765 | [production] | 
            
  | 16:54 | <gehel> | restart wdqs for jvm ugprade | [production] | 
            
  | 16:49 | <jijiki> | Depool thumbor1004 for 505759 and pool back - T187765 | [production] | 
            
  | 16:43 | <jijiki> | Depool thumbor2003 for 505759 and pool back - T187765 | [production] | 
            
  | 16:39 | <jijiki> | Depool thumbor1003 for 505759 and pool back - T187765 | [production] | 
            
  | 16:38 | <otto@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: Enable api-request logging to eventgate-analytics for all wikis - T214080 (duration: 00m 53s) | [production] | 
            
  | 16:33 | <ottomata> | proceeding to enable api-request eventgate-analytics logging for all wikis | [production] | 
            
  | 16:31 | <herron> | added jfishback to wmf ldap group T221660 | [production] | 
            
  | 16:12 | <robh@cumin1001> | END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) | [production] | 
            
  | 16:12 | <robh@cumin1001> | START - Cookbook sre.hosts.decommission | [production] | 
            
  | 16:07 | <reedy@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: set wglocaltimezone for sqwikiquote T221627 (duration: 00m 54s) | [production] | 
            
  | 15:28 | <mlitn@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: SDC: Enable Depicts functionality on Commons (duration: 00m 54s) | [production] | 
            
  | 14:27 | <jijiki> | Depool thumbor2002 for 505759 and pool back - T187765 | [production] | 
            
  | 14:21 | <jijiki> | Depool thumbor1002 for 505759 and pool back - T187765 | [production] | 
            
  | 14:16 | <jijiki> | Depool thumbor2001 for 505759 and pool back - T187765 | [production] | 
            
  | 14:14 | <jijiki> | Depool thumbor1001 for 505759 and pool back - T187765 | [production] | 
            
  | 14:07 | <jijiki> | Disable puppet on thumbor* to merge 505759 | [production] | 
            
  | 13:54 | <ema> | depool cp4021 and reimage as upload_ats T219967 | [production] | 
            
  | 13:17 | <jijiki> | Restart nagios-nrpe-server on prometheus1003 | [production] | 
            
  | 12:15 | <godog> | swift eqiad-prod: fully decom ms-be1013 - T220590 | [production] | 
            
  | 11:59 | <moritzm> | installing clamav security updates on fermium | [production] | 
            
  | 11:56 | <kart_> | EU-Midday SWAT is done. | [production] | 
            
  | 11:54 | <kart_> | 'SWAT: [[gerrit:505059]] deployment-prep: Use new poolcounter instance, [[gerrit:505060]] deployment-prep: Use new ms-fe host.' | [production] | 
            
  | 11:53 | <kartik@deploy1001> | Synchronized wmf-config/LabsServices.php: SWAT: [[gerrit:505643]]   (duration: 00m 53s) | [production] | 
            
  | 11:45 | <jijiki> | Stop xenon-log, excimer-log and apache on mwlog* | [production] | 
            
  | 11:43 | <kartik@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:505643]] Turn off logging for CitationUsage and CitationUsagePageLoad (T213969) (duration: 00m 53s) | [production] | 
            
  | 11:29 | <kartik@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: SWAT: Fix undefined variable from last SWAT (duration: 00m 54s) | [production] | 
            
  | 11:27 | <moritzm> | installing clamav security updates on mendelevium (OTRS host) | [production] | 
            
  | 11:18 | <kartik@deploy1001> | Synchronized wmf-config: SWAT: [[gerrit:505220]] Use higher unmodified MT threshold for Indonesian Wikipedia (T221353) (duration: 00m 57s) | [production] | 
            
  | 10:44 | <moritzm> | uploaded ferm 2.4-1+wmf2+deb10u1 to buster-wikimedia (T153468) | [production] | 
            
  | 09:23 | <godog> | upgrade prometheus to v2 on bast5001, previous metrics will not be available until migration and backfill are complete - T187987 | [production] | 
            
  | 09:19 | <elukey> | dumping Kafka consumer offsets' history on logstash1012 for T221202 | [production] | 
            
  | 09:00 | <fdans@deploy1001> | Finished deploy [analytics/refinery@0d63671]: deploying changes to pageview definition brought in refinery source 0.0.87 (duration: 14m 09s) | [production] | 
            
  | 08:54 | <fsero> | synchronizing old docker_registry content into new one - T221101 | [production] | 
            
  | 08:46 | <fdans@deploy1001> | Started deploy [analytics/refinery@0d63671]: deploying changes to pageview definition brought in refinery source 0.0.87 | [production] | 
            
  | 08:14 | <moritzm> | removing debmonitor entries for labvirt* hosts | [production] | 
            
  | 08:06 | <moritzm> | installing wget security updates on jessie | [production] | 
            
  | 07:27 | <gilles@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: T216499 Set wgPriorityHintsRatio (duration: 00m 52s) | [production] | 
            
  | 06:20 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Repool all slaves in x1 T136427 (duration: 00m 57s) | [production] | 
            
  | 05:52 | <elukey> | powercycle wtp2019 - no ssh, mgmt console stuck | [production] | 
            
  | 05:16 | <marostegui> | Deploy schema change on x1 master - lag will appear on x1 slaves - T136427 | [production] | 
            
  | 05:16 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool all slaves in x1 T136427 (duration: 00m 54s) | [production] |