| 2019-03-13
      
      ยง | 
    
  | 23:48 | <catrope@deploy1001> | Synchronized php-1.33.0-wmf.21/skins/MinervaNeue/: Remove unnecessary parameter from getHistoryPageAction (duration: 00m 56s) | [production] | 
            
  | 23:45 | <catrope@deploy1001> | Synchronized wmf-config/WikibaseSearchSettings.php: Fix builder class definition for WBCS (duration: 00m 56s) | [production] | 
            
  | 23:41 | <catrope@deploy1001> | Synchronized php-1.33.0-wmf.21/extensions/MobileFrontend/: Fix animation when visual section editing enabled on mobile only (T218167) (duration: 00m 58s) | [production] | 
            
  | 23:39 | <catrope@deploy1001> | Synchronized php-1.33.0-wmf.21/extensions/WikibaseCirrusSearch/: Fix hook return values (duration: 00m 58s) | [production] | 
            
  | 23:30 | <catrope@deploy1001> | Synchronized php-1.33.0-wmf.21/extensions/GrowthExperiments/: Instrumentation fixes (T217802) (duration: 00m 57s) | [production] | 
            
  | 22:00 | <otto@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: Disabling api-request logging to eventgate-analytics for group0 wikis until we solve T218268 (duration: 00m 56s) | [production] | 
            
  | 21:11 | <otto@deploy1001> | scap-helm eventgate-analytics finished | [production] | 
            
  | 21:11 | <otto@deploy1001> | scap-helm eventgate-analytics cluster eqiad completed | [production] | 
            
  | 21:11 | <otto@deploy1001> | scap-helm eventgate-analytics upgrade production -f eventgate-analytics-eqiad-values.yaml stable/eventgate-analytics [namespace: eventgate-analytics, clusters: eqiad] | [production] | 
            
  | 21:10 | <otto@deploy1001> | scap-helm eventgate-analytics finished | [production] | 
            
  | 21:10 | <otto@deploy1001> | scap-helm eventgate-analytics cluster codfw completed | [production] | 
            
  | 21:09 | <otto@deploy1001> | scap-helm eventgate-analytics upgrade production -f eventgate-analytics-codfw-values.yaml stable/eventgate-analytics [namespace: eventgate-analytics, clusters: codfw] | [production] | 
            
  | 20:58 | <otto@deploy1001> | scap-helm eventgate-analytics finished | [production] | 
            
  | 20:58 | <otto@deploy1001> | scap-helm eventgate-analytics cluster staging completed | [production] | 
            
  | 20:58 | <otto@deploy1001> | scap-helm eventgate-analytics upgrade staging -f eventgate-analytics-staging-values.yaml stable/eventgate-analytics [namespace: eventgate-analytics, clusters: staging] | [production] | 
            
  | 20:58 | <otto@deploy1001> | scap-helm eventgate-analytics install -n staging -f eventgate-analytics-staging-values.yaml stable/eventgate-analytics [namespace: eventgate-analytics, clusters: staging] | [production] | 
            
  | 20:58 | <otto@deploy1001> | scap-helm eventgate-analytics install -n staging -f eventgate-analytics-staging-values.yaml stable/eventgate-analytics [namespace: eventgate-analytics, clusters: eqiad,codfw] | [production] | 
            
  | 20:35 | <arlolra@deploy1001> | Finished deploy [parsoid/deploy@e2e44bc]: Updating Parsoid to ea80d1b (duration: 06m 38s) | [production] | 
            
  | 20:28 | <arlolra@deploy1001> | Started deploy [parsoid/deploy@e2e44bc]: Updating Parsoid to ea80d1b | [production] | 
            
  | 20:25 | <bsitzmann@deploy1001> | Finished deploy [mobileapps/deploy@5f8e4e6]: Update mobileapps to 5865552 (7074964 d6dc3cd fbc6262) (duration: 03m 35s) | [production] | 
            
  | 20:24 | <otto@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: Disabling api-request logging to eventgate-analytics for group1 wikis to investigate possible outage (duration: 00m 56s) | [production] | 
            
  | 20:21 | <bsitzmann@deploy1001> | Started deploy [mobileapps/deploy@5f8e4e6]: Update mobileapps to 5865552 (7074964 d6dc3cd fbc6262) | [production] | 
            
  | 20:14 | <bsitzmann@deploy1001> | Finished deploy [mobileapps/deploy@5f8e4e6]: Update mobileapps to 5865552 (7074964 d6dc3cd fbc6262) (duration: 01m 49s) | [production] | 
            
  | 20:03 | <herron> | increased index.mapping.total_fields.limit to 1350 on index logstash-2019.03.13 | [production] | 
            
  | 19:46 | <jijiki> | Pooling mw2206 - T215415 | [production] | 
            
  | 19:26 | <herron> | performing rolling restart of eqiad logstash instances | [production] | 
            
  | 18:51 | <jijiki> | Depool mw1280  and mw2206 to hardware issues - T215415 T218006 | [production] | 
            
  | 18:44 | <otto@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: Enabling api-request logging to eventgate-analytics for group1 wikis (duration: 00m 58s) | [production] | 
            
  | 18:30 | <robh> | thumbor1004 memtest in progress via T215411 | [production] | 
            
  | 18:29 | <ema@puppetmaster1001> | conftool action : set/pooled=no; selector: name=cp2002.codfw.wmnet,service=varnish-fe | [production] | 
            
  | 18:29 | <ema@puppetmaster1001> | conftool action : set/pooled=no; selector: name=cp2002.codfw.wmnet,service=nginx | [production] | 
            
  | 18:28 | <ema> | cp2002: depool varnish-fe after 1 hour ATS experiment T213263 | [production] | 
            
  | 18:09 | <bstorm_> | rebooting labstore1006 T217473 | [production] | 
            
  | 18:07 | <bstorm_> | downtime labstore1006 for troubleshooting T217473 | [production] | 
            
  | 17:57 | <XioNoX> | set interface description on fasw-c-codfw:ge-0/0/47 | [production] | 
            
  | 17:43 | <XioNoX> | s/29073/202425/ on AMS-IX | [production] | 
            
  | 17:34 | <XioNoX> | add missing sandbox1-b-eqiad interface to ospf(3) passive on cr1/2-eqiad | [production] | 
            
  | 17:19 | <ema@puppetmaster1001> | conftool action : set/pooled=yes; selector: name=cp2002.codfw.wmnet,service=varnish-fe | [production] | 
            
  | 17:19 | <ema@puppetmaster1001> | conftool action : set/pooled=yes; selector: name=cp2002.codfw.wmnet,service=nginx | [production] | 
            
  | 17:18 | <ema> | cp2002: pool varnish-fe for user traffic, routed through ATS backends T213263 | [production] | 
            
  | 17:05 | <otto@deploy1001> | scap-helm eventgate-analytics finished | [production] | 
            
  | 17:05 | <otto@deploy1001> | scap-helm eventgate-analytics cluster eqiad completed | [production] | 
            
  | 17:05 | <otto@deploy1001> | scap-helm eventgate-analytics upgrade production -f eventgate-analytics-eqiad-values.yaml stable/eventgate-analytics [namespace: eventgate-analytics, clusters: eqiad] | [production] | 
            
  | 17:01 | <otto@deploy1001> | scap-helm eventgate-analytics finished | [production] | 
            
  | 17:01 | <otto@deploy1001> | scap-helm eventgate-analytics cluster codfw completed | [production] | 
            
  | 17:01 | <otto@deploy1001> | scap-helm eventgate-analytics upgrade production -f eventgate-analytics-codfw-values.yaml stable/eventgate-analytics [namespace: eventgate-analytics, clusters: codfw] | [production] | 
            
  | 16:59 | <otto@deploy1001> | scap-helm eventgate-analytics finished | [production] | 
            
  | 16:58 | <otto@deploy1001> | scap-helm eventgate-analytics cluster staging completed | [production] | 
            
  | 16:58 | <otto@deploy1001> | scap-helm eventgate-analytics upgrade staging -f eventgate-analytics-staging-values.yaml stable/eventgate-analytics [namespace: eventgate-analytics, clusters: staging] | [production] | 
            
  | 16:56 | <robh> | mw2206.codfw.wmnet is being powered down for firmware update, relying on auto depool function from clean shutdown for mw api server via T215415 | [production] |