| 
      
        2021-03-23
      
      ยง
     | 
  
    
  | 20:03 | 
  <robh@cumin1001> | 
  START - Cookbook sre.hosts.decommission for hosts auth1002.eqiad.wmnet | 
  [production] | 
            
  | 20:02 | 
  <robh@cumin1001> | 
  END (FAIL) - Cookbook sre.hosts.decommission (exit_code=99) for hosts auth1002.eqiad.wmnet | 
  [production] | 
            
  | 20:01 | 
  <robh@cumin1001> | 
  START - Cookbook sre.hosts.decommission for hosts auth1002.eqiad.wmnet | 
  [production] | 
            
  | 19:51 | 
  <jforrester@deploy1002> | 
  Finished deploy [integration/docroot@9de8c9d]: Add homer-public listing, added by volans (duration: 00m 08s) | 
  [production] | 
            
  | 19:51 | 
  <jforrester@deploy1002> | 
  Started deploy [integration/docroot@9de8c9d]: Add homer-public listing, added by volans | 
  [production] | 
            
  | 18:45 | 
  <otto@deploy1002> | 
  Synchronized wmf-config/InitialiseSettings.php: Remove schema overrides for 6 finished EL migrations - T267347 T271164 T267351 T267348 T267343 T267353 (duration: 01m 07s) | 
  [production] | 
            
  | 18:40 | 
  <legoktm@deploy1002> | 
  Synchronized php-1.36.0-wmf.36/vendor/: Bump wikimedia/parsoid to 0.13.0-a29 (duration: 01m 16s) | 
  [production] | 
            
  | 18:20 | 
  <mbsantos@deploy1002> | 
  helmfile [eqiad] Ran 'sync' command on namespace 'mobileapps' for release 'production' . | 
  [production] | 
            
  | 18:18 | 
  <mbsantos@deploy1002> | 
  helmfile [codfw] Ran 'sync' command on namespace 'mobileapps' for release 'production' . | 
  [production] | 
            
  | 18:16 | 
  <mbsantos@deploy1002> | 
  helmfile [staging] Ran 'sync' command on namespace 'mobileapps' for release 'staging' . | 
  [production] | 
            
  | 18:10 | 
  <legoktm@deploy1002> | 
  Synchronized wmf-config/ProductionServices.php: Add irc2001.wikimedia.org (running buster) as second irc server (T224579) (duration: 01m 08s) | 
  [production] | 
            
  | 15:39 | 
  <akosiaris@deploy1002> | 
  helmfile [staging] Ran 'sync' command on namespace 'cxserver' for release 'staging' . | 
  [production] | 
            
  | 15:39 | 
  <akosiaris@deploy1002> | 
  helmfile [staging] Ran 'sync' command on namespace 'cxserver' for release 'production' . | 
  [production] | 
            
  | 15:38 | 
  <akosiaris@deploy1002> | 
  helmfile [codfw] Ran 'sync' command on namespace 'cxserver' for release 'production' . | 
  [production] | 
            
  | 15:38 | 
  <akosiaris@deploy1002> | 
  helmfile [codfw] Ran 'sync' command on namespace 'cxserver' for release 'staging' . | 
  [production] | 
            
  | 15:36 | 
  <akosiaris@deploy1002> | 
  helmfile [eqiad] Ran 'sync' command on namespace 'cxserver' for release 'staging' . | 
  [production] | 
            
  | 15:36 | 
  <akosiaris@deploy1002> | 
  helmfile [eqiad] Ran 'sync' command on namespace 'cxserver' for release 'production' . | 
  [production] | 
            
  | 15:32 | 
  <moritzm> | 
  installing libsdl2 security updates | 
  [production] | 
            
  | 15:31 | 
  <akosiaris> | 
  pool echostore for eqiad (the first of the larger services traffic wise) | 
  [production] | 
            
  | 15:31 | 
  <akosiaris@cumin1001> | 
  conftool action : set/pooled=true; selector: name=eqiad,dnsdisc=echostore | 
  [production] | 
            
  | 15:25 | 
  <Trey314159> | 
  reindexing Italian wikis on elastic@eqiad, elastic@codfw, and cloudelastic complete (T274200) | 
  [production] | 
            
  | 15:10 | 
  <akosiaris@deploy1002> | 
  helmfile [codfw] Ran 'sync' command on namespace 'linkrecommendation' for release 'production' . | 
  [production] | 
            
  | 15:10 | 
  <akosiaris@deploy1002> | 
  helmfile [codfw] Ran 'sync' command on namespace 'linkrecommendation' for release 'staging' . | 
  [production] | 
            
  | 15:10 | 
  <akosiaris@deploy1002> | 
  helmfile [codfw] Ran 'sync' command on namespace 'linkrecommendation' for release 'external' . | 
  [production] | 
            
  | 14:53 | 
  <akosiaris@deploy1002> | 
  helmfile [eqiad] Ran 'sync' command on namespace 'linkrecommendation' for release 'staging' . | 
  [production] | 
            
  | 14:53 | 
  <akosiaris@deploy1002> | 
  helmfile [eqiad] Ran 'sync' command on namespace 'linkrecommendation' for release 'external' . | 
  [production] | 
            
  | 14:53 | 
  <akosiaris@deploy1002> | 
  helmfile [eqiad] Ran 'sync' command on namespace 'linkrecommendation' for release 'production' . | 
  [production] | 
            
  | 14:46 | 
  <akosiaris@deploy1002> | 
  helmfile [staging] Ran 'sync' command on namespace 'linkrecommendation' for release 'production' . | 
  [production] | 
            
  | 14:46 | 
  <akosiaris@deploy1002> | 
  helmfile [staging] Ran 'sync' command on namespace 'linkrecommendation' for release 'staging' . | 
  [production] | 
            
  | 14:46 | 
  <akosiaris@deploy1002> | 
  helmfile [staging] Ran 'sync' command on namespace 'linkrecommendation' for release 'external' . | 
  [production] | 
            
  | 14:43 | 
  <akosiaris> | 
  pool more services in eqiad k8s. T277741. Only the very large ones traffic wise are still on codfw | 
  [production] | 
            
  | 14:43 | 
  <akosiaris@cumin1001> | 
  conftool action : set/pooled=true; selector: name=eqiad,dnsdisc=recommendation-api | 
  [production] | 
            
  | 14:43 | 
  <akosiaris@cumin1001> | 
  conftool action : set/pooled=true; selector: name=eqiad,dnsdisc=push-notifications | 
  [production] | 
            
  | 14:43 | 
  <akosiaris@cumin1001> | 
  conftool action : set/pooled=true; selector: name=eqiad,dnsdisc=proton | 
  [production] | 
            
  | 14:42 | 
  <akosiaris@cumin1001> | 
  conftool action : set/pooled=true; selector: name=eqiad,dnsdisc=mobileapps | 
  [production] | 
            
  | 14:42 | 
  <akosiaris@cumin1001> | 
  conftool action : set/pooled=true; selector: name=eqiad,dnsdisc=mathoid | 
  [production] | 
            
  | 14:42 | 
  <akosiaris@cumin1001> | 
  conftool action : set/pooled=true; selector: name=eqiad,dnsdisc=linkrecommendation | 
  [production] | 
            
  | 14:42 | 
  <akosiaris@cumin1001> | 
  conftool action : set/pooled=true; selector: name=eqiad,dnsdisc=eventstreams-internal | 
  [production] | 
            
  | 14:42 | 
  <akosiaris@cumin1001> | 
  conftool action : set/pooled=true; selector: name=eqiad,dnsdisc=eventstreams | 
  [production] | 
            
  | 14:20 | 
  <akosiaris> | 
  pool a few more services in eqiad k8s. T277741 | 
  [production] | 
            
  | 14:19 | 
  <akosiaris@cumin1001> | 
  conftool action : set/pooled=true; selector: name=eqiad,dnsdisc=wikifeeds | 
  [production] | 
            
  | 14:19 | 
  <akosiaris@cumin1001> | 
  conftool action : set/pooled=true; selector: name=eqiad,dnsdisc=termbox | 
  [production] | 
            
  | 14:19 | 
  <akosiaris@cumin1001> | 
  conftool action : set/pooled=true; selector: name=eqiad,dnsdisc=similar-users | 
  [production] | 
            
  | 14:07 | 
  <hashar@deploy1002> | 
  rebuilt and synchronized wikiversions files: group0 wikis to 1.36.0-wmf.36 | 
  [production] | 
            
  | 14:06 | 
  <akosiaris> | 
  pool a few services in eqiad k8s. T277741 | 
  [production] | 
            
  | 14:05 | 
  <akosiaris@cumin1001> | 
  conftool action : set/pooled=true; selector: name=eqiad,dnsdisc=cxserver | 
  [production] | 
            
  | 14:05 | 
  <akosiaris@cumin1001> | 
  conftool action : set/pooled=true; selector: name=eqiad,dnsdisc=citoid | 
  [production] | 
            
  | 14:05 | 
  <akosiaris@cumin1001> | 
  conftool action : set/pooled=true; selector: name=eqiad,dnsdisc=blubberoid | 
  [production] | 
            
  | 14:05 | 
  <akosiaris@cumin1001> | 
  conftool action : set/pooled=true; selector: name=eqiad,dnsdisc=api-gateway | 
  [production] | 
            
  | 14:05 | 
  <akosiaris@cumin1001> | 
  conftool action : set/pooled=true; selector: name=eqiad,dnsdisc=apertium | 
  [production] |