| 2021-01-27
      
      ยง | 
    
  | 18:49 | <dzahn@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1263.eqiad.wmnet with reason: REIMAGE | [production] | 
            
  | 18:47 | <dzahn@cumin1001> | START - Cookbook sre.hosts.downtime for 2:00:00 on mw1263.eqiad.wmnet with reason: REIMAGE | [production] | 
            
  | 18:45 | <dzahn@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw2219.codfw.wmnet with reason: REIMAGE | [production] | 
            
  | 18:43 | <dzahn@cumin1001> | START - Cookbook sre.hosts.downtime for 2:00:00 on mw2219.codfw.wmnet with reason: REIMAGE | [production] | 
            
  | 18:42 | <dzahn@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw2218.codfw.wmnet with reason: REIMAGE | [production] | 
            
  | 18:40 | <dzahn@cumin1001> | START - Cookbook sre.hosts.downtime for 2:00:00 on mw2218.codfw.wmnet with reason: REIMAGE | [production] | 
            
  | 18:39 | <dzahn@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw2217.codfw.wmnet with reason: REIMAGE | [production] | 
            
  | 18:37 | <dzahn@cumin1001> | START - Cookbook sre.hosts.downtime for 2:00:00 on mw2217.codfw.wmnet with reason: REIMAGE | [production] | 
            
  | 18:30 | <Tchanders> | Creating the table securepoll_log in votewiki and testwiki (T271270) | [production] | 
            
  | 18:25 | <hashar@deploy1001> | Finished deploy [integration/docroot@da43ad4]: Add Shellbox to doc.wm.o , misc build related changes fdf0917..da43ad4 (duration: 00m 07s) | [production] | 
            
  | 18:25 | <hashar@deploy1001> | Started deploy [integration/docroot@da43ad4]: Add Shellbox to doc.wm.o , misc build related changes fdf0917..da43ad4 | [production] | 
            
  | 18:25 | <hashar@deploy1001> | Finished deploy [integration/docroot@da43ad4]: Add Shellbox to doc.wm.o , misc build related changes fdf0917..da43ad4 (duration: 00m 10s) | [production] | 
            
  | 18:25 | <hashar@deploy1001> | Started deploy [integration/docroot@da43ad4]: Add Shellbox to doc.wm.o , misc build related changes fdf0917..da43ad4 | [production] | 
            
  | 18:23 | <dzahn@cumin1001> | conftool action : set/pooled=yes; selector: name=mw1268.eqiad.wmnet | [production] | 
            
  | 18:21 | <dzahn@cumin1001> | conftool action : set/pooled=no; selector: name=mw1268.eqiad.wmnet | [production] | 
            
  | 18:15 | <dpifke@deploy1001> | Finished deploy [performance/arc-lamp@e24f319]: Re-deploying ArcLamp to webperf1002 (duration: 00m 05s) | [production] | 
            
  | 18:15 | <dpifke@deploy1001> | Started deploy [performance/arc-lamp@e24f319]: Re-deploying ArcLamp to webperf1002 | [production] | 
            
  | 18:13 | <dzahn@cumin1001> | conftool action : set/pooled=yes; selector: name=mw2301.codfw.wmnet | [production] | 
            
  | 18:10 | <dzahn@cumin1001> | conftool action : set/pooled=yes; selector: name=mw1406.eqiad.wmnet | [production] | 
            
  | 18:07 | <dzahn@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw2216.codfw.wmnet with reason: REIMAGE | [production] | 
            
  | 18:06 | <dzahn@cumin1001> | conftool action : set/pooled=yes; selector: name=mw1407.eqiad.wmnet | [production] | 
            
  | 18:05 | <dzahn@cumin1001> | START - Cookbook sre.hosts.downtime for 2:00:00 on mw2216.codfw.wmnet with reason: REIMAGE | [production] | 
            
  | 18:04 | <dzahn@cumin1001> | conftool action : set/pooled=no; selector: name=mw1407.eqiad.wmnet | [production] | 
            
  | 18:03 | <dzahn@cumin1001> | conftool action : set/pooled=no; selector: name=mw2301.codfw.wmnet | [production] | 
            
  | 18:03 | <dzahn@cumin1001> | conftool action : set/pooled=no; selector: name=mw1406.eqiad.wmnet | [production] | 
            
  | 17:50 | <dzahn@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw2215.codfw.wmnet with reason: REIMAGE | [production] | 
            
  | 17:48 | <dzahn@cumin1001> | START - Cookbook sre.hosts.downtime for 2:00:00 on mw2215.codfw.wmnet with reason: REIMAGE | [production] | 
            
  | 17:34 | <dzahn@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw2301.codfw.wmnet with reason: REIMAGE | [production] | 
            
  | 17:32 | <dzahn@cumin1001> | START - Cookbook sre.hosts.downtime for 2:00:00 on mw2301.codfw.wmnet with reason: REIMAGE | [production] | 
            
  | 17:32 | <dzahn@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1406.eqiad.wmnet with reason: REIMAGE | [production] | 
            
  | 17:30 | <dzahn@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1407.eqiad.wmnet with reason: REIMAGE | [production] | 
            
  | 17:29 | <dzahn@cumin1001> | START - Cookbook sre.hosts.downtime for 2:00:00 on mw1406.eqiad.wmnet with reason: REIMAGE | [production] | 
            
  | 17:28 | <dzahn@cumin1001> | START - Cookbook sre.hosts.downtime for 2:00:00 on mw1407.eqiad.wmnet with reason: REIMAGE | [production] | 
            
  | 17:27 | <dzahn@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1268.eqiad.wmnet with reason: REIMAGE | [production] | 
            
  | 17:25 | <dzahn@cumin1001> | START - Cookbook sre.hosts.downtime for 2:00:00 on mw1268.eqiad.wmnet with reason: REIMAGE | [production] | 
            
  | 16:54 | <elukey@deploy1001> | helmfile [eqiad] Ran 'sync' command on namespace 'eventstreams-internal' for release 'main' . | [production] | 
            
  | 16:40 | <elukey@deploy1001> | helmfile [codfw] Ran 'sync' command on namespace 'eventstreams-internal' for release 'main' . | [production] | 
            
  | 16:38 | <jayme@deploy1001> | helmfile [eqiad] Ran 'sync' command on namespace 'kube-system' for release 'rbac-deploy-clusterrole' . | [production] | 
            
  | 16:21 | <jayme@deploy1001> | helmfile [codfw] Ran 'sync' command on namespace 'kube-system' for release 'rbac-deploy-clusterrole' . | [production] | 
            
  | 16:18 | <moritzm> | installing python-bottle security updates | [production] | 
            
  | 15:42 | <elukey> | umount /var/hadoop/data/r on an-worker1099 and restart hadoop daemons - T273034 | [production] | 
            
  | 15:31 | <otto@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: Migrate 5 NavigationTiming schemas to Event Platform on group0 and group1 - T271208 (duration: 01m 07s) | [production] | 
            
  | 15:15 | <godog> | bounce rsyslog on centrallog1001 | [production] | 
            
  | 13:52 | <kharlan@deploy1001> | helmfile [eqiad] Ran 'sync' command on namespace 'linkrecommendation' for release 'external' . | [production] | 
            
  | 13:52 | <kharlan@deploy1001> | helmfile [eqiad] Ran 'sync' command on namespace 'linkrecommendation' for release 'production' . | [production] | 
            
  | 13:48 | <kharlan@deploy1001> | helmfile [codfw] Ran 'sync' command on namespace 'linkrecommendation' for release 'production' . | [production] | 
            
  | 13:48 | <kharlan@deploy1001> | helmfile [codfw] Ran 'sync' command on namespace 'linkrecommendation' for release 'external' . | [production] | 
            
  | 13:43 | <kharlan@deploy1001> | helmfile [staging] Ran 'sync' command on namespace 'linkrecommendation' for release 'staging' . | [production] | 
            
  | 13:25 | <godog> | swift codfw-prod decrease SSD weight for ms-be20[16-27] - T272837 | [production] | 
            
  | 13:19 | <godog> | swift codfw-prod decrease SSD weight for ms-be20[16-27] - T272837 | [production] |