| 
      
        2021-10-13
      
      ยง
     | 
  
    
  | 18:33 | 
  <urbanecm> | 
  [urbanecm@mwmaint1002 ~]$ mwscript emptyUserGroup.php --wiki=ptwiki extendedconfirmed | 
  [production] | 
            
  | 18:31 | 
  <urbanecm@deploy1002> | 
  Synchronized wmf-config/InitialiseSettings.php: 0bb2b388217aa91a39ed3684f87fdf7edb06fd81:  Set autoconfirmedextended and confirmedextended for ptwiki (T292915) (duration: 01m 04s) | 
  [production] | 
            
  | 18:16 | 
  <urbanecm@deploy1002> | 
  Synchronized static/images/project-logos: 694bc234ab5dbb9a2387a6129998d45a53ac0ab3: Remove an old dawiki temporary logo (duration: 01m 04s) | 
  [production] | 
            
  | 18:14 | 
  <urbanecm@deploy1002> | 
  Synchronized wmf-config/InitialiseSettings.php: 224e2a374b1cc6327e9d8c2bca576091ce4efc74: Add NS_MAIN back to wgExtraSignatureNamespaces for mediawikiwiki (T291630) (duration: 01m 05s) | 
  [production] | 
            
  | 18:12 | 
  <volans@cumin2002> | 
  END (PASS) - Cookbook sre.debmonitor.remove-hosts (exit_code=0) for 1 hosts: sretest1001.eqiad.wmnet | 
  [production] | 
            
  | 18:12 | 
  <volans@cumin2002> | 
  START - Cookbook sre.debmonitor.remove-hosts for 1 hosts: sretest1001.eqiad.wmnet | 
  [production] | 
            
  | 18:11 | 
  <urbanecm@deploy1002> | 
  Synchronized static/images/project-logos/: 1b96f54a518620b0dc6a0ab63b402d0ea2c6bf70: Update logo for liwiktionary (T291479) (duration: 01m 14s) | 
  [production] | 
            
  | 18:10 | 
  <volans@cumin2002> | 
  END (PASS) - Cookbook sre.debmonitor.remove-hosts (exit_code=0) for 1 hosts: sretest1001.eqiad.wmnet | 
  [production] | 
            
  | 18:10 | 
  <volans@cumin2002> | 
  START - Cookbook sre.debmonitor.remove-hosts for 1 hosts: sretest1001.eqiad.wmnet | 
  [production] | 
            
  | 18:09 | 
  <volans@cumin2002> | 
  END (PASS) - Cookbook sre.debmonitor.remove-hosts (exit_code=0) for 1 hosts: sretest1001.eqiad.wmnet | 
  [production] | 
            
  | 18:09 | 
  <volans@cumin2002> | 
  START - Cookbook sre.debmonitor.remove-hosts for 1 hosts: sretest1001.eqiad.wmnet | 
  [production] | 
            
  | 18:08 | 
  <volans> | 
  uploaded debmonitor-client_0.3.1 to apt.wikimedia.org stretch-wikimedia,buster-wikimedia,bullseye-wikimedia | 
  [production] | 
            
  | 17:14 | 
  <urbanecm@deploy1002> | 
  Synchronized php-1.38.0-wmf.4/extensions/GrowthExperiments/maintenance/initWikiConfig.php: dd7a3314602ffddc5b917cccc71c917301639388: initWikiConfig: Fix loading difficulty/group from SUGGESTED_EDITS_TASK_TYPES (T293219) (duration: 01m 04s) | 
  [production] | 
            
  | 17:13 | 
  <urbanecm@deploy1002> | 
  Synchronized php-1.38.0-wmf.3/extensions/GrowthExperiments/maintenance/initWikiConfig.php: 5c27154cf434bebc37f5e98e2ad1b5cea7cde1d4: initWikiConfig: Fix loading difficulty/group from SUGGESTED_EDITS_TASK_TYPES (T293219) (duration: 01m 15s) | 
  [production] | 
            
  | 16:57 | 
  <mutante> | 
  stat1008 - short on disk space, mostly used in /tmp, high CPU usage by R proccess, sent a message about it to all shell users via wall | 
  [production] | 
            
  | 16:50 | 
  <mutante> | 
  stat1008 - apt-get clean - freed 1.3 GB disk space - was alerting in Icinga because / was 97% full | 
  [production] | 
            
  | 16:37 | 
  <volans@cumin2002> | 
  END (PASS) - Cookbook sre.debmonitor.remove-hosts (exit_code=0) for 1 hosts: sretest1001.eqiad.wmnet | 
  [production] | 
            
  | 16:37 | 
  <volans@cumin2002> | 
  START - Cookbook sre.debmonitor.remove-hosts for 1 hosts: sretest1001.eqiad.wmnet | 
  [production] | 
            
  | 16:23 | 
  <volans@cumin2002> | 
  END (PASS) - Cookbook sre.debmonitor.remove-hosts (exit_code=0) for 1 hosts: sretest1001.eqiad.wmnet | 
  [production] | 
            
  | 16:23 | 
  <volans@cumin2002> | 
  START - Cookbook sre.debmonitor.remove-hosts for 1 hosts: sretest1001.eqiad.wmnet | 
  [production] | 
            
  | 15:29 | 
  <volans@cumin2002> | 
  END (PASS) - Cookbook sre.debmonitor.remove-hosts (exit_code=0) for 1 hosts: sretest1001.eqiad.wmnet | 
  [production] | 
            
  | 15:28 | 
  <volans@cumin2002> | 
  START - Cookbook sre.debmonitor.remove-hosts for 1 hosts: sretest1001.eqiad.wmnet | 
  [production] | 
            
  | 15:26 | 
  <volans@cumin2002> | 
  END (PASS) - Cookbook sre.debmonitor.remove-hosts (exit_code=0) for 1 hosts: sretest1001.eqiad.wmnet | 
  [production] | 
            
  | 15:26 | 
  <volans@cumin2002> | 
  START - Cookbook sre.debmonitor.remove-hosts for 1 hosts: sretest1001.eqiad.wmnet | 
  [production] | 
            
  | 15:16 | 
  <jmm@cumin2002> | 
  END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti2026.codfw.wmnet | 
  [production] | 
            
  | 15:13 | 
  <jbond@cumin1001> | 
  END (PASS) - Cookbook sre.debmonitor.remove-hosts (exit_code=0) for 1 hosts: sretest1001.eqiad.wmnet | 
  [production] | 
            
  | 15:13 | 
  <jbond@cumin1001> | 
  START - Cookbook sre.debmonitor.remove-hosts for 1 hosts: sretest1001.eqiad.wmnet | 
  [production] | 
            
  | 15:12 | 
  <jbond@cumin1001> | 
  END (PASS) - Cookbook sre.debmonitor.remove-hosts (exit_code=0) for 1 hosts: sretest1001.eqiad.wmnet | 
  [production] | 
            
  | 15:12 | 
  <jbond@cumin1001> | 
  START - Cookbook sre.debmonitor.remove-hosts for 1 hosts: sretest1001.eqiad.wmnet | 
  [production] | 
            
  | 15:09 | 
  <jmm@cumin2002> | 
  START - Cookbook sre.hosts.reboot-single for host ganeti2026.codfw.wmnet | 
  [production] | 
            
  | 15:04 | 
  <jgiannelos@deploy1002> | 
  helmfile [eqiad] Ran 'sync' command on namespace 'tegola-vector-tiles' for release 'main' . | 
  [production] | 
            
  | 15:03 | 
  <jbond@cumin1001> | 
  END (PASS) - Cookbook sre.debmonitor.remove-hosts (exit_code=0) for 1 hosts: sretest1001.eqiad.wmnet | 
  [production] | 
            
  | 15:03 | 
  <jbond@cumin1001> | 
  START - Cookbook sre.debmonitor.remove-hosts for 1 hosts: sretest1001.eqiad.wmnet | 
  [production] | 
            
  | 15:01 | 
  <jgiannelos@deploy1002> | 
  helmfile [codfw] Ran 'sync' command on namespace 'tegola-vector-tiles' for release 'main' . | 
  [production] | 
            
  | 15:01 | 
  <jbond@cumin1001> | 
  END (PASS) - Cookbook sre.debmonitor.remove-hosts (exit_code=0) for 1 hosts: sretest1001.eqiad.wmnet | 
  [production] | 
            
  | 15:01 | 
  <jbond@cumin1001> | 
  START - Cookbook sre.debmonitor.remove-hosts for 1 hosts: sretest1001.eqiad.wmnet | 
  [production] | 
            
  | 14:59 | 
  <jgiannelos@deploy1002> | 
  helmfile [staging] Ran 'sync' command on namespace 'tegola-vector-tiles' for release 'main' . | 
  [production] | 
            
  | 14:59 | 
  <jbond@cumin1001> | 
  END (PASS) - Cookbook sre.debmonitor.remove-hosts (exit_code=0) for 1 hosts: sretest1001.eqiad.wmnet | 
  [production] | 
            
  | 14:59 | 
  <jbond@cumin1001> | 
  START - Cookbook sre.debmonitor.remove-hosts for 1 hosts: sretest1001.eqiad.wmnet | 
  [production] | 
            
  | 14:57 | 
  <jbond@cumin1001> | 
  END (PASS) - Cookbook sre.debmonitor.remove-hosts (exit_code=0) for 1 hosts: sretest1001.eqiad.wmnet | 
  [production] | 
            
  | 14:56 | 
  <jbond@cumin1001> | 
  START - Cookbook sre.debmonitor.remove-hosts for 1 hosts: sretest1001.eqiad.wmnet | 
  [production] | 
            
  | 14:56 | 
  <jbond@cumin1001> | 
  END (PASS) - Cookbook sre.debmonitor.remove-hosts (exit_code=0) for 1 hosts: sretest1001.eqiad.wmnet | 
  [production] | 
            
  | 14:56 | 
  <jbond@cumin1001> | 
  START - Cookbook sre.debmonitor.remove-hosts for 1 hosts: sretest1001.eqiad.wmnet | 
  [production] | 
            
  | 14:54 | 
  <jbond@cumin1001> | 
  END (PASS) - Cookbook sre.debmonitor.remove-hosts (exit_code=0) for 1 hosts: sretest1001.eqiad.wmnet | 
  [production] | 
            
  | 14:54 | 
  <jbond@cumin1001> | 
  START - Cookbook sre.debmonitor.remove-hosts for 1 hosts: sretest1001.eqiad.wmnet | 
  [production] | 
            
  | 14:52 | 
  <ema> | 
  repool cp4021, further testing can be performed on sretest1001 T201317 | 
  [production] | 
            
  | 14:51 | 
  <volans> | 
  restarting ircecho.service on alert1001 to get back icinga-wm without the underscore | 
  [production] | 
            
  | 14:50 | 
  <elukey> | 
  restart pybal on lvs1015 (low-traffic primary) to pick up new config for inference.discovery.wmnet - T289835 | 
  [production] | 
            
  | 14:48 | 
  <moritzm> | 
  reverted to clean package state on deneb | 
  [production] | 
            
  | 14:44 | 
  <elukey@puppetmaster1001> | 
  conftool action : ge; selector: cluster=ml_serve,service=inference | 
  [production] |