| 2021-07-01
      
      ยง | 
    
  | 14:57 | <jiji@cumin1001> | conftool action : set/pooled=inactive; selector: name=mw2380.codfw.wmnet | [production] | 
            
  | 14:53 | <effie> | depool mw2380 for disk repair - T285603 | [production] | 
            
  | 14:51 | <jiji@deploy1002> | helmfile [staging] Ran 'sync' command on namespace 'tegola-vector-tiles' for release 'main' . | [production] | 
            
  | 14:51 | <oblivian@deploy1002> | helmfile [staging] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . | [production] | 
            
  | 14:45 | <moritzm> | installing glib2.0 security updates on buster | [production] | 
            
  | 13:50 | <jmm@cumin2002> | END (FAIL) - Cookbook sre.hosts.decommission (exit_code=1) for hosts maps2002.codfw.wmnet | [production] | 
            
  | 13:35 | <jmm@cumin2002> | START - Cookbook sre.hosts.decommission for hosts maps2002.codfw.wmnet | [production] | 
            
  | 13:02 | <marostegui> | Deploy schema change on s2 eqiad master T276150 | [production] | 
            
  | 12:49 | <jelto@cumin1001> | END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts mw1266.eqiad.wmnet | [production] | 
            
  | 12:39 | <jelto@cumin1001> | START - Cookbook sre.hosts.decommission for hosts mw1266.eqiad.wmnet | [production] | 
            
  | 12:37 | <jiji@deploy1002> | helmfile [staging] Ran 'sync' command on namespace 'tegola-vector-tiles' for release 'main' . | [production] | 
            
  | 12:29 | <jelto@cumin1001> | END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts mw[1264-1265].eqiad.wmnet | [production] | 
            
  | 12:23 | <tgr> | EU deploys done | [production] | 
            
  | 12:22 | <tgr@deploy1002> | Synchronized php-1.37.0-wmf.12/extensions/GrowthExperiments/: Backport: [[gerrit:702402|Welcome tour: Mark as complete when notice is shown (T284800)]] [[gerrit:702404|SuggestedEdits: Return default JS data as 'noresults' (T285906)]] (duration: 01m 08s) | [production] | 
            
  | 12:20 | <tgr@deploy1002> | Synchronized php-1.37.0-wmf.11/extensions/GrowthExperiments/: Backport: [[gerrit:702401|Welcome tour: Mark as complete when notice is shown (T284800)]] [[gerrit:702403|SuggestedEdits: Return default JS data as 'noresults' (T285906)]] (duration: 01m 09s) | [production] | 
            
  | 12:19 | <jelto@cumin1001> | START - Cookbook sre.hosts.decommission for hosts mw[1264-1265].eqiad.wmnet | [production] | 
            
  | 12:09 | <jelto@cumin1001> | END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts mw1263.eqiad.wmnet | [production] | 
            
  | 11:58 | <jelto@cumin1001> | START - Cookbook sre.hosts.decommission for hosts mw1263.eqiad.wmnet | [production] | 
            
  | 11:54 | <lucaswerkmeister-wmde@deploy1002> | Synchronized php-1.37.0-wmf.12/extensions/Wikibase/: Backport: [[gerrit:702400|Stop using legacy entityNamespaces setting in onSetupAfterCache hook (T285472)]] (duration: 01m 15s) | [production] | 
            
  | 11:46 | <jelto@cumin1001> | END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts mw1262.eqiad.wmnet | [production] | 
            
  | 11:35 | <elukey> | reboot ml-serve-ctrl200[1,2] to increase vcpus/memory (1->2 vcores, 2->4g of memory) | [production] | 
            
  | 11:35 | <marostegui> | Deploy schema change on s8 eqiad master T276150 | [production] | 
            
  | 11:33 | <elukey> | reboot ml-serve-ctrl100[1,2] to increase vcpus/memory (1->2 vcores, 2->4g of memory) | [production] | 
            
  | 11:33 | <jelto@cumin1001> | START - Cookbook sre.hosts.decommission for hosts mw1262.eqiad.wmnet | [production] | 
            
  | 11:19 | <jiji@deploy1002> | helmfile [staging] Ran 'sync' command on namespace 'tegola-vector-tiles' for release 'main' . | [production] | 
            
  | 11:10 | <lucaswerkmeister-wmde@deploy1002> | Synchronized wmf-config/Wikibase.php: Config: [[gerrit:697851|Avoid using MWNamespace]] (duration: 01m 06s) | [production] | 
            
  | 11:07 | <jiji@deploy1002> | helmfile [staging] Ran 'sync' command on namespace 'tegola-vector-tiles' for release 'main' . | [production] | 
            
  | 10:27 | <jiji@deploy1002> | helmfile [staging] Ran 'sync' command on namespace 'tegola-vector-tiles' for release 'main' . | [production] | 
            
  | 10:05 | <moritzm> | installing remaining libgcrypt20 security updates | [production] | 
            
  | 09:56 | <moritzm> | installing remaining gnutls28 security updates | [production] | 
            
  | 09:55 | <Amir1> | start of clean up of autoreview logs in ruwiki (T285608) | [production] | 
            
  | 09:47 | <jiji@deploy1002> | helmfile [staging] Ran 'sync' command on namespace 'tegola-vector-tiles' for release 'main' . | [production] | 
            
  | 09:36 | <jiji@deploy1002> | helmfile [staging-codfw] DONE helmfile.d/admin 'apply'. | [production] | 
            
  | 09:36 | <jiji@deploy1002> | helmfile [staging-codfw] START helmfile.d/admin 'apply'. | [production] | 
            
  | 09:35 | <jiji@deploy1002> | helmfile [staging-codfw] DONE helmfile.d/admin 'apply'. | [production] | 
            
  | 09:35 | <jiji@deploy1002> | helmfile [staging-codfw] START helmfile.d/admin 'apply'. | [production] | 
            
  | 09:05 | <marostegui> | Deploy schema change on s1 eqiad (db1157) master T277123 | [production] | 
            
  | 08:52 | <marostegui> | Deploy schema change on s1 eqiad (db1163) master T277123 | [production] | 
            
  | 08:50 | <jelto@cumin1001> | END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts mw1261.eqiad.wmnet | [production] | 
            
  | 08:28 | <jelto@cumin1001> | START - Cookbook sre.hosts.decommission for hosts mw1261.eqiad.wmnet | [production] | 
            
  | 08:23 | <jelto@cumin1001> | conftool action : set/pooled=inactive; selector: name=mw126[2-6].eqiad.wmnet | [production] | 
            
  | 08:22 | <jelto@cumin1001> | conftool action : set/pooled=no; selector: name=mw126[2-6].eqiad.wmnet | [production] | 
            
  | 08:13 | <jelto@cumin1001> | conftool action : set/pooled=inactive; selector: name=mw1261.eqiad.wmnet | [production] | 
            
  | 08:11 | <jelto@cumin1001> | conftool action : set/pooled=no; selector: name=mw1261.eqiad.wmnet | [production] | 
            
  | 07:06 | <marostegui> | Deploy schema change on s4 eqiad (db1138) master T277123 | [production] | 
            
  | 06:34 | <marostegui> | Deploy schema change on s7 eqiad (db1136) masters T277123 | [production] | 
            
  | 06:31 | <marostegui> | Deploy schema change on s2,s8 eqiad masters T277123 | [production] | 
            
  | 05:57 | <marostegui> | Deploy schema change on s5 eqiad master (db1130) T277123 | [production] | 
            
  | 05:55 | <marostegui> | Deploy schema change on s6 eqiad master (db1173) T277123 | [production] | 
            
  | 05:52 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Repool db1129', diff saved to https://phabricator.wikimedia.org/P16750 and previous config saved to /var/cache/conftool/dbconfig/20210701-055243-marostegui.json | [production] |