3701-3750 of 10000 results (34ms)
2021-07-01 ยง
14:51 <jiji@deploy1002> helmfile [staging] Ran 'sync' command on namespace 'tegola-vector-tiles' for release 'main' . [production]
14:51 <oblivian@deploy1002> helmfile [staging] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
14:45 <moritzm> installing glib2.0 security updates on buster [production]
13:50 <jmm@cumin2002> END (FAIL) - Cookbook sre.hosts.decommission (exit_code=1) for hosts maps2002.codfw.wmnet [production]
13:35 <jmm@cumin2002> START - Cookbook sre.hosts.decommission for hosts maps2002.codfw.wmnet [production]
13:02 <marostegui> Deploy schema change on s2 eqiad master T276150 [production]
12:49 <jelto@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts mw1266.eqiad.wmnet [production]
12:39 <jelto@cumin1001> START - Cookbook sre.hosts.decommission for hosts mw1266.eqiad.wmnet [production]
12:37 <jiji@deploy1002> helmfile [staging] Ran 'sync' command on namespace 'tegola-vector-tiles' for release 'main' . [production]
12:29 <jelto@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts mw[1264-1265].eqiad.wmnet [production]
12:23 <tgr> EU deploys done [production]
12:22 <tgr@deploy1002> Synchronized php-1.37.0-wmf.12/extensions/GrowthExperiments/: Backport: [[gerrit:702402|Welcome tour: Mark as complete when notice is shown (T284800)]] [[gerrit:702404|SuggestedEdits: Return default JS data as 'noresults' (T285906)]] (duration: 01m 08s) [production]
12:20 <tgr@deploy1002> Synchronized php-1.37.0-wmf.11/extensions/GrowthExperiments/: Backport: [[gerrit:702401|Welcome tour: Mark as complete when notice is shown (T284800)]] [[gerrit:702403|SuggestedEdits: Return default JS data as 'noresults' (T285906)]] (duration: 01m 09s) [production]
12:19 <jelto@cumin1001> START - Cookbook sre.hosts.decommission for hosts mw[1264-1265].eqiad.wmnet [production]
12:09 <jelto@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts mw1263.eqiad.wmnet [production]
11:58 <jelto@cumin1001> START - Cookbook sre.hosts.decommission for hosts mw1263.eqiad.wmnet [production]
11:54 <lucaswerkmeister-wmde@deploy1002> Synchronized php-1.37.0-wmf.12/extensions/Wikibase/: Backport: [[gerrit:702400|Stop using legacy entityNamespaces setting in onSetupAfterCache hook (T285472)]] (duration: 01m 15s) [production]
11:46 <jelto@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts mw1262.eqiad.wmnet [production]
11:35 <elukey> reboot ml-serve-ctrl200[1,2] to increase vcpus/memory (1->2 vcores, 2->4g of memory) [production]
11:35 <marostegui> Deploy schema change on s8 eqiad master T276150 [production]
11:33 <elukey> reboot ml-serve-ctrl100[1,2] to increase vcpus/memory (1->2 vcores, 2->4g of memory) [production]
11:33 <jelto@cumin1001> START - Cookbook sre.hosts.decommission for hosts mw1262.eqiad.wmnet [production]
11:19 <jiji@deploy1002> helmfile [staging] Ran 'sync' command on namespace 'tegola-vector-tiles' for release 'main' . [production]
11:10 <lucaswerkmeister-wmde@deploy1002> Synchronized wmf-config/Wikibase.php: Config: [[gerrit:697851|Avoid using MWNamespace]] (duration: 01m 06s) [production]
11:07 <jiji@deploy1002> helmfile [staging] Ran 'sync' command on namespace 'tegola-vector-tiles' for release 'main' . [production]
10:27 <jiji@deploy1002> helmfile [staging] Ran 'sync' command on namespace 'tegola-vector-tiles' for release 'main' . [production]
10:05 <moritzm> installing remaining libgcrypt20 security updates [production]
09:56 <moritzm> installing remaining gnutls28 security updates [production]
09:55 <Amir1> start of clean up of autoreview logs in ruwiki (T285608) [production]
09:47 <jiji@deploy1002> helmfile [staging] Ran 'sync' command on namespace 'tegola-vector-tiles' for release 'main' . [production]
09:36 <jiji@deploy1002> helmfile [staging-codfw] DONE helmfile.d/admin 'apply'. [production]
09:36 <jiji@deploy1002> helmfile [staging-codfw] START helmfile.d/admin 'apply'. [production]
09:35 <jiji@deploy1002> helmfile [staging-codfw] DONE helmfile.d/admin 'apply'. [production]
09:35 <jiji@deploy1002> helmfile [staging-codfw] START helmfile.d/admin 'apply'. [production]
09:05 <marostegui> Deploy schema change on s1 eqiad (db1157) master T277123 [production]
08:52 <marostegui> Deploy schema change on s1 eqiad (db1163) master T277123 [production]
08:50 <jelto@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts mw1261.eqiad.wmnet [production]
08:28 <jelto@cumin1001> START - Cookbook sre.hosts.decommission for hosts mw1261.eqiad.wmnet [production]
08:23 <jelto@cumin1001> conftool action : set/pooled=inactive; selector: name=mw126[2-6].eqiad.wmnet [production]
08:22 <jelto@cumin1001> conftool action : set/pooled=no; selector: name=mw126[2-6].eqiad.wmnet [production]
08:13 <jelto@cumin1001> conftool action : set/pooled=inactive; selector: name=mw1261.eqiad.wmnet [production]
08:11 <jelto@cumin1001> conftool action : set/pooled=no; selector: name=mw1261.eqiad.wmnet [production]
07:06 <marostegui> Deploy schema change on s4 eqiad (db1138) master T277123 [production]
06:34 <marostegui> Deploy schema change on s7 eqiad (db1136) masters T277123 [production]
06:31 <marostegui> Deploy schema change on s2,s8 eqiad masters T277123 [production]
05:57 <marostegui> Deploy schema change on s5 eqiad master (db1130) T277123 [production]
05:55 <marostegui> Deploy schema change on s6 eqiad master (db1173) T277123 [production]
05:52 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1129', diff saved to https://phabricator.wikimedia.org/P16750 and previous config saved to /var/cache/conftool/dbconfig/20210701-055243-marostegui.json [production]
05:27 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1129', diff saved to https://phabricator.wikimedia.org/P16749 and previous config saved to /var/cache/conftool/dbconfig/20210701-052702-marostegui.json [production]
04:48 <marostegui> Disconnect eqiad -> codfw replication from s1-s8 [production]