3101-3150 of 10000 results (36ms)
2020-07-08 §
13:31 <moritzm> imported git 2.20.1-2+deb10u3~wmf1 for stretch-wikimedia component/git T257308 [production]
13:10 <elukey@cumin1001> START - Cookbook sre.hadoop.change-distro [production]
13:07 <elukey@cumin1001> END (PASS) - Cookbook sre.hadoop.stop-cluster (exit_code=0) [production]
13:00 <elukey@cumin1001> START - Cookbook sre.hadoop.stop-cluster [production]
12:41 <marostegui> Deploy schema change on s7 codfw, lag is expected [production]
12:17 <xionox-tmp> rollout less frequent option-refresh-rate - T240658 [production]
12:01 <xionox-tmp> renumber eqiad NTT link - T254877 [production]
11:42 <awight> EU BACON complete [production]
11:41 <awight@deploy1001> Synchronized wmf-config/InitialiseSettings.php: BACON: [[gerrit:610234|Undeploy graphoid for phase 1 wikis (T257402)]] (duration: 01m 03s) [production]
11:31 <awight@deploy1001> Synchronized wmf-config/InitialiseSettings.php: BACON: [[gerrit:610268|Add nature.com to commonswiki wgCopyUploadDomains (T254342)]] (duration: 01m 03s) [production]
11:29 <moritzm> installing freetype security updates [production]
11:26 <awight@deploy1001> Synchronized wmf-config/InitialiseSettings.php: BACON: [[gerrit:609991|[hiwikibooks] Translate sitename for hi.wikibooks (T256587)]] (duration: 01m 03s) [production]
11:19 <awight@deploy1001> Synchronized wmf-config/InitialiseSettings.php: BACON: [[gerrit:609990|[arwiki] Grant 'patrolmarks' to all (T257106)]] (duration: 01m 04s) [production]
11:18 <akosiaris@deploy1001> helmfile [CODFW] Ran 'sync' command on namespace 'proton' for release 'production' . [production]
11:18 <moritzm> installing libgcrypt20 security updates [production]
11:16 <akosiaris@deploy1001> helmfile [EQIAD] Ran 'sync' command on namespace 'proton' for release 'production' . [production]
11:07 <awight@deploy1001> Synchronized wmf-config/InitialiseSettings.php: BACON: [[gerrit:610056|Provision WMDE TeWü survey for prototype 1 (T257306)]], file 2/2 (duration: 01m 03s) [production]
11:06 <awight@deploy1001> Synchronized wmf-config/InitialiseSettings-labs.php: BACON: [[gerrit:610056|Provision WMDE TeWü survey for prototype 1 (T257306)]], file 1/2 (duration: 01m 16s) [production]
11:05 <akosiaris@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'proton' for release 'production' . [production]
11:05 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1121', diff saved to https://phabricator.wikimedia.org/P11818 and previous config saved to /var/cache/conftool/dbconfig/20200708-110546-marostegui.json [production]
10:51 <akosiaris@deploy1001> helmfile [EQIAD] Ran 'sync' command on namespace 'kube-system' for release 'calico-policy-controller' . [production]
10:51 <akosiaris@deploy1001> helmfile [CODFW] Ran 'sync' command on namespace 'kube-system' for release 'calico-policy-controller' . [production]
10:50 <akosiaris> apply calico egress policies [production]
10:50 <akosiaris@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'kube-system' for release 'calico-policy-controller' . [production]
10:45 <moritzm> installing json-c security updates [production]
10:25 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1121', diff saved to https://phabricator.wikimedia.org/P11817 and previous config saved to /var/cache/conftool/dbconfig/20200708-102553-marostegui.json [production]
10:25 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1084', diff saved to https://phabricator.wikimedia.org/P11816 and previous config saved to /var/cache/conftool/dbconfig/20200708-102500-marostegui.json [production]
10:13 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1084', diff saved to https://phabricator.wikimedia.org/P11815 and previous config saved to /var/cache/conftool/dbconfig/20200708-101313-marostegui.json [production]
09:58 <kormat@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
09:57 <elukey@cumin1001> END (PASS) - Cookbook sre.hadoop.stop-cluster (exit_code=0) [production]
09:56 <kormat@cumin2001> START - Cookbook sre.hosts.downtime [production]
09:50 <elukey@cumin1001> START - Cookbook sre.hadoop.stop-cluster [production]
09:45 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1149', diff saved to https://phabricator.wikimedia.org/P11814 and previous config saved to /var/cache/conftool/dbconfig/20200708-094539-marostegui.json [production]
09:26 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1149', diff saved to https://phabricator.wikimedia.org/P11813 and previous config saved to /var/cache/conftool/dbconfig/20200708-092650-marostegui.json [production]
09:26 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1148', diff saved to https://phabricator.wikimedia.org/P11812 and previous config saved to /var/cache/conftool/dbconfig/20200708-092627-marostegui.json [production]
09:24 <xionox-tmp> renumber eqord NTT link - T254877 [production]
09:18 <xionox-tmp> remove eqord-eqiad tunnel - T254877 [production]
09:15 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1148', diff saved to https://phabricator.wikimedia.org/P11811 and previous config saved to /var/cache/conftool/dbconfig/20200708-091557-marostegui.json [production]
08:57 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1147', diff saved to https://phabricator.wikimedia.org/P11810 and previous config saved to /var/cache/conftool/dbconfig/20200708-085745-marostegui.json [production]
08:55 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) [production]
08:54 <marostegui@cumin1001> START - Cookbook sre.hosts.decommission [production]
08:54 <marostegui@cumin1001> END (FAIL) - Cookbook sre.hosts.decommission (exit_code=99) [production]
08:54 <marostegui@cumin1001> START - Cookbook sre.hosts.decommission [production]
08:50 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1147', diff saved to https://phabricator.wikimedia.org/P11809 and previous config saved to /var/cache/conftool/dbconfig/20200708-085024-marostegui.json [production]
08:42 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1074', diff saved to https://phabricator.wikimedia.org/P11808 and previous config saved to /var/cache/conftool/dbconfig/20200708-084227-marostegui.json [production]
08:40 <moritzm> upgrading docker on remaining buster hosts [production]
08:38 <hashar> Upgraded docker.io on contint1001 and contint2001 [production]
08:28 <marostegui> Remove dbproxy1003 grants from misc hosts T231280 [production]
08:26 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1146:3314', diff saved to https://phabricator.wikimedia.org/P11807 and previous config saved to /var/cache/conftool/dbconfig/20200708-082624-marostegui.json [production]
08:20 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1146:3314', diff saved to https://phabricator.wikimedia.org/P11806 and previous config saved to /var/cache/conftool/dbconfig/20200708-082040-marostegui.json [production]