2401-2450 of 10000 results (33ms)
2020-07-08 §
15:06 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) [production]
15:04 <jmm@cumin2001> START - Cookbook sre.hosts.reboot-single [production]
14:48 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) [production]
14:46 <jmm@cumin2001> START - Cookbook sre.hosts.reboot-single [production]
14:46 <moritzm> installing isc-dhcp security updates [production]
14:31 <elukey@cumin1001> END (FAIL) - Cookbook sre.hadoop.change-distro (exit_code=99) [production]
14:31 <moritzm> installing gdk-pixbuf security updates [production]
14:26 <_joe_> repooling mw1346 [production]
14:24 <_joe_> php7adm /opcache-free on mw1346 [production]
14:15 <jbond42> switch icinga authentication to CAS SSO [production]
14:12 <_joe_> depooling mw1346 [production]
14:12 <elukey@cumin1001> START - Cookbook sre.hadoop.change-distro [production]
14:11 <elukey@cumin1001> END (PASS) - Cookbook sre.hadoop.stop-cluster (exit_code=0) [production]
14:06 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) [production]
14:04 <elukey@cumin1001> START - Cookbook sre.hadoop.stop-cluster [production]
14:04 <jmm@cumin2001> START - Cookbook sre.hosts.reboot-single [production]
14:04 <moritzm> rebooting idp-test1001 for kernel update [production]
13:59 <elukey@cumin1001> END (ERROR) - Cookbook sre.hadoop.stop-cluster (exit_code=97) [production]
13:59 <elukey@cumin1001> START - Cookbook sre.hadoop.stop-cluster [production]
13:39 <elukey@cumin1001> END (PASS) - Cookbook sre.hadoop.change-distro (exit_code=0) [production]
13:31 <jynus> replacing ssh key for ci_docroot at deploy1001 [production]
13:31 <moritzm> imported git 2.20.1-2+deb10u3~wmf1 for stretch-wikimedia component/git T257308 [production]
13:10 <elukey@cumin1001> START - Cookbook sre.hadoop.change-distro [production]
13:07 <elukey@cumin1001> END (PASS) - Cookbook sre.hadoop.stop-cluster (exit_code=0) [production]
13:00 <elukey@cumin1001> START - Cookbook sre.hadoop.stop-cluster [production]
12:41 <marostegui> Deploy schema change on s7 codfw, lag is expected [production]
12:17 <xionox-tmp> rollout less frequent option-refresh-rate - T240658 [production]
12:01 <xionox-tmp> renumber eqiad NTT link - T254877 [production]
11:42 <awight> EU BACON complete [production]
11:41 <awight@deploy1001> Synchronized wmf-config/InitialiseSettings.php: BACON: [[gerrit:610234|Undeploy graphoid for phase 1 wikis (T257402)]] (duration: 01m 03s) [production]
11:31 <awight@deploy1001> Synchronized wmf-config/InitialiseSettings.php: BACON: [[gerrit:610268|Add nature.com to commonswiki wgCopyUploadDomains (T254342)]] (duration: 01m 03s) [production]
11:29 <moritzm> installing freetype security updates [production]
11:26 <awight@deploy1001> Synchronized wmf-config/InitialiseSettings.php: BACON: [[gerrit:609991|[hiwikibooks] Translate sitename for hi.wikibooks (T256587)]] (duration: 01m 03s) [production]
11:19 <awight@deploy1001> Synchronized wmf-config/InitialiseSettings.php: BACON: [[gerrit:609990|[arwiki] Grant 'patrolmarks' to all (T257106)]] (duration: 01m 04s) [production]
11:18 <akosiaris@deploy1001> helmfile [CODFW] Ran 'sync' command on namespace 'proton' for release 'production' . [production]
11:18 <moritzm> installing libgcrypt20 security updates [production]
11:16 <akosiaris@deploy1001> helmfile [EQIAD] Ran 'sync' command on namespace 'proton' for release 'production' . [production]
11:07 <awight@deploy1001> Synchronized wmf-config/InitialiseSettings.php: BACON: [[gerrit:610056|Provision WMDE TeWü survey for prototype 1 (T257306)]], file 2/2 (duration: 01m 03s) [production]
11:06 <awight@deploy1001> Synchronized wmf-config/InitialiseSettings-labs.php: BACON: [[gerrit:610056|Provision WMDE TeWü survey for prototype 1 (T257306)]], file 1/2 (duration: 01m 16s) [production]
11:05 <akosiaris@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'proton' for release 'production' . [production]
11:05 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1121', diff saved to https://phabricator.wikimedia.org/P11818 and previous config saved to /var/cache/conftool/dbconfig/20200708-110546-marostegui.json [production]
10:51 <akosiaris@deploy1001> helmfile [EQIAD] Ran 'sync' command on namespace 'kube-system' for release 'calico-policy-controller' . [production]
10:51 <akosiaris@deploy1001> helmfile [CODFW] Ran 'sync' command on namespace 'kube-system' for release 'calico-policy-controller' . [production]
10:50 <akosiaris> apply calico egress policies [production]
10:50 <akosiaris@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'kube-system' for release 'calico-policy-controller' . [production]
10:45 <moritzm> installing json-c security updates [production]
10:25 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1121', diff saved to https://phabricator.wikimedia.org/P11817 and previous config saved to /var/cache/conftool/dbconfig/20200708-102553-marostegui.json [production]
10:25 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1084', diff saved to https://phabricator.wikimedia.org/P11816 and previous config saved to /var/cache/conftool/dbconfig/20200708-102500-marostegui.json [production]
10:13 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1084', diff saved to https://phabricator.wikimedia.org/P11815 and previous config saved to /var/cache/conftool/dbconfig/20200708-101313-marostegui.json [production]
09:58 <kormat@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]