6151-6200 of 10000 results (71ms)
2022-12-14 ยง
16:19 <denisse@cumin1001> START - Cookbook sre.hosts.reboot-single for host kafkamon2002.codfw.wmnet [production]
16:17 <eevans@deploy1002> helmfile [staging] START helmfile.d/services/sessionstore: apply [production]
16:17 <eevans@deploy1002> helmfile [staging] DONE helmfile.d/services/sessionstore: apply [production]
16:15 <denisse@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host kafkamon1002.eqiad.wmnet [production]
16:10 <denisse@cumin1001> START - Cookbook sre.hosts.reboot-single for host kafkamon1002.eqiad.wmnet [production]
16:06 <eevans@deploy1002> helmfile [staging] START helmfile.d/services/sessionstore: apply [production]
16:02 <cmjohnson@cumin1001> START - Cookbook sre.hosts.reimage for host logstash1036.eqiad.wmnet with OS buster [production]
16:00 <hnowlan@deploy1002> helmfile [eqiad] DONE helmfile.d/services/thumbor: apply [production]
15:51 <eevans@deploy1002> helmfile [staging] DONE helmfile.d/services/echostore: apply [production]
15:50 <eevans@deploy1002> helmfile [staging] START helmfile.d/services/echostore: apply [production]
15:50 <hnowlan@deploy1002> helmfile [eqiad] START helmfile.d/services/thumbor: apply [production]
15:49 <hnowlan@deploy1002> helmfile [eqiad] DONE helmfile.d/services/thumbor: apply [production]
15:48 <hnowlan@deploy1002> helmfile [eqiad] START helmfile.d/services/thumbor: apply [production]
15:45 <hnowlan@deploy1002> helmfile [eqiad] START helmfile.d/services/thumbor: apply [production]
15:44 <hnowlan@deploy1002> helmfile [eqiad] DONE helmfile.d/services/thumbor: sync [production]
15:38 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host apt2001.wikimedia.org [production]
15:34 <hnowlan@deploy1002> helmfile [eqiad] START helmfile.d/services/thumbor: sync [production]
15:32 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host apt2001.wikimedia.org [production]
15:32 <cmjohnson@cumin1001> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host logstash1036.mgmt.eqiad.wmnet with reboot policy FORCED [production]
15:30 <cmjohnson@cumin1001> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host logstash1037.mgmt.eqiad.wmnet with reboot policy FORCED [production]
15:30 <elukey@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ores1009.eqiad.wmnet [production]
15:28 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host testvm2003.codfw.wmnet [production]
15:25 <hnowlan@deploy1002> helmfile [eqiad] DONE helmfile.d/services/thumbor: sync [production]
15:24 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host testvm2003.codfw.wmnet [production]
15:24 <elukey@cumin1001> START - Cookbook sre.hosts.reboot-single for host ores1009.eqiad.wmnet [production]
15:24 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host testvm2002.codfw.wmnet [production]
15:23 <elukey@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ores1008.eqiad.wmnet [production]
15:19 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host testvm2002.codfw.wmnet [production]
15:18 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host testvm2001.codfw.wmnet [production]
15:18 <cmjohnson@cumin1001> START - Cookbook sre.hosts.provision for host logstash1036.mgmt.eqiad.wmnet with reboot policy FORCED [production]
15:17 <elukey@cumin1001> START - Cookbook sre.hosts.reboot-single for host ores1008.eqiad.wmnet [production]
15:16 <elukey@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ores1007.eqiad.wmnet [production]
15:15 <hnowlan@deploy1002> helmfile [eqiad] START helmfile.d/services/thumbor: sync [production]
15:15 <cmjohnson@cumin1001> START - Cookbook sre.hosts.provision for host logstash1037.mgmt.eqiad.wmnet with reboot policy FORCED [production]
15:14 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host testvm2001.codfw.wmnet [production]
15:08 <elukey@cumin1001> START - Cookbook sre.hosts.reboot-single for host ores1007.eqiad.wmnet [production]
15:07 <elukey@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ores1006.eqiad.wmnet [production]
15:07 <hnowlan@deploy1002> helmfile [eqiad] DONE helmfile.d/services/thumbor: sync [production]
15:00 <elukey@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ores1005.eqiad.wmnet [production]
15:00 <elukey@cumin1001> START - Cookbook sre.hosts.reboot-single for host ores1006.eqiad.wmnet [production]
14:58 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host xhgui1001.eqiad.wmnet [production]
14:57 <hnowlan@deploy1002> helmfile [eqiad] START helmfile.d/services/thumbor: sync [production]
14:57 <elukey@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ores1004.eqiad.wmnet [production]
14:55 <elukey@cumin1001> START - Cookbook sre.hosts.reboot-single for host ores1005.eqiad.wmnet [production]
14:54 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host xhgui1001.eqiad.wmnet [production]
14:50 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host xhgui2001.codfw.wmnet [production]
14:47 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host xhgui2001.codfw.wmnet [production]
14:30 <jmm@cumin2002> END (FAIL) - Cookbook sre.hosts.reboot-single (exit_code=1) for host puppetdb1003.eqiad.wmnet [production]
14:29 <marostegui@cumin1001> dbctl commit (dc=all): 'db1119 (re)pooling @ 100%: Repooling', diff saved to https://phabricator.wikimedia.org/P42707 and previous config saved to /var/cache/conftool/dbconfig/20221214-142958-root.json [production]
14:20 <ladsgroup@deploy1002> Finished scap: Backport for [[gerrit:868048|Parsoid: Default parsoid version to "0.0.0" for unsupported models (T325137)]] (duration: 08m 12s) [production]