101-150 of 10000 results (92ms)
2024-07-19 ยง
13:31 <cgoubert@cumin1002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host mw2439.mgmt.codfw.wmnet with reboot policy GRACEFUL [production]
13:21 <cgoubert@cumin1002> START - Cookbook sre.hosts.provision for host mw2439.mgmt.codfw.wmnet with reboot policy GRACEFUL [production]
12:53 <cgoubert@cumin1002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host mw2439.mgmt.codfw.wmnet with reboot policy GRACEFUL [production]
12:49 <cgoubert@cumin1002> START - Cookbook sre.hosts.provision for host mw2439.mgmt.codfw.wmnet with reboot policy GRACEFUL [production]
12:47 <cgoubert@cumin1002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host mw2439.mgmt.codfw.wmnet with reboot policy GRACEFUL [production]
12:47 <cgoubert@cumin1002> START - Cookbook sre.hosts.provision for host mw2439.mgmt.codfw.wmnet with reboot policy GRACEFUL [production]
12:24 <cgoubert@cumin1002> END (PASS) - Cookbook sre.hosts.convert-disks (exit_code=0) for host mw2439 [production]
12:24 <cgoubert@cumin1002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host mw2439.mgmt.codfw.wmnet with reboot policy GRACEFUL [production]
12:23 <arnaudb@cumin1002> dbctl commit (dc=all): 'T365998 - depooling db1195 - s1 db1202 - s7 db1203 - s8', diff saved to https://phabricator.wikimedia.org/P66843 and previous config saved to /var/cache/conftool/dbconfig/20240719-122320-arnaudb.json [production]
12:20 <cgoubert@cumin1002> START - Cookbook sre.hosts.provision for host mw2439.mgmt.codfw.wmnet with reboot policy GRACEFUL [production]
12:19 <marostegui@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2199.codfw.wmnet with reason: Maintenance [production]
12:19 <marostegui@cumin1002> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2199.codfw.wmnet with reason: Maintenance [production]
12:19 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2172 (T367856)', diff saved to https://phabricator.wikimedia.org/P66842 and previous config saved to /var/cache/conftool/dbconfig/20240719-121933-marostegui.json [production]
12:19 <cgoubert@cumin1002> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts mw2439.codfw.wmnet [production]
12:18 <cgoubert@cumin1002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts mw2439.codfw.wmnet [production]
12:18 <cgoubert@cumin1002> START - Cookbook sre.hosts.convert-disks for host mw2439 [production]
12:13 <cgoubert@cumin1002> END (FAIL) - Cookbook sre.hosts.convert-disks (exit_code=99) for host mw2439 [production]
12:12 <cgoubert@cumin1002> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts mw2439.codfw.wmnet [production]
12:12 <cgoubert@cumin1002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts mw2439.codfw.wmnet [production]
12:12 <cgoubert@cumin1002> START - Cookbook sre.hosts.convert-disks for host mw2439 [production]
12:10 <cgoubert@cumin1002> END (FAIL) - Cookbook sre.hosts.convert-disks (exit_code=99) for host mw2439 [production]
12:09 <cgoubert@cumin1002> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts mw2439.codfw.wmnet [production]
12:09 <cgoubert@cumin1002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts mw2439.codfw.wmnet [production]
12:09 <cgoubert@cumin1002> START - Cookbook sre.hosts.convert-disks for host mw2439 [production]
12:06 <cgoubert@cumin1002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host mw2439.mgmt.codfw.wmnet with reboot policy GRACEFUL [production]
12:04 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2172', diff saved to https://phabricator.wikimedia.org/P66841 and previous config saved to /var/cache/conftool/dbconfig/20240719-120426-marostegui.json [production]
12:01 <cgoubert@cumin1002> START - Cookbook sre.hosts.provision for host mw2439.mgmt.codfw.wmnet with reboot policy GRACEFUL [production]
11:49 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2172', diff saved to https://phabricator.wikimedia.org/P66840 and previous config saved to /var/cache/conftool/dbconfig/20240719-114919-marostegui.json [production]
11:34 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2172 (T367856)', diff saved to https://phabricator.wikimedia.org/P66839 and previous config saved to /var/cache/conftool/dbconfig/20240719-113412-marostegui.json [production]
11:10 <cgoubert@cumin1002> END (FAIL) - Cookbook sre.hosts.convert-disks (exit_code=99) for host mw2439 [production]
11:07 <isaranto@deploy1002> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'articletopic-outlink' for release 'main' . [production]
11:05 <btullis@deploy1002> helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'apply'. [production]
11:05 <btullis@deploy1002> helmfile [dse-k8s-eqiad] START helmfile.d/admin 'apply'. [production]
10:54 <cgoubert@cumin1002> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts mw2439.codfw.wmnet [production]
10:54 <cgoubert@cumin1002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts mw2439.codfw.wmnet [production]
10:54 <cgoubert@cumin1002> START - Cookbook sre.hosts.convert-disks for host mw2439 [production]
10:49 <cgoubert@cumin1002> END (ERROR) - Cookbook sre.hosts.convert-disks (exit_code=97) for host mw2439 [production]
10:41 <cgoubert@cumin1002> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts mw2439.codfw.wmnet [production]
10:41 <cgoubert@cumin1002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts mw2439.codfw.wmnet [production]
10:41 <cgoubert@cumin1002> START - Cookbook sre.hosts.convert-disks for host mw2439 [production]
10:38 <cgoubert@cumin1002> END (FAIL) - Cookbook sre.hosts.convert-disks (exit_code=99) for host mw2439 [production]
10:37 <cgoubert@cumin1002> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts mw2439.codfw.wmnet [production]
10:37 <cgoubert@cumin1002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts mw2439.codfw.wmnet [production]
10:37 <cgoubert@cumin1002> START - Cookbook sre.hosts.convert-disks for host mw2439 [production]
10:28 <cgoubert@cumin1002> END (FAIL) - Cookbook sre.hosts.convert-disks (exit_code=99) for host mw2439 [production]
10:13 <cgoubert@cumin1002> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts mw2439.codfw.wmnet [production]
10:13 <cgoubert@cumin1002> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts mw2439.codfw.wmnet [production]
10:13 <cgoubert@cumin1002> START - Cookbook sre.hosts.convert-disks for host mw2439 [production]
10:06 <pfischer@deploy1002> helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
10:05 <pfischer@deploy1002> helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply [production]