9051-9100 of 10000 results (10ms)
2025-06-05 §
13:38 <jmm@cumin1003> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti2037.codfw.wmnet [production]
13:37 <jmm@cumin1003> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti2036.codfw.wmnet [production]
13:18 <jmm@cumin1003> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti2036.codfw.wmnet [production]
12:54 <jmm@cumin1003> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti2035.codfw.wmnet [production]
12:50 <marostegui@cumin1002> dbctl commit (dc=all): 'Depool db2151 T395989', diff saved to https://phabricator.wikimedia.org/P77158 and previous config saved to /var/cache/conftool/dbconfig/20250605-125057-marostegui.json [production]
12:43 <jmm@cumin1003> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti2035.codfw.wmnet [production]
12:20 <marostegui@cumin1002> dbctl commit (dc=all): 'Depool es2042 es2045 T395241', diff saved to https://phabricator.wikimedia.org/P77147 and previous config saved to /var/cache/conftool/dbconfig/20250605-122035-marostegui.json [production]
11:26 <jmm@cumin1003> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti2032.codfw.wmnet [production]
11:09 <jmm@cumin1003> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti2032.codfw.wmnet [production]
11:04 <jmm@cumin1003> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti2031.codfw.wmnet [production]
10:42 <jmm@cumin1003> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti2031.codfw.wmnet [production]
10:41 <jmm@cumin1003> END (FAIL) - Cookbook sre.ganeti.drain-node (exit_code=99) for draining ganeti node ganeti2030.codfw.wmnet [production]
10:33 <jmm@cumin1003> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti2030.codfw.wmnet [production]
10:22 <jmm@cumin1003> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti2029.codfw.wmnet [production]
10:04 <marostegui@cumin1002> dbctl commit (dc=all): 'Depool es2043 es2046 T395241', diff saved to https://phabricator.wikimedia.org/P77117 and previous config saved to /var/cache/conftool/dbconfig/20250605-100419-marostegui.json [production]
10:03 <jmm@cumin1003> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti2029.codfw.wmnet [production]
09:58 <jmm@cumin1003> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti2028.codfw.wmnet [production]
09:44 <jmm@cumin1003> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti2028.codfw.wmnet [production]
09:36 <jmm@cumin1003> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti2027.codfw.wmnet [production]
09:31 <marostegui@cumin1002> dbctl commit (dc=all): 'Depool db2158 T395989', diff saved to https://phabricator.wikimedia.org/P77108 and previous config saved to /var/cache/conftool/dbconfig/20250605-093107-marostegui.json [production]
09:26 <jmm@cumin1003> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti2027.codfw.wmnet [production]
09:24 <jmm@cumin1003> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti2026.codfw.wmnet [production]
08:53 <jmm@cumin1003> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti2026.codfw.wmnet [production]
08:50 <jmm@cumin1003> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti2025.codfw.wmnet [production]
08:45 <marostegui@cumin1002> dbctl commit (dc=all): 'Depool db2169 T395989', diff saved to https://phabricator.wikimedia.org/P77100 and previous config saved to /var/cache/conftool/dbconfig/20250605-084557-marostegui.json [production]
08:31 <jmm@cumin1003> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti2025.codfw.wmnet [production]
08:10 <jmm@cumin1003> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti2024.codfw.wmnet [production]
07:56 <jmm@cumin1003> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti2024.codfw.wmnet [production]
07:50 <jmm@cumin1003> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti2023.codfw.wmnet [production]
07:36 <jmm@cumin1003> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti2023.codfw.wmnet [production]
07:32 <jmm@cumin1003> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti2022.codfw.wmnet [production]
07:19 <jmm@cumin1003> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti2022.codfw.wmnet [production]
06:16 <marostegui@cumin1002> dbctl commit (dc=all): 'Depool pc8 T395983', diff saved to https://phabricator.wikimedia.org/P77092 and previous config saved to /var/cache/conftool/dbconfig/20250605-061612-marostegui.json [production]
06:12 <marostegui@cumin1002> dbctl commit (dc=all): 'Depool pc7 T395983', diff saved to https://phabricator.wikimedia.org/P77090 and previous config saved to /var/cache/conftool/dbconfig/20250605-061200-marostegui.json [production]
05:54 <marostegui@cumin1002> dbctl commit (dc=all): 'Depool pc6 T395983', diff saved to https://phabricator.wikimedia.org/P77086 and previous config saved to /var/cache/conftool/dbconfig/20250605-055438-marostegui.json [production]
05:51 <marostegui@cumin1002> dbctl commit (dc=all): 'Depool pc5 T395983', diff saved to https://phabricator.wikimedia.org/P77084 and previous config saved to /var/cache/conftool/dbconfig/20250605-055121-marostegui.json [production]
05:48 <marostegui@cumin1002> dbctl commit (dc=all): 'Depool pc4 T395983', diff saved to https://phabricator.wikimedia.org/P77082 and previous config saved to /var/cache/conftool/dbconfig/20250605-054806-marostegui.json [production]
05:33 <marostegui@cumin1002> dbctl commit (dc=all): 'Depool pc3 T395983', diff saved to https://phabricator.wikimedia.org/P77079 and previous config saved to /var/cache/conftool/dbconfig/20250605-053317-marostegui.json [production]
05:24 <marostegui@cumin1002> dbctl commit (dc=all): 'Depool pc2 T395983', diff saved to https://phabricator.wikimedia.org/P77076 and previous config saved to /var/cache/conftool/dbconfig/20250605-052442-marostegui.json [production]
05:20 <marostegui@cumin1002> dbctl commit (dc=all): 'Depool db2180 T395989', diff saved to https://phabricator.wikimedia.org/P77075 and previous config saved to /var/cache/conftool/dbconfig/20250605-052003-marostegui.json [production]
2025-06-04 §
22:11 <brett> sudo -i cumin 'A:ncredir' 'depool && apt-get update && apt-get upgrade -y && pool' -b1 -s10 [production]
14:47 <jmm@cumin1003> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti2020.codfw.wmnet [production]
14:31 <jmm@cumin1003> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti2020.codfw.wmnet [production]
14:29 <jmm@cumin1003> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti2019.codfw.wmnet [production]
14:13 <jmm@cumin1003> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti2019.codfw.wmnet [production]
13:37 <sukhe> forcing agent run on cp2037 (non-single BE node): CR 1114074 [production]
13:30 <sukhe> forcing agent run on cp7001 (single BE node): CR 1114074 [production]
12:23 <marostegui@cumin1002> dbctl commit (dc=all): 'Depool db2217 T395989', diff saved to https://phabricator.wikimedia.org/P77045 and previous config saved to /var/cache/conftool/dbconfig/20250604-122303-marostegui.json [production]
11:34 <jmm@cumin1003> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti4008.ulsfo.wmnet [production]
11:20 <jmm@cumin1003> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti4008.ulsfo.wmnet [production]