8751-8800 of 10000 results (9ms)
2025-07-09 §
07:34 <marostegui@cumin1002> dbctl commit (dc=all): 'Depool es1036', diff saved to https://phabricator.wikimedia.org/P78817 and previous config saved to /var/cache/conftool/dbconfig/20250709-073458-marostegui.json [production]
2025-07-08 §
14:26 <marostegui@cumin1002> dbctl commit (dc=all): 'Depool db1185 for migration to mariadb 10.11', diff saved to https://phabricator.wikimedia.org/P78811 and previous config saved to /var/cache/conftool/dbconfig/20250708-142635-marostegui.json [production]
10:31 <marostegui@cumin1002> dbctl commit (dc=all): 'Depool db1159 for migration to mariadb 10.11', diff saved to https://phabricator.wikimedia.org/P78799 and previous config saved to /var/cache/conftool/dbconfig/20250708-103106-marostegui.json [production]
10:21 <marostegui@cumin1002> dbctl commit (dc=all): 'Depool db1159 for migration to mariadb 10.11', diff saved to https://phabricator.wikimedia.org/P78796 and previous config saved to /var/cache/conftool/dbconfig/20250708-102114-marostegui.json [production]
10:04 <marostegui@cumin1002> dbctl commit (dc=all): 'Depool db2157', diff saved to https://phabricator.wikimedia.org/P78795 and previous config saved to /var/cache/conftool/dbconfig/20250708-100434-marostegui.json [production]
04:38 <marostegui@cumin1002> dbctl commit (dc=all): 'Depool db1162 T398906', diff saved to https://phabricator.wikimedia.org/P78783 and previous config saved to /var/cache/conftool/dbconfig/20250708-043814-marostegui.json [production]
2025-07-07 §
16:04 <elukey> restart kafka on kafka1015 (forth and last node without restart in the previous cookbook run) [production]
16:02 <elukey> restart kafka on kafka1014 (second node without restart in the previous cookbook run) [production]
15:59 <elukey> restart kafka on kafka1013 (second node without restart in the previous cookbook run) [production]
15:56 <elukey> restart kafka on kafka1012 (first node without restart in the previous cookbook run) [production]
13:47 <cgoubert@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1069.eqiad.wmnet [production]
13:47 <cgoubert@cumin1003> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1069.eqiad.wmnet [production]
12:35 <akosiaris@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2042.codfw.wmnet [production]
12:35 <akosiaris@cumin1003> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2042.codfw.wmnet [production]
12:34 <akosiaris@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2046.codfw.wmnet [production]
12:34 <akosiaris@cumin1003> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2046.codfw.wmnet [production]
12:03 <akosiaris@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2046.codfw.wmnet [production]
12:03 <akosiaris@cumin1003> START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2046.codfw.wmnet [production]
12:02 <akosiaris@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2042.codfw.wmnet [production]
12:02 <akosiaris@cumin1003> START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2042.codfw.wmnet [production]
11:54 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Depool db2146 T398433', diff saved to https://phabricator.wikimedia.org/P78771 and previous config saved to /var/cache/conftool/dbconfig/20250707-115457-ladsgroup.json [production]
07:53 <marostegui@cumin1002> dbctl commit (dc=all): 'Depool db1237 T397612', diff saved to https://phabricator.wikimedia.org/P78763 and previous config saved to /var/cache/conftool/dbconfig/20250707-075308-root.json [production]
2025-07-03 §
21:18 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti6001.drmrs.wmnet [production]
21:17 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti6001.drmrs.wmnet [production]
13:47 <jmm@cumin1003> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1047.eqiad.wmnet [production]
13:46 <jmm@cumin1003> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1047.eqiad.wmnet [production]
08:42 <jmm@cumin1003> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1048.eqiad.wmnet [production]
08:36 <jmm@cumin1003> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1048.eqiad.wmnet [production]
06:50 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti6003.drmrs.wmnet [production]
06:49 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti6003.drmrs.wmnet [production]
2025-07-02 §
14:31 <jmm@cumin1003> END (FAIL) - Cookbook sre.ganeti.drain-node (exit_code=99) for draining ganeti node ganeti1048.eqiad.wmnet [production]
14:31 <jmm@cumin1003> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1048.eqiad.wmnet [production]
13:28 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti6002.drmrs.wmnet [production]
13:27 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti6002.drmrs.wmnet [production]
09:36 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti6004.drmrs.wmnet [production]
09:35 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti6004.drmrs.wmnet [production]
09:06 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti3006.esams.wmnet [production]
09:04 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti3006.esams.wmnet [production]
06:15 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Depool pc4 T378715', diff saved to https://phabricator.wikimedia.org/P78735 and previous config saved to /var/cache/conftool/dbconfig/20250702-061517-ladsgroup.json [production]
2025-07-01 §
17:02 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti5007.eqsin.wmnet [production]
15:26 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti5007.eqsin.wmnet [production]
15:19 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti5007.eqsin.wmnet [production]
15:17 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti5007.eqsin.wmnet [production]
12:16 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti5006.eqsin.wmnet [production]
10:07 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Depool pc3 T378715', diff saved to https://phabricator.wikimedia.org/P78729 and previous config saved to /var/cache/conftool/dbconfig/20250701-100729-ladsgroup.json [production]
09:53 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti5006.eqsin.wmnet [production]
09:52 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti5006.eqsin.wmnet [production]
09:51 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti5006.eqsin.wmnet [production]
09:50 <jmm@cumin2002> END (FAIL) - Cookbook sre.ganeti.drain-node (exit_code=99) for draining ganeti node ganeti5006.eqsin.wmnet [production]
09:50 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti5006.eqsin.wmnet [production]