9501-9550 of 10000 results (9ms)
2025-03-24 §
11:46 <fceratto@cumin1002> END (PASS) - Cookbook sre.mysql.depool (exit_code=0) db2212 - Depool db2188.codfw.wmnet to then clone it to db2212.codfw.wmnet - fceratto@cumin1002 [production]
11:46 <fceratto@cumin1002> START - Cookbook sre.mysql.depool db2212 - Depool db2188.codfw.wmnet to then clone it to db2212.codfw.wmnet - fceratto@cumin1002 [production]
11:11 <fceratto@cumin1002> dbctl commit (dc=all): 'Depool db2212 T389373', diff saved to https://phabricator.wikimedia.org/P74324 and previous config saved to /var/cache/conftool/dbconfig/20250324-111157-fceratto.json [production]
07:16 <marostegui@cumin1002> END (PASS) - Cookbook sre.mysql.depool (exit_code=0) db2214 - Depool db2169.codfw.wmnet to then clone it to db2214.codfw.wmnet - marostegui@cumin1002 [production]
07:16 <marostegui@cumin1002> START - Cookbook sre.mysql.depool db2214 - Depool db2169.codfw.wmnet to then clone it to db2214.codfw.wmnet - marostegui@cumin1002 [production]
07:02 <marostegui@cumin1002> dbctl commit (dc=all): 'Depool db2214 T389382', diff saved to https://phabricator.wikimedia.org/P74309 and previous config saved to /var/cache/conftool/dbconfig/20250324-070245-marostegui.json [production]
06:23 <marostegui@cumin1002> dbctl commit (dc=all): 'Depool db2204 T389376', diff saved to https://phabricator.wikimedia.org/P74306 and previous config saved to /var/cache/conftool/dbconfig/20250324-062338-marostegui.json [production]
2025-03-20 §
22:38 <sukhe> depool dns1005 to debug zone files not in sync with dns.git [production]
15:47 <moritzm> installing node-postcss security updates [production]
13:29 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti-test2001.codfw.wmnet [production]
13:14 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti-test2001.codfw.wmnet [production]
13:11 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti-test2001.codfw.wmnet [production]
13:11 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti-test2001.codfw.wmnet [production]
12:55 <jmm@cumin2002> END (FAIL) - Cookbook sre.ganeti.drain-node (exit_code=99) for draining ganeti node ganeti-test2001.codfw.wmnet [production]
12:55 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti-test2001.codfw.wmnet [production]
09:34 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti5004.eqsin.wmnet [production]
09:32 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti5004.eqsin.wmnet [production]
08:48 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti5007.eqsin.wmnet [production]
08:45 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti5007.eqsin.wmnet [production]
08:09 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti5006.eqsin.wmnet [production]
08:07 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti5006.eqsin.wmnet [production]
07:32 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti5005.eqsin.wmnet [production]
07:31 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti5005.eqsin.wmnet [production]
06:41 <marostegui@cumin1002> dbctl commit (dc=all): 'Depool db2165 T389367', diff saved to https://phabricator.wikimedia.org/P74270 and previous config saved to /var/cache/conftool/dbconfig/20250320-064131-marostegui.json [production]
2025-03-19 §
11:54 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti7003.magru.wmnet [production]
11:52 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti7003.magru.wmnet [production]
10:49 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti7001.magru.wmnet [production]
10:48 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti7001.magru.wmnet [production]
2025-03-18 §
15:34 <hnowlan@cumin2002> END (PASS) - Cookbook sre.discovery.datacenter (exit_code=0) depool all services in codfw: Datacenter Switchover - T385155 [production]
15:05 <hnowlan@cumin2002> START - Cookbook sre.discovery.datacenter depool all services in codfw: Datacenter Switchover - T385155 [production]
14:42 <hnowlan@cumin2002> END (PASS) - Cookbook sre.dns.admin (exit_code=0) DNS admin: depool site codfw [reason: Datacentre switchover, T387444] [production]
14:42 <hnowlan@cumin2002> START - Cookbook sre.dns.admin DNS admin: depool site codfw [reason: Datacentre switchover, T387444] [production]
14:42 <hnowlan@cumin2002> END (FAIL) - Cookbook sre.dns.admin (exit_code=99) DNS admin: depool site codfw [reason: no reason specified, no task ID specified] [production]
14:41 <hnowlan@cumin2002> START - Cookbook sre.dns.admin DNS admin: depool site codfw [reason: no reason specified, no task ID specified] [production]
2025-03-17 §
13:47 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1029.eqiad.wmnet [production]
13:47 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1029.eqiad.wmnet [production]
13:45 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1029.eqiad.wmnet [production]
2025-03-13 §
19:42 <cwhite@cumin2002> dbctl commit (dc=all): 'depool db1245', diff saved to https://phabricator.wikimedia.org/P74224 and previous config saved to /var/cache/conftool/dbconfig/20250313-194204-cwhite.json [production]
07:41 <vgutierrez> depool lvs6001 before being reimaged - T384477 [production]
2025-03-12 §
15:20 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1034.eqiad.wmnet [production]
12:27 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1034.eqiad.wmnet [production]
12:24 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1034.eqiad.wmnet [production]
12:23 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1034.eqiad.wmnet [production]
12:23 <jmm@cumin2002> END (FAIL) - Cookbook sre.ganeti.drain-node (exit_code=99) for draining ganeti node ganeti1034.eqiad.wmnet [production]
12:22 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1034.eqiad.wmnet [production]
2025-03-11 §
12:37 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1037.eqiad.wmnet [production]
08:59 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1037.eqiad.wmnet [production]
08:52 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1037.eqiad.wmnet [production]
08:50 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1037.eqiad.wmnet [production]
2025-03-10 §
11:55 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1028.eqiad.wmnet [production]