9451-9500 of 10000 results (15ms)
2025-04-02 §
07:29 <fabfur> depool cp7001 to fix stale ocsp alert (T384227) [production]
2025-04-01 §
13:48 <elukey> depool registry2005 to investigate some nginx logging issue [production]
11:05 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti4008.ulsfo.wmnet [production]
09:00 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti4008.ulsfo.wmnet [production]
08:59 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti4008.ulsfo.wmnet [production]
08:56 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti4008.ulsfo.wmnet [production]
2025-03-31 §
14:25 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti4007.ulsfo.wmnet [production]
13:00 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti4007.ulsfo.wmnet [production]
12:59 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti4007.ulsfo.wmnet [production]
12:58 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti4007.ulsfo.wmnet [production]
11:32 <cgoubert@cumin1002> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) check for host wikikube-worker1039.eqiad.wmnet [production]
11:32 <cgoubert@cumin1002> START - Cookbook sre.k8s.pool-depool-node check for host wikikube-worker1039.eqiad.wmnet [production]
09:55 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti4006.ulsfo.wmnet [production]
08:48 <marostegui@cumin1002> END (PASS) - Cookbook sre.mysql.depool (exit_code=0) db1211 - Depool db1211.eqiad.wmnet to then clone it to db1256.eqiad.wmnet - marostegui@cumin1002 [production]
08:48 <marostegui@cumin1002> START - Cookbook sre.mysql.depool db1211 - Depool db1211.eqiad.wmnet to then clone it to db1256.eqiad.wmnet - marostegui@cumin1002 [production]
07:49 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti4006.ulsfo.wmnet [production]
07:48 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti4006.ulsfo.wmnet [production]
07:46 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti4006.ulsfo.wmnet [production]
2025-03-29 §
15:42 <oblivian@cumin1002> END (FAIL) - Cookbook sre.discovery.service-route (exit_code=99) depool swift in eqiad: maintenance [production]
15:37 <oblivian@cumin1002> START - Cookbook sre.discovery.service-route depool swift in eqiad: maintenance [production]
2025-03-27 §
08:40 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti4005.ulsfo.wmnet [production]
07:37 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti4005.ulsfo.wmnet [production]
07:30 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti4005.ulsfo.wmnet [production]
07:30 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti4005.ulsfo.wmnet [production]
2025-03-26 §
14:05 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti-test2003.codfw.wmnet [production]
13:38 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti-test2003.codfw.wmnet [production]
13:36 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti-test2003.codfw.wmnet [production]
13:34 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti-test2003.codfw.wmnet [production]
13:34 <jmm@cumin2002> END (FAIL) - Cookbook sre.ganeti.drain-node (exit_code=99) for draining ganeti node ganeti-test2002.codfw.wmnet [production]
13:34 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti-test2002.codfw.wmnet [production]
10:49 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti-test2002.codfw.wmnet [production]
10:23 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti-test2002.codfw.wmnet [production]
10:22 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti-test2002.codfw.wmnet [production]
10:22 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti-test2002.codfw.wmnet [production]
10:22 <jmm@cumin2002> END (FAIL) - Cookbook sre.ganeti.drain-node (exit_code=99) for draining ganeti node ganeti-test2002.codfw.wmnet [production]
10:22 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti-test2002.codfw.wmnet [production]
06:50 <marostegui@cumin1002> dbctl commit (dc=all): 'Depool db2181 T381475', diff saved to https://phabricator.wikimedia.org/P74423 and previous config saved to /var/cache/conftool/dbconfig/20250326-065037-marostegui.json [production]
06:13 <marostegui@cumin1002> dbctl commit (dc=all): 'Depool db2220', diff saved to https://phabricator.wikimedia.org/P74419 and previous config saved to /var/cache/conftool/dbconfig/20250326-061320-marostegui.json [production]
2025-03-25 §
15:32 <pt1979@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: updare frack node to use new mgmt subnet 10.195.1.1/25 - pt1979@cumin2002" [production]
15:32 <pt1979@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: updare frack node to use new mgmt subnet 10.195.1.1/25 - pt1979@cumin2002" [production]
11:05 <fceratto@cumin1002> dbctl commit (dc=all): 'Depool db2220 T389383', diff saved to https://phabricator.wikimedia.org/P74392 and previous config saved to /var/cache/conftool/dbconfig/20250325-110505-fceratto.json [production]
10:12 <fceratto@cumin1002> dbctl commit (dc=all): 'Depool db2192 T389381', diff saved to https://phabricator.wikimedia.org/P74376 and previous config saved to /var/cache/conftool/dbconfig/20250325-101222-fceratto.json [production]
09:58 <marostegui@cumin1002> dbctl commit (dc=all): 'Depool ms1 T387332', diff saved to https://phabricator.wikimedia.org/P74372 and previous config saved to /var/cache/conftool/dbconfig/20250325-095817-marostegui.json [production]
2025-03-24 §
17:30 <pt1979@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: updare frack node to use new mgmt subnet 10.195.1.1/25 - pt1979@cumin2002" [production]
17:30 <pt1979@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: updare frack node to use new mgmt subnet 10.195.1.1/25 - pt1979@cumin2002" [production]
14:51 <marostegui@cumin1002> dbctl commit (dc=all): 'Depool db2179 T389378', diff saved to https://phabricator.wikimedia.org/P74349 and previous config saved to /var/cache/conftool/dbconfig/20250324-145100-marostegui.json [production]
13:45 <marostegui@cumin1002> dbctl commit (dc=all): 'Depool db2196 T389795', diff saved to https://phabricator.wikimedia.org/P74340 and previous config saved to /var/cache/conftool/dbconfig/20250324-134500-marostegui.json [production]
12:31 <fceratto@cumin1002> END (PASS) - Cookbook sre.mysql.depool (exit_code=0) db2205 - Depool db2227.codfw.wmnet to then clone it to db2205.codfw.wmnet - fceratto@cumin1002 [production]
12:31 <fceratto@cumin1002> START - Cookbook sre.mysql.depool db2205 - Depool db2227.codfw.wmnet to then clone it to db2205.codfw.wmnet - fceratto@cumin1002 [production]
12:12 <fceratto@cumin1002> dbctl commit (dc=all): 'Depool db2205 T389377', diff saved to https://phabricator.wikimedia.org/P74335 and previous config saved to /var/cache/conftool/dbconfig/20250324-121227-fceratto.json [production]