9201-9250 of 10000 results (16ms)
2025-05-22 §
05:39 <marostegui@cumin1002> dbctl commit (dc=all): 'Depool db1169', diff saved to https://phabricator.wikimedia.org/P76373 and previous config saved to /var/cache/conftool/dbconfig/20250522-053938-marostegui.json [production]
2025-05-21 §
13:48 <elukey@cumin1002> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host ml-serve1001.eqiad.wmnet [production]
13:48 <elukey@cumin1002> START - Cookbook sre.k8s.pool-depool-node pool for host ml-serve1001.eqiad.wmnet [production]
10:00 <marostegui@cumin1002> dbctl commit (dc=all): 'Depool es2036', diff saved to https://phabricator.wikimedia.org/P76357 and previous config saved to /var/cache/conftool/dbconfig/20250521-100055-marostegui.json [production]
08:34 <elukey@cumin1002> END (FAIL) - Cookbook sre.k8s.pool-depool-node (exit_code=99) depool for host ml-serve1001.eqiad.wmnet [production]
08:34 <elukey@cumin1002> START - Cookbook sre.k8s.pool-depool-node depool for host ml-serve1001.eqiad.wmnet [production]
07:32 <marostegui@cumin1002> dbctl commit (dc=all): 'Depool db1187 T394623', diff saved to https://phabricator.wikimedia.org/P76348 and previous config saved to /var/cache/conftool/dbconfig/20250521-073207-marostegui.json [production]
05:07 <marostegui@cumin1002> dbctl commit (dc=all): 'Depool db1169', diff saved to https://phabricator.wikimedia.org/P76342 and previous config saved to /var/cache/conftool/dbconfig/20250521-050730-marostegui.json [production]
2025-05-20 §
11:25 <cmooney@cumin1003> END (PASS) - Cookbook sre.dns.admin (exit_code=0) DNS admin: depool site codfw [reason: being cautious during maintenance on codfw CRs, T393552] [production]
11:23 <topranks> depool codfw in dns T393552 [production]
11:22 <cmooney@cumin1003> START - Cookbook sre.dns.admin DNS admin: depool site codfw [reason: being cautious during maintenance on codfw CRs, T393552] [production]
05:00 <marostegui@cumin1002> dbctl commit (dc=all): 'Depool db2236 T394653', diff saved to https://phabricator.wikimedia.org/P76319 and previous config saved to /var/cache/conftool/dbconfig/20250520-050017-marostegui.json [production]
2025-05-19 §
12:43 <marostegui@cumin1002> dbctl commit (dc=all): 'Depool db1179 T394661', diff saved to https://phabricator.wikimedia.org/P76301 and previous config saved to /var/cache/conftool/dbconfig/20250519-124302-marostegui.json [production]
11:23 <marostegui@cumin1002> dbctl commit (dc=all): 'Depool db1169 T394653', diff saved to https://phabricator.wikimedia.org/P76294 and previous config saved to /var/cache/conftool/dbconfig/20250519-112356-marostegui.json [production]
06:09 <marostegui@cumin1002> dbctl commit (dc=all): 'Depool db1183 T394507', diff saved to https://phabricator.wikimedia.org/P76285 and previous config saved to /var/cache/conftool/dbconfig/20250519-060946-marostegui.json [production]
05:12 <marostegui@cumin1002> dbctl commit (dc=all): 'Depool db1210 T394508', diff saved to https://phabricator.wikimedia.org/P76280 and previous config saved to /var/cache/conftool/dbconfig/20250519-051224-marostegui.json [production]
2025-05-16 §
13:47 <fceratto@cumin1002> END (PASS) - Cookbook sre.mysql.depool (exit_code=0) db1238 - Depool db1238.eqiad.wmnet to then clone it to db1247.eqiad.wmnet - fceratto@cumin1002 [production]
13:47 <fceratto@cumin1002> START - Cookbook sre.mysql.depool db1238 - Depool db1238.eqiad.wmnet to then clone it to db1247.eqiad.wmnet - fceratto@cumin1002 [production]
11:42 <fceratto@cumin1002> END (PASS) - Cookbook sre.mysql.depool (exit_code=0) db1188 - Depool db1188.eqiad.wmnet to then clone it to db1246.eqiad.wmnet - fceratto@cumin1002 [production]
11:42 <fceratto@cumin1002> START - Cookbook sre.mysql.depool db1188 - Depool db1188.eqiad.wmnet to then clone it to db1246.eqiad.wmnet - fceratto@cumin1002 [production]
06:16 <marostegui@cumin1002> dbctl commit (dc=all): 'Depool es2046 es1044 T391921', diff saved to https://phabricator.wikimedia.org/P76239 and previous config saved to /var/cache/conftool/dbconfig/20250516-061649-marostegui.json [production]
05:07 <marostegui@cumin1002> dbctl commit (dc=all): 'Depool es1046 es2044 T391921', diff saved to https://phabricator.wikimedia.org/P76228 and previous config saved to /var/cache/conftool/dbconfig/20250516-050707-marostegui.json [production]
2025-05-15 §
10:08 <Emperor> depool thanos-fe100[1-3] prior to decom T391352 [production]
08:23 <marostegui@cumin1002> dbctl commit (dc=all): 'Depool db1187 for testing T264016', diff saved to https://phabricator.wikimedia.org/P76202 and previous config saved to /var/cache/conftool/dbconfig/20250515-082333-marostegui.json [production]
07:30 <marostegui@cumin1002> dbctl commit (dc=all): 'Depool es1041 es2043 T391921', diff saved to https://phabricator.wikimedia.org/P76186 and previous config saved to /var/cache/conftool/dbconfig/20250515-073033-marostegui.json [production]
06:50 <marostegui@cumin1002> dbctl commit (dc=all): 'Depool es1045 es2045 T391921', diff saved to https://phabricator.wikimedia.org/P76176 and previous config saved to /var/cache/conftool/dbconfig/20250515-065039-marostegui.json [production]
05:07 <marostegui@cumin1002> dbctl commit (dc=all): 'Depool pc7 T394260', diff saved to https://phabricator.wikimedia.org/P76162 and previous config saved to /var/cache/conftool/dbconfig/20250515-050724-marostegui.json [production]
04:56 <marostegui@cumin1002> dbctl commit (dc=all): 'Depool es1043 es2041 T391921', diff saved to https://phabricator.wikimedia.org/P76159 and previous config saved to /var/cache/conftool/dbconfig/20250515-045658-marostegui.json [production]
2025-05-14 §
07:36 <ayounsi@cumin1002> END (PASS) - Cookbook sre.dns.admin (exit_code=0) DNS admin: depool site esams [reason: esams routers upgrade, T364092] [production]
07:36 <ayounsi@cumin1002> START - Cookbook sre.dns.admin DNS admin: depool site esams [reason: esams routers upgrade, T364092] [production]
07:11 <marostegui@cumin1002> dbctl commit (dc=all): 'Depool es1042 es2042 T391921', diff saved to https://phabricator.wikimedia.org/P76085 and previous config saved to /var/cache/conftool/dbconfig/20250514-071159-marostegui.json [production]
06:17 <marostegui@cumin1002> dbctl commit (dc=all): 'Depool es1034 es2034 T391921', diff saved to https://phabricator.wikimedia.org/P76075 and previous config saved to /var/cache/conftool/dbconfig/20250514-061721-marostegui.json [production]
05:36 <marostegui@cumin1002> END (PASS) - Cookbook sre.mysql.depool (exit_code=0) db1257 - Depool db1257.eqiad.wmnet to then clone it to db1258.eqiad.wmnet - marostegui@cumin1002 [production]
05:36 <marostegui@cumin1002> START - Cookbook sre.mysql.depool db1257 - Depool db1257.eqiad.wmnet to then clone it to db1258.eqiad.wmnet - marostegui@cumin1002 [production]
2025-05-13 §
12:31 <ayounsi@cumin1002> END (PASS) - Cookbook sre.dns.admin (exit_code=0) DNS admin: depool site eqsin [reason: cr3-eqsin upgrade, T364092] [production]
12:31 <ayounsi@cumin1002> START - Cookbook sre.dns.admin DNS admin: depool site eqsin [reason: cr3-eqsin upgrade, T364092] [production]
10:24 <marostegui@cumin1002> dbctl commit (dc=all): 'Depool es1028 es2027 T391921', diff saved to https://phabricator.wikimedia.org/P75988 and previous config saved to /var/cache/conftool/dbconfig/20250513-102455-marostegui.json [production]
05:16 <marostegui@cumin1002> dbctl commit (dc=all): 'Depool es1031 es2029 T391921', diff saved to https://phabricator.wikimedia.org/P75969 and previous config saved to /var/cache/conftool/dbconfig/20250513-051617-marostegui.json [production]
2025-05-12 §
15:13 <elukey@cumin1002> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host kubestage2001.codfw.wmnet [production]
15:13 <elukey@cumin1002> START - Cookbook sre.k8s.pool-depool-node pool for host kubestage2001.codfw.wmnet [production]
15:12 <elukey@cumin1002> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host kubestage2001.codfw.wmnet [production]
15:12 <elukey@cumin1002> START - Cookbook sre.k8s.pool-depool-node depool for host kubestage2001.codfw.wmnet [production]
14:58 <elukey@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host kubestage2001.codfw.wmnet [production]
14:58 <elukey@cumin1003> START - Cookbook sre.k8s.pool-depool-node pool for host kubestage2001.codfw.wmnet [production]
14:57 <elukey@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host kubestage2001.codfw.wmnet [production]
14:57 <elukey@cumin1003> START - Cookbook sre.k8s.pool-depool-node depool for host kubestage2001.codfw.wmnet [production]
2025-05-08 §
07:06 <jmm@cumin2002> END (FAIL) - Cookbook sre.ganeti.drain-node (exit_code=99) for draining ganeti node ganeti2034.codfw.wmnet [production]
07:06 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti2034.codfw.wmnet [production]
06:56 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti2032.codfw.wmnet [production]
06:45 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti2032.codfw.wmnet [production]