1-50 of 10000 results (94ms)
2025-08-16 ยง
23:57 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2172 (T400854)', diff saved to https://phabricator.wikimedia.org/P81389 and previous config saved to /var/cache/conftool/dbconfig/20250816-235708-ladsgroup.json [production]
23:52 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Depooling db2172 (T400854)', diff saved to https://phabricator.wikimedia.org/P81388 and previous config saved to /var/cache/conftool/dbconfig/20250816-235253-ladsgroup.json [production]
23:52 <ladsgroup@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2172.codfw.wmnet with reason: Maintenance [production]
23:52 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2155 (T400854)', diff saved to https://phabricator.wikimedia.org/P81387 and previous config saved to /var/cache/conftool/dbconfig/20250816-235229-ladsgroup.json [production]
23:37 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2155', diff saved to https://phabricator.wikimedia.org/P81386 and previous config saved to /var/cache/conftool/dbconfig/20250816-233722-ladsgroup.json [production]
23:22 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2155', diff saved to https://phabricator.wikimedia.org/P81385 and previous config saved to /var/cache/conftool/dbconfig/20250816-232214-ladsgroup.json [production]
23:07 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2155 (T400854)', diff saved to https://phabricator.wikimedia.org/P81384 and previous config saved to /var/cache/conftool/dbconfig/20250816-230707-ladsgroup.json [production]
23:02 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Depooling db2155 (T400854)', diff saved to https://phabricator.wikimedia.org/P81383 and previous config saved to /var/cache/conftool/dbconfig/20250816-230254-ladsgroup.json [production]
23:02 <ladsgroup@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2155.codfw.wmnet with reason: Maintenance [production]
23:02 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2147 (T400854)', diff saved to https://phabricator.wikimedia.org/P81382 and previous config saved to /var/cache/conftool/dbconfig/20250816-230231-ladsgroup.json [production]
22:47 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2147', diff saved to https://phabricator.wikimedia.org/P81381 and previous config saved to /var/cache/conftool/dbconfig/20250816-224723-ladsgroup.json [production]
22:32 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2147', diff saved to https://phabricator.wikimedia.org/P81380 and previous config saved to /var/cache/conftool/dbconfig/20250816-223215-ladsgroup.json [production]
22:17 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2147 (T400854)', diff saved to https://phabricator.wikimedia.org/P81379 and previous config saved to /var/cache/conftool/dbconfig/20250816-221708-ladsgroup.json [production]
22:12 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Depooling db2147 (T400854)', diff saved to https://phabricator.wikimedia.org/P81378 and previous config saved to /var/cache/conftool/dbconfig/20250816-221254-ladsgroup.json [production]
22:12 <ladsgroup@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2147.codfw.wmnet with reason: Maintenance [production]
01:34 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2240 (T399249)', diff saved to https://phabricator.wikimedia.org/P81377 and previous config saved to /var/cache/conftool/dbconfig/20250816-013415-fceratto.json [production]
01:24 <jhancock@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host es2055.codfw.wmnet with OS bookworm [production]
01:19 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2240', diff saved to https://phabricator.wikimedia.org/P81376 and previous config saved to /var/cache/conftool/dbconfig/20250816-011908-fceratto.json [production]
01:14 <jhancock@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on es2055.codfw.wmnet with reason: host reimage [production]
01:11 <jhancock@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host es2052.codfw.wmnet with OS bookworm [production]
01:11 <jhancock@cumin1003> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin1003" [production]
01:11 <jhancock@cumin1003> START - Cookbook sre.hosts.downtime for 2:00:00 on es2055.codfw.wmnet with reason: host reimage [production]
01:10 <jhancock@cumin1003> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin1003" [production]
01:08 <jhancock@cumin1003> START - Cookbook sre.hosts.reimage for host es2055.codfw.wmnet with OS bookworm [production]
01:04 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2240', diff saved to https://phabricator.wikimedia.org/P81375 and previous config saved to /var/cache/conftool/dbconfig/20250816-010400-fceratto.json [production]
01:03 <jhancock@cumin1003> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host es2055.codfw.wmnet with OS bookworm [production]
01:00 <jhancock@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host es2053.codfw.wmnet with OS bookworm [production]
01:00 <jhancock@cumin1003> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin1003" [production]
01:00 <jhancock@cumin1003> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin1003" [production]
00:54 <jhancock@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host es2056.codfw.wmnet with OS bookworm [production]
00:54 <jhancock@cumin1003> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin1003" [production]
00:53 <jhancock@cumin1003> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin1003" [production]
00:53 <jhancock@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host es2054.codfw.wmnet with OS bookworm [production]
00:53 <jhancock@cumin1003> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin1003" [production]
00:53 <jhancock@cumin1003> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin1003" [production]
00:52 <jhancock@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on es2052.codfw.wmnet with reason: host reimage [production]
00:51 <jhancock@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host es2057.codfw.wmnet with OS bookworm [production]
00:51 <jhancock@cumin1003> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin1003" [production]
00:50 <jhancock@cumin1003> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin1003" [production]
00:48 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2240 (T399249)', diff saved to https://phabricator.wikimedia.org/P81374 and previous config saved to /var/cache/conftool/dbconfig/20250816-004852-fceratto.json [production]
00:48 <jhancock@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host es2051.codfw.wmnet with OS bookworm [production]
00:48 <jhancock@cumin1003> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin1003" [production]
00:47 <jhancock@cumin1003> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin1003" [production]
00:45 <jhancock@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on es2055.codfw.wmnet with reason: host reimage [production]
00:41 <jhancock@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on es2053.codfw.wmnet with reason: host reimage [production]
00:38 <jhancock@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on es2056.codfw.wmnet with reason: host reimage [production]
00:34 <jhancock@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on es2054.codfw.wmnet with reason: host reimage [production]
00:32 <jhancock@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on es2057.codfw.wmnet with reason: host reimage [production]
00:28 <jhancock@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on es2051.codfw.wmnet with reason: host reimage [production]
00:26 <jhancock@cumin1003> START - Cookbook sre.hosts.downtime for 2:00:00 on es2057.codfw.wmnet with reason: host reimage [production]