3601-3650 of 10000 results (42ms)
2025-02-06 ยง
20:26 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.safe_reboot (exit_code=0) on hosts matched by 'D{cloudvirt1044.eqiad.wmnet}' [admin]
20:25 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.safe_reboot on hosts matched by 'D{cloudvirt1051.eqiad.wmnet}' [admin]
20:25 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.safe_reboot (exit_code=0) on hosts matched by 'D{cloudvirt1052.eqiad.wmnet}' [admin]
20:24 <marostegui@cumin1002> dbctl commit (dc=all): 'db2213 (re)pooling @ 50%: Repooling', diff saved to https://phabricator.wikimedia.org/P73345 and previous config saved to /var/cache/conftool/dbconfig/20250206-202426-root.json [production]
20:21 <pt1979@cumin1002> START - Cookbook sre.hosts.provision for host ganeti1054.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
20:09 <marostegui@cumin1002> dbctl commit (dc=all): 'db2213 (re)pooling @ 25%: Repooling', diff saved to https://phabricator.wikimedia.org/P73344 and previous config saved to /var/cache/conftool/dbconfig/20250206-200921-root.json [production]
20:04 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.safe_reboot on hosts matched by 'D{cloudvirt1052.eqiad.wmnet}' [admin]
20:04 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.safe_reboot (exit_code=0) on hosts matched by 'D{cloudvirt1053.eqiad.wmnet}' [admin]
20:04 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.safe_reboot on hosts matched by 'D{cloudvirt1044.eqiad.wmnet}' [admin]
20:04 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.safe_reboot (exit_code=0) on hosts matched by 'D{cloudvirt1045.eqiad.wmnet}' [admin]
19:54 <marostegui@cumin1002> dbctl commit (dc=all): 'db2213 (re)pooling @ 10%: Repooling', diff saved to https://phabricator.wikimedia.org/P73343 and previous config saved to /var/cache/conftool/dbconfig/20250206-195417-root.json [production]
19:52 <marostegui@cumin1002> dbctl commit (dc=all): 'Depool db2213', diff saved to https://phabricator.wikimedia.org/P73342 and previous config saved to /var/cache/conftool/dbconfig/20250206-195250-marostegui.json [production]
19:52 <marostegui@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2213.codfw.wmnet with reason: maintenance [production]
19:48 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.safe_reboot on hosts matched by 'D{cloudvirt1053.eqiad.wmnet}' [admin]
19:48 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.safe_reboot (exit_code=0) on hosts matched by 'D{cloudvirt1054.eqiad.wmnet}' [admin]
19:42 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.safe_reboot on hosts matched by 'D{cloudvirt1045.eqiad.wmnet}' [admin]
19:42 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.safe_reboot (exit_code=0) on hosts matched by 'D{cloudvirt1046.eqiad.wmnet}' [admin]
19:32 <sukhe> sudo cumin 'A:cumin' 'run-puppet-agent' [production]
19:24 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.safe_reboot on hosts matched by 'D{cloudvirt1054.eqiad.wmnet}' [admin]
19:24 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.safe_reboot (exit_code=0) on hosts matched by 'D{cloudvirt1055.eqiad.wmnet}' [admin]
19:19 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.safe_reboot on hosts matched by 'D{cloudvirt1046.eqiad.wmnet}' [admin]
19:19 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.safe_reboot (exit_code=0) on hosts matched by 'D{cloudvirt1047.eqiad.wmnet}' [admin]
19:19 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.safe_reboot on hosts matched by 'D{cloudvirt1055.eqiad.wmnet}' [admin]
19:19 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.safe_reboot (exit_code=0) on hosts matched by 'D{cloudvirt1056.eqiad.wmnet}' [admin]
19:05 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1033.eqiad.wmnet [production]
19:03 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.safe_reboot on hosts matched by 'D{cloudvirt1047.eqiad.wmnet}' [admin]
19:02 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.safe_reboot (exit_code=0) on hosts matched by 'D{cloudvirt1048.eqiad.wmnet}' [admin]
19:02 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.safe_reboot on hosts matched by 'D{cloudvirt1056.eqiad.wmnet}' [admin]
19:02 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.safe_reboot (exit_code=0) on hosts matched by 'D{cloudvirt1057.eqiad.wmnet}' [admin]
18:44 <marostegui@cumin1002> dbctl commit (dc=all): 'db2159 (re)pooling @ 100%: Repooling after rebuild index', diff saved to https://phabricator.wikimedia.org/P73339 and previous config saved to /var/cache/conftool/dbconfig/20250206-184451-root.json [production]
18:42 <cdanis@deploy2002> Finished scap sync-world: Backport for [[gerrit:1117945|Route PHP8 Excimer profiles to separate ArcLamp sinks (T383845 T385395 T385199)]] (duration: 10m 58s) [production]
18:41 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.safe_reboot on hosts matched by 'D{cloudvirt1057.eqiad.wmnet}' [admin]
18:41 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.safe_reboot (exit_code=0) on hosts matched by 'D{cloudvirt1058.eqiad.wmnet}' [admin]
18:40 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.safe_reboot on hosts matched by 'D{cloudvirt1048.eqiad.wmnet}' [admin]
18:40 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.safe_reboot (exit_code=0) on hosts matched by 'D{cloudvirt1049.eqiad.wmnet}' [admin]
18:34 <cdanis@deploy2002> cdanis: Continuing with sync [production]
18:33 <cdanis@deploy2002> cdanis: Backport for [[gerrit:1117945|Route PHP8 Excimer profiles to separate ArcLamp sinks (T383845 T385395 T385199)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
18:31 <cdanis@deploy2002> Started scap sync-world: Backport for [[gerrit:1117945|Route PHP8 Excimer profiles to separate ArcLamp sinks (T383845 T385395 T385199)]] [production]
18:29 <marostegui@cumin1002> dbctl commit (dc=all): 'db2159 (re)pooling @ 75%: Repooling after rebuild index', diff saved to https://phabricator.wikimedia.org/P73338 and previous config saved to /var/cache/conftool/dbconfig/20250206-182946-root.json [production]
18:28 <andrew@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cloudnet2008-dev.codfw.wmnet [production]
18:22 <andrew@cumin1002> START - Cookbook sre.hosts.reboot-single for host cloudnet2008-dev.codfw.wmnet [production]
18:21 <andrew@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cloudnet2007-dev.codfw.wmnet [production]
18:21 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.safe_reboot on hosts matched by 'D{cloudvirt1049.eqiad.wmnet}' [admin]
18:21 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.safe_reboot (exit_code=0) on hosts matched by 'D{cloudvirt1060.eqiad.wmnet}' [admin]
18:19 <wmbot~bd808@tools-bastion-12> Update public_html/toolinfo.json [tools.extreg-wos]
18:15 <andrew@cumin1002> START - Cookbook sre.hosts.reboot-single for host cloudnet2007-dev.codfw.wmnet [production]
18:15 <andrew@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cloudnet2006-dev.codfw.wmnet [production]
18:14 <marostegui@cumin1002> dbctl commit (dc=all): 'db2159 (re)pooling @ 50%: Repooling after rebuild index', diff saved to https://phabricator.wikimedia.org/P73337 and previous config saved to /var/cache/conftool/dbconfig/20250206-181441-root.json [production]
18:13 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.safe_reboot on hosts matched by 'D{cloudvirt1058.eqiad.wmnet}' [admin]
18:13 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.safe_reboot (exit_code=0) on hosts matched by 'D{cloudvirt1059.eqiad.wmnet}' [admin]