1751-1800 of 10000 results (33ms)
2024-06-21 ยง
07:54 <arnaudb@cumin1002> dbctl commit (dc=all): 'db1206 (re)pooling @ 100%: repool to fill up vslow/dump', diff saved to https://phabricator.wikimedia.org/P65297 and previous config saved to /var/cache/conftool/dbconfig/20240621-075404-arnaudb.json [production]
07:38 <arnaudb@cumin1002> dbctl commit (dc=all): 'db1206 (re)pooling @ 75%: repool to fill up vslow/dump', diff saved to https://phabricator.wikimedia.org/P65296 and previous config saved to /var/cache/conftool/dbconfig/20240621-073858-arnaudb.json [production]
07:23 <arnaudb@cumin1002> dbctl commit (dc=all): 'db1206 (re)pooling @ 50%: repool to fill up vslow/dump', diff saved to https://phabricator.wikimedia.org/P65295 and previous config saved to /var/cache/conftool/dbconfig/20240621-072353-arnaudb.json [production]
07:08 <arnaudb@cumin1002> dbctl commit (dc=all): 'db1206 (re)pooling @ 25%: repool to fill up vslow/dump', diff saved to https://phabricator.wikimedia.org/P65294 and previous config saved to /var/cache/conftool/dbconfig/20240621-070847-arnaudb.json [production]
07:03 <arnaudb@cumin1002> dbctl commit (dc=all): 'db1206 depool for debugging T368098', diff saved to https://phabricator.wikimedia.org/P65293 and previous config saved to /var/cache/conftool/dbconfig/20240621-070358-arnaudb.json [production]
04:51 <marostegui@cumin1002> dbctl commit (dc=all): 'Depooling db2162 (T364069)', diff saved to https://phabricator.wikimedia.org/P65292 and previous config saved to /var/cache/conftool/dbconfig/20240621-045107-marostegui.json [production]
04:51 <marostegui@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2162.codfw.wmnet with reason: Maintenance [production]
04:50 <marostegui@cumin1002> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2162.codfw.wmnet with reason: Maintenance [production]
04:50 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2161 (T364069)', diff saved to https://phabricator.wikimedia.org/P65291 and previous config saved to /var/cache/conftool/dbconfig/20240621-045044-marostegui.json [production]
04:45 <marostegui@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2197.codfw.wmnet with reason: Maintenance [production]
04:45 <marostegui@cumin1002> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2197.codfw.wmnet with reason: Maintenance [production]
04:44 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2193 (T367856)', diff saved to https://phabricator.wikimedia.org/P65290 and previous config saved to /var/cache/conftool/dbconfig/20240621-044455-marostegui.json [production]
04:35 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2161', diff saved to https://phabricator.wikimedia.org/P65289 and previous config saved to /var/cache/conftool/dbconfig/20240621-043537-marostegui.json [production]
04:29 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2193', diff saved to https://phabricator.wikimedia.org/P65288 and previous config saved to /var/cache/conftool/dbconfig/20240621-042948-marostegui.json [production]
04:21 <andrew@cloudcumin1001> END (FAIL) - Cookbook wmcs.openstack.migrate_server_to_ovs (exit_code=99) for server 4e612eb8-04e1-4541-941d-a05519eed60a [admin]
04:20 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2161', diff saved to https://phabricator.wikimedia.org/P65287 and previous config saved to /var/cache/conftool/dbconfig/20240621-042030-marostegui.json [production]
04:15 <andrew@cloudcumin1001> END (FAIL) - Cookbook wmcs.openstack.migrate_dbinstance_to_ovs (exit_code=99) for server tbd [reading-web-staging]
04:14 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2193', diff saved to https://phabricator.wikimedia.org/P65286 and previous config saved to /var/cache/conftool/dbconfig/20240621-041441-marostegui.json [production]
04:14 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.migrate_server_to_ovs for server 4e612eb8-04e1-4541-941d-a05519eed60a [admin]
04:08 <andrew@cloudcumin1001> END (FAIL) - Cookbook wmcs.openstack.migrate_dbinstance_to_ovs (exit_code=99) for server tbd [checkuser-beta-wiki]
04:05 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2161 (T364069)', diff saved to https://phabricator.wikimedia.org/P65285 and previous config saved to /var/cache/conftool/dbconfig/20240621-040523-marostegui.json [production]
03:59 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2193 (T367856)', diff saved to https://phabricator.wikimedia.org/P65284 and previous config saved to /var/cache/conftool/dbconfig/20240621-035934-marostegui.json [production]
03:58 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.migrate_dbinstance_to_ovs for server tbd [checkuser-beta-wiki]
03:58 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.migrate_dbinstance_to_ovs for server tbd [reading-web-staging]
03:54 <andrew@cloudcumin1001> END (FAIL) - Cookbook wmcs.openstack.migrate_dbinstance_to_ovs (exit_code=99) for server tbd [checkuser-beta-wiki]
03:48 <andrew@cloudcumin1001> END (FAIL) - Cookbook wmcs.openstack.migrate_dbinstance_to_ovs (exit_code=99) for server tbd [reading-web-staging]
03:43 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.migrate_dbinstance_to_ovs for server tbd [checkuser-beta-wiki]
03:43 <andrew@cloudcumin1001> END (FAIL) - Cookbook wmcs.openstack.migrate_dbinstance_to_ovs (exit_code=99) for server tbd [checkuser-beta-wiki]
03:36 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.migrate_dbinstance_to_ovs for server tbd [checkuser-beta-wiki]
03:34 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.migrate_dbinstance_to_ovs for server tbd [reading-web-staging]
03:33 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.migrate_dbinstance_to_ovs (exit_code=0) for server tbd [library-upgrader]
03:32 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.migrate_dbinstance_to_ovs (exit_code=0) for server tbd [osmit]
03:23 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.migrate_dbinstance_to_ovs for server tbd [library-upgrader]
03:18 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.migrate_dbinstance_to_ovs (exit_code=0) for server tbd [pm20database]
03:14 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.migrate_dbinstance_to_ovs for server tbd [osmit]
03:13 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.migrate_dbinstance_to_ovs (exit_code=0) for server tbd [hoiscript]
03:12 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.migrate_dbinstance_to_ovs for server tbd [pm20database]
03:11 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.migrate_dbinstance_to_ovs (exit_code=0) for server tbd [toolsbeta]
03:07 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.migrate_dbinstance_to_ovs for server tbd [hoiscript]
03:04 <ejegg> fundraising civicrm upgraded from 2e1db811 to 8a0b5bea [production]
03:03 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.migrate_dbinstance_to_ovs (exit_code=0) for server tbd [copypatrol]
02:59 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.migrate_dbinstance_to_ovs for server tbd [toolsbeta]
02:58 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.migrate_dbinstance_to_ovs (exit_code=0) for server tbd [copypatrol]
02:51 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.migrate_dbinstance_to_ovs for server tbd [copypatrol]
02:51 <andrew@cloudcumin1001> END (ERROR) - Cookbook wmcs.openstack.migrate_dbinstance_to_ovs (exit_code=97) for server tbd [maps]
02:50 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.migrate_dbinstance_to_ovs for server tbd [copypatrol]
02:46 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.migrate_dbinstance_to_ovs for server tbd [maps]
02:43 <andrew@cloudcumin1001> END (FAIL) - Cookbook wmcs.openstack.migrate_dbinstance_to_ovs (exit_code=99) for server tbd [quarry]
02:36 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.migrate_dbinstance_to_ovs for server tbd [quarry]
02:28 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.migrate_dbinstance_to_ovs (exit_code=0) for server tbd [quarry]