201-250 of 10000 results (25ms)
2026-01-10 ยง
21:50 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2210 (T411163 T411164)', diff saved to https://phabricator.wikimedia.org/P87080 and previous config saved to /var/cache/conftool/dbconfig/20260110-215037-marostegui.json [production]
21:48 <taavi> reload zuul for https://gerrit.wikimedia.org/r/1224782 [releng]
21:47 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2156', diff saved to https://phabricator.wikimedia.org/P87079 and previous config saved to /var/cache/conftool/dbconfig/20260110-214708-marostegui.json [production]
21:40 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2210', diff saved to https://phabricator.wikimedia.org/P87078 and previous config saved to /var/cache/conftool/dbconfig/20260110-214023-marostegui.json [production]
21:38 <marostegui@cumin1003> dbctl commit (dc=all): 'Depooling db1189 (T413525)', diff saved to https://phabricator.wikimedia.org/P87077 and previous config saved to /var/cache/conftool/dbconfig/20260110-213801-marostegui.json [production]
21:37 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1189.eqiad.wmnet with reason: Maintenance [production]
21:37 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1175 (T413525)', diff saved to https://phabricator.wikimedia.org/P87076 and previous config saved to /var/cache/conftool/dbconfig/20260110-213736-marostegui.json [production]
21:37 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2156 (T413525)', diff saved to https://phabricator.wikimedia.org/P87075 and previous config saved to /var/cache/conftool/dbconfig/20260110-213700-marostegui.json [production]
21:30 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2210', diff saved to https://phabricator.wikimedia.org/P87074 and previous config saved to /var/cache/conftool/dbconfig/20260110-213015-marostegui.json [production]
21:27 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1175', diff saved to https://phabricator.wikimedia.org/P87073 and previous config saved to /var/cache/conftool/dbconfig/20260110-212728-marostegui.json [production]
21:20 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2210 (T411163 T411164)', diff saved to https://phabricator.wikimedia.org/P87072 and previous config saved to /var/cache/conftool/dbconfig/20260110-212006-marostegui.json [production]
21:17 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1175', diff saved to https://phabricator.wikimedia.org/P87071 and previous config saved to /var/cache/conftool/dbconfig/20260110-211720-marostegui.json [production]
21:07 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1175 (T413525)', diff saved to https://phabricator.wikimedia.org/P87070 and previous config saved to /var/cache/conftool/dbconfig/20260110-210711-marostegui.json [production]
20:56 <andrewbogott> in codfw1dev: openstack role add --project swift --user swift member [admin]
20:56 <andrewbogott> in codfw1dev: openstack role add --project swift --user swift admin [admin]
20:52 <marostegui@cumin1003> dbctl commit (dc=all): 'Depooling db1175 (T413525)', diff saved to https://phabricator.wikimedia.org/P87069 and previous config saved to /var/cache/conftool/dbconfig/20260110-205226-marostegui.json [production]
20:52 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1175.eqiad.wmnet with reason: Maintenance [production]
20:52 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1166 (T413525)', diff saved to https://phabricator.wikimedia.org/P87068 and previous config saved to /var/cache/conftool/dbconfig/20260110-205201-marostegui.json [production]
20:48 <marostegui@cumin1003> dbctl commit (dc=all): 'Depooling db2156 (T413525)', diff saved to https://phabricator.wikimedia.org/P87067 and previous config saved to /var/cache/conftool/dbconfig/20260110-204804-marostegui.json [production]
20:47 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2156.codfw.wmnet with reason: Maintenance [production]
20:47 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2149 (T413525)', diff saved to https://phabricator.wikimedia.org/P87066 and previous config saved to /var/cache/conftool/dbconfig/20260110-204739-marostegui.json [production]
20:41 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1166', diff saved to https://phabricator.wikimedia.org/P87065 and previous config saved to /var/cache/conftool/dbconfig/20260110-204154-marostegui.json [production]
20:37 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2149', diff saved to https://phabricator.wikimedia.org/P87064 and previous config saved to /var/cache/conftool/dbconfig/20260110-203731-marostegui.json [production]
20:31 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1166', diff saved to https://phabricator.wikimedia.org/P87063 and previous config saved to /var/cache/conftool/dbconfig/20260110-203146-marostegui.json [production]
20:27 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2149', diff saved to https://phabricator.wikimedia.org/P87062 and previous config saved to /var/cache/conftool/dbconfig/20260110-202722-marostegui.json [production]
20:21 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1166 (T413525)', diff saved to https://phabricator.wikimedia.org/P87061 and previous config saved to /var/cache/conftool/dbconfig/20260110-202138-marostegui.json [production]
20:17 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2149 (T413525)', diff saved to https://phabricator.wikimedia.org/P87060 and previous config saved to /var/cache/conftool/dbconfig/20260110-201714-marostegui.json [production]
20:06 <marostegui@cumin1003> dbctl commit (dc=all): 'Depooling db1166 (T413525)', diff saved to https://phabricator.wikimedia.org/P87059 and previous config saved to /var/cache/conftool/dbconfig/20260110-200615-marostegui.json [production]
20:06 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1166.eqiad.wmnet with reason: Maintenance [production]
20:06 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1157 (T413525)', diff saved to https://phabricator.wikimedia.org/P87058 and previous config saved to /var/cache/conftool/dbconfig/20260110-200601-marostegui.json [production]
19:55 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1157', diff saved to https://phabricator.wikimedia.org/P87057 and previous config saved to /var/cache/conftool/dbconfig/20260110-195553-marostegui.json [production]
19:45 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1157', diff saved to https://phabricator.wikimedia.org/P87056 and previous config saved to /var/cache/conftool/dbconfig/20260110-194544-marostegui.json [production]
19:37 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.restart_openstack (exit_code=0) on deployment codfw1dev for all services [admin]
19:35 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1157 (T413525)', diff saved to https://phabricator.wikimedia.org/P87055 and previous config saved to /var/cache/conftool/dbconfig/20260110-193536-marostegui.json [production]
19:34 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.restart_openstack on deployment codfw1dev for all services [admin]
19:29 <andrew@cloudcumin1001> END (FAIL) - Cookbook wmcs.openstack.restart_openstack (exit_code=99) on deployment codfw1dev for all services [admin]
19:27 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.restart_openstack on deployment codfw1dev for all services [admin]
19:27 <marostegui@cumin1003> dbctl commit (dc=all): 'Depooling db2149 (T413525)', diff saved to https://phabricator.wikimedia.org/P87054 and previous config saved to /var/cache/conftool/dbconfig/20260110-192742-marostegui.json [production]
19:27 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2149.codfw.wmnet with reason: Maintenance [production]
19:20 <marostegui@cumin1003> dbctl commit (dc=all): 'Depooling db1157 (T413525)', diff saved to https://phabricator.wikimedia.org/P87053 and previous config saved to /var/cache/conftool/dbconfig/20260110-192058-marostegui.json [production]
19:20 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1157.eqiad.wmnet with reason: Maintenance [production]
18:42 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1150.eqiad.wmnet with reason: Maintenance [production]
18:13 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1222.eqiad.wmnet with reason: Maintenance [production]
11:31 <marostegui@cumin1003> dbctl commit (dc=all): 'Depooling db2210 (T411163 T411164)', diff saved to https://phabricator.wikimedia.org/P87052 and previous config saved to /var/cache/conftool/dbconfig/20260110-113128-marostegui.json [production]
11:31 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3 days, 0:00:00 on db2210.codfw.wmnet with reason: Maintenance [production]
11:31 <marostegui@cumin1003> dbctl commit (dc=all): 'Depooling db1241 (T411163 T411164)', diff saved to https://phabricator.wikimedia.org/P87051 and previous config saved to /var/cache/conftool/dbconfig/20260110-113110-marostegui.json [production]
11:31 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2206 (T411163 T411164)', diff saved to https://phabricator.wikimedia.org/P87050 and previous config saved to /var/cache/conftool/dbconfig/20260110-113104-marostegui.json [production]
11:31 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3 days, 0:00:00 on db1241.eqiad.wmnet with reason: Maintenance [production]
11:30 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1238 (T411163 T411164)', diff saved to https://phabricator.wikimedia.org/P87049 and previous config saved to /var/cache/conftool/dbconfig/20260110-113045-marostegui.json [production]
11:20 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2206', diff saved to https://phabricator.wikimedia.org/P87048 and previous config saved to /var/cache/conftool/dbconfig/20260110-112055-marostegui.json [production]