351-400 of 10000 results (87ms)
2025-08-12 ยง
08:31 <ladsgroup@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2163.codfw.wmnet with reason: Maintenance [production]
08:31 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2161 (T400854)', diff saved to https://phabricator.wikimedia.org/P81062 and previous config saved to /var/cache/conftool/dbconfig/20250812-083119-ladsgroup.json [production]
08:20 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2145', diff saved to https://phabricator.wikimedia.org/P81061 and previous config saved to /var/cache/conftool/dbconfig/20250812-082056-fceratto.json [production]
08:16 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2161', diff saved to https://phabricator.wikimedia.org/P81060 and previous config saved to /var/cache/conftool/dbconfig/20250812-081611-ladsgroup.json [production]
08:05 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2145', diff saved to https://phabricator.wikimedia.org/P81059 and previous config saved to /var/cache/conftool/dbconfig/20250812-080549-fceratto.json [production]
08:01 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2161', diff saved to https://phabricator.wikimedia.org/P81058 and previous config saved to /var/cache/conftool/dbconfig/20250812-080104-ladsgroup.json [production]
07:50 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2145 (T391056)', diff saved to https://phabricator.wikimedia.org/P81057 and previous config saved to /var/cache/conftool/dbconfig/20250812-075041-fceratto.json [production]
07:49 <fceratto@cumin1002> dbctl commit (dc=all): 'Depooling db2145 (T391056)', diff saved to https://phabricator.wikimedia.org/P81056 and previous config saved to /var/cache/conftool/dbconfig/20250812-074932-fceratto.json [production]
07:49 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db2145.codfw.wmnet with reason: Maintenance [production]
07:49 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db2141.codfw.wmnet with reason: Maintenance [production]
07:45 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2161 (T400854)', diff saved to https://phabricator.wikimedia.org/P81055 and previous config saved to /var/cache/conftool/dbconfig/20250812-074556-ladsgroup.json [production]
07:43 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Depooling db2161 (T400854)', diff saved to https://phabricator.wikimedia.org/P81054 and previous config saved to /var/cache/conftool/dbconfig/20250812-074312-ladsgroup.json [production]
07:43 <ladsgroup@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2161.codfw.wmnet with reason: Maintenance [production]
07:42 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2154 (T400854)', diff saved to https://phabricator.wikimedia.org/P81053 and previous config saved to /var/cache/conftool/dbconfig/20250812-074249-ladsgroup.json [production]
07:27 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2154', diff saved to https://phabricator.wikimedia.org/P81052 and previous config saved to /var/cache/conftool/dbconfig/20250812-072742-ladsgroup.json [production]
07:17 <hashar@deploy1003> Finished deploy [integration/docroot@77c4765]: build: Updating mediawiki/mediawiki-phan-config to 0.17.0 (duration: 00m 13s) [production]
07:17 <hashar@deploy1003> Started deploy [integration/docroot@77c4765]: build: Updating mediawiki/mediawiki-phan-config to 0.17.0 [production]
07:12 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2154', diff saved to https://phabricator.wikimedia.org/P81051 and previous config saved to /var/cache/conftool/dbconfig/20250812-071234-ladsgroup.json [production]
06:57 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2154 (T400854)', diff saved to https://phabricator.wikimedia.org/P81050 and previous config saved to /var/cache/conftool/dbconfig/20250812-065726-ladsgroup.json [production]
06:54 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Depooling db2154 (T400854)', diff saved to https://phabricator.wikimedia.org/P81049 and previous config saved to /var/cache/conftool/dbconfig/20250812-065443-ladsgroup.json [production]
06:54 <ladsgroup@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2154.codfw.wmnet with reason: Maintenance [production]
06:54 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2152 (T400854)', diff saved to https://phabricator.wikimedia.org/P81048 and previous config saved to /var/cache/conftool/dbconfig/20250812-065420-ladsgroup.json [production]
06:42 <fceratto@cumin1002> dbctl commit (dc=all): 'Depooling db2172 (T399249)', diff saved to https://phabricator.wikimedia.org/P81047 and previous config saved to /var/cache/conftool/dbconfig/20250812-064209-fceratto.json [production]
06:42 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 8:00:00 on db2172.codfw.wmnet with reason: Maintenance [production]
06:41 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2155 (T399249)', diff saved to https://phabricator.wikimedia.org/P81046 and previous config saved to /var/cache/conftool/dbconfig/20250812-064146-fceratto.json [production]
06:39 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2152', diff saved to https://phabricator.wikimedia.org/P81045 and previous config saved to /var/cache/conftool/dbconfig/20250812-063913-ladsgroup.json [production]
06:32 <vriley@cumin1002> START - Cookbook sre.hosts.provision for host cloudcephosd1044.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
06:26 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2155', diff saved to https://phabricator.wikimedia.org/P81044 and previous config saved to /var/cache/conftool/dbconfig/20250812-062638-fceratto.json [production]
06:24 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2152', diff saved to https://phabricator.wikimedia.org/P81043 and previous config saved to /var/cache/conftool/dbconfig/20250812-062405-ladsgroup.json [production]
06:11 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2155', diff saved to https://phabricator.wikimedia.org/P81042 and previous config saved to /var/cache/conftool/dbconfig/20250812-061130-fceratto.json [production]
06:08 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2152 (T400854)', diff saved to https://phabricator.wikimedia.org/P81041 and previous config saved to /var/cache/conftool/dbconfig/20250812-060857-ladsgroup.json [production]
06:07 <vriley@cumin1002> START - Cookbook sre.hosts.reimage for host cloudcephosd1044.eqiad.wmnet with OS bookworm [production]
06:07 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Depooling db2152 (T400854)', diff saved to https://phabricator.wikimedia.org/P81040 and previous config saved to /var/cache/conftool/dbconfig/20250812-060705-ladsgroup.json [production]
06:06 <ladsgroup@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2152.codfw.wmnet with reason: Maintenance [production]
06:06 <ladsgroup@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on dbstore1009.eqiad.wmnet with reason: Maintenance [production]
06:06 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1226 (T400854)', diff saved to https://phabricator.wikimedia.org/P81039 and previous config saved to /var/cache/conftool/dbconfig/20250812-060559-ladsgroup.json [production]
05:56 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2155 (T399249)', diff saved to https://phabricator.wikimedia.org/P81038 and previous config saved to /var/cache/conftool/dbconfig/20250812-055623-fceratto.json [production]
05:50 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1226', diff saved to https://phabricator.wikimedia.org/P81037 and previous config saved to /var/cache/conftool/dbconfig/20250812-055052-ladsgroup.json [production]
05:35 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1226', diff saved to https://phabricator.wikimedia.org/P81036 and previous config saved to /var/cache/conftool/dbconfig/20250812-053544-ladsgroup.json [production]
05:20 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1226 (T400854)', diff saved to https://phabricator.wikimedia.org/P81035 and previous config saved to /var/cache/conftool/dbconfig/20250812-052037-ladsgroup.json [production]
05:17 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Depooling db1226 (T400854)', diff saved to https://phabricator.wikimedia.org/P81034 and previous config saved to /var/cache/conftool/dbconfig/20250812-051757-ladsgroup.json [production]
05:17 <ladsgroup@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1226.eqiad.wmnet with reason: Maintenance [production]
05:17 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1214 (T400854)', diff saved to https://phabricator.wikimedia.org/P81033 and previous config saved to /var/cache/conftool/dbconfig/20250812-051735-ladsgroup.json [production]
05:02 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1214', diff saved to https://phabricator.wikimedia.org/P81032 and previous config saved to /var/cache/conftool/dbconfig/20250812-050227-ladsgroup.json [production]
04:47 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1214', diff saved to https://phabricator.wikimedia.org/P81031 and previous config saved to /var/cache/conftool/dbconfig/20250812-044719-ladsgroup.json [production]
04:32 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1214 (T400854)', diff saved to https://phabricator.wikimedia.org/P81030 and previous config saved to /var/cache/conftool/dbconfig/20250812-043212-ladsgroup.json [production]
04:29 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Depooling db1214 (T400854)', diff saved to https://phabricator.wikimedia.org/P81029 and previous config saved to /var/cache/conftool/dbconfig/20250812-042937-ladsgroup.json [production]
04:29 <ladsgroup@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1214.eqiad.wmnet with reason: Maintenance [production]
04:29 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1209 (T400854)', diff saved to https://phabricator.wikimedia.org/P81028 and previous config saved to /var/cache/conftool/dbconfig/20250812-042915-ladsgroup.json [production]
04:14 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1209', diff saved to https://phabricator.wikimedia.org/P81027 and previous config saved to /var/cache/conftool/dbconfig/20250812-041408-ladsgroup.json [production]