1-50 of 10000 results (94ms)
2026-02-28 §
11:09 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2189', diff saved to https://phabricator.wikimedia.org/P89218 and previous config saved to /var/cache/conftool/dbconfig/20260228-110954-marostegui.json [production]
11:07 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1182', diff saved to https://phabricator.wikimedia.org/P89217 and previous config saved to /var/cache/conftool/dbconfig/20260228-110723-marostegui.json [production]
10:54 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2189', diff saved to https://phabricator.wikimedia.org/P89216 and previous config saved to /var/cache/conftool/dbconfig/20260228-105446-marostegui.json [production]
10:52 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1182', diff saved to https://phabricator.wikimedia.org/P89215 and previous config saved to /var/cache/conftool/dbconfig/20260228-105214-marostegui.json [production]
10:39 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2189 (T418465)', diff saved to https://phabricator.wikimedia.org/P89214 and previous config saved to /var/cache/conftool/dbconfig/20260228-103938-marostegui.json [production]
10:37 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1182 (T418465)', diff saved to https://phabricator.wikimedia.org/P89213 and previous config saved to /var/cache/conftool/dbconfig/20260228-103706-marostegui.json [production]
10:33 <marostegui@cumin1003> dbctl commit (dc=all): 'Depooling db2189 (T418465)', diff saved to https://phabricator.wikimedia.org/P89212 and previous config saved to /var/cache/conftool/dbconfig/20260228-103352-marostegui.json [production]
10:33 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 5:00:00 on db2189.codfw.wmnet with reason: Maintenance [production]
10:33 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2175 (T418465)', diff saved to https://phabricator.wikimedia.org/P89211 and previous config saved to /var/cache/conftool/dbconfig/20260228-103327-marostegui.json [production]
10:29 <marostegui@cumin1003> dbctl commit (dc=all): 'Depooling db1182 (T418465)', diff saved to https://phabricator.wikimedia.org/P89210 and previous config saved to /var/cache/conftool/dbconfig/20260228-102952-marostegui.json [production]
10:29 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 8:00:00 on db1182.eqiad.wmnet with reason: Maintenance [production]
10:29 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1162 (T418465)', diff saved to https://phabricator.wikimedia.org/P89209 and previous config saved to /var/cache/conftool/dbconfig/20260228-102927-marostegui.json [production]
10:18 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2175', diff saved to https://phabricator.wikimedia.org/P89208 and previous config saved to /var/cache/conftool/dbconfig/20260228-101818-marostegui.json [production]
10:14 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1162', diff saved to https://phabricator.wikimedia.org/P89207 and previous config saved to /var/cache/conftool/dbconfig/20260228-101419-marostegui.json [production]
10:03 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2175', diff saved to https://phabricator.wikimedia.org/P89206 and previous config saved to /var/cache/conftool/dbconfig/20260228-100310-marostegui.json [production]
09:59 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1162', diff saved to https://phabricator.wikimedia.org/P89205 and previous config saved to /var/cache/conftool/dbconfig/20260228-095911-marostegui.json [production]
09:48 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2175 (T418465)', diff saved to https://phabricator.wikimedia.org/P89204 and previous config saved to /var/cache/conftool/dbconfig/20260228-094802-marostegui.json [production]
09:44 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1162 (T418465)', diff saved to https://phabricator.wikimedia.org/P89203 and previous config saved to /var/cache/conftool/dbconfig/20260228-094402-marostegui.json [production]
09:41 <marostegui@cumin1003> dbctl commit (dc=all): 'Depooling db2175 (T418465)', diff saved to https://phabricator.wikimedia.org/P89202 and previous config saved to /var/cache/conftool/dbconfig/20260228-094157-marostegui.json [production]
09:41 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 5:00:00 on db2175.codfw.wmnet with reason: Maintenance [production]
09:41 <marostegui@cumin1003> dbctl commit (dc=all): 'Depooling db1162 (T418465)', diff saved to https://phabricator.wikimedia.org/P89201 and previous config saved to /var/cache/conftool/dbconfig/20260228-094146-marostegui.json [production]
09:41 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 8:00:00 on db1162.eqiad.wmnet with reason: Maintenance [production]
09:41 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2148 (T418465)', diff saved to https://phabricator.wikimedia.org/P89200 and previous config saved to /var/cache/conftool/dbconfig/20260228-094133-marostegui.json [production]
09:41 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1156 (T418465)', diff saved to https://phabricator.wikimedia.org/P89199 and previous config saved to /var/cache/conftool/dbconfig/20260228-094122-marostegui.json [production]
09:26 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2148', diff saved to https://phabricator.wikimedia.org/P89198 and previous config saved to /var/cache/conftool/dbconfig/20260228-092625-marostegui.json [production]
09:26 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1156', diff saved to https://phabricator.wikimedia.org/P89197 and previous config saved to /var/cache/conftool/dbconfig/20260228-092614-marostegui.json [production]
09:11 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2148', diff saved to https://phabricator.wikimedia.org/P89196 and previous config saved to /var/cache/conftool/dbconfig/20260228-091116-marostegui.json [production]
09:11 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1156', diff saved to https://phabricator.wikimedia.org/P89195 and previous config saved to /var/cache/conftool/dbconfig/20260228-091105-marostegui.json [production]
08:56 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2148 (T418465)', diff saved to https://phabricator.wikimedia.org/P89194 and previous config saved to /var/cache/conftool/dbconfig/20260228-085608-marostegui.json [production]
08:55 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1156 (T418465)', diff saved to https://phabricator.wikimedia.org/P89193 and previous config saved to /var/cache/conftool/dbconfig/20260228-085557-marostegui.json [production]
08:49 <marostegui@cumin1003> dbctl commit (dc=all): 'Depooling db1156 (T418465)', diff saved to https://phabricator.wikimedia.org/P89192 and previous config saved to /var/cache/conftool/dbconfig/20260228-084957-marostegui.json [production]
08:49 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 5:00:00 on db2148.codfw.wmnet with reason: Maintenance [production]
08:49 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 16:00:00 on an-redacteddb1001.eqiad.wmnet,clouddb[1014,1018].eqiad.wmnet,db1155.eqiad.wmnet with reason: Maintenance [production]
08:49 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 8:00:00 on db1156.eqiad.wmnet with reason: Maintenance [production]
06:32 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 8:00:00 on db2209.codfw.wmnet with reason: Maintenance [production]
06:31 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 8:00:00 on db1189.eqiad.wmnet with reason: Maintenance [production]
02:13 <mwpresync@deploy2002> Finished scap build-images: Publishing wmf/next image (duration: 12m 58s) [production]
02:00 <mwpresync@deploy2002> Started scap build-images: Publishing wmf/next image [production]
2026-02-27 §
23:02 <cscott@deploy2002> Finished scap sync-world: Backport for [[gerrit:1245477|Ensure that Parsoid canonical HTML is not language converted (T418549)]] (duration: 08m 47s) [production]
22:58 <cscott@deploy2002> cscott: Continuing with sync [production]
22:55 <cscott@deploy2002> cscott: Backport for [[gerrit:1245477|Ensure that Parsoid canonical HTML is not language converted (T418549)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
22:53 <cscott@deploy2002> Started scap sync-world: Backport for [[gerrit:1245477|Ensure that Parsoid canonical HTML is not language converted (T418549)]] [production]
21:38 <cdobbins@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cp2058.codfw.wmnet with OS trixie [production]
21:36 <cdobbins@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cp2057.codfw.wmnet with OS trixie [production]
21:17 <cdobbins@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cp2058.codfw.wmnet with reason: host reimage [production]
21:15 <cdobbins@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cp2057.codfw.wmnet with reason: host reimage [production]
21:14 <ebernhardson@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/opensearch-semantic-search: apply [production]
21:14 <ebernhardson@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/opensearch-semantic-search: apply [production]
21:12 <cdobbins@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cp2056.codfw.wmnet with OS trixie [production]
21:11 <cdobbins@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on cp2058.codfw.wmnet with reason: host reimage [production]