251-300 of 10000 results (31ms)
2026-01-16 ยง
09:24 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2145', diff saved to https://phabricator.wikimedia.org/P87611 and previous config saved to /var/cache/conftool/dbconfig/20260116-092410-marostegui.json [production]
09:16 <marostegui@cumin1003> dbctl commit (dc=all): 'Depooling db1242 (T413525)', diff saved to https://phabricator.wikimedia.org/P87609 and previous config saved to /var/cache/conftool/dbconfig/20260116-091649-marostegui.json [production]
09:16 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1242.eqiad.wmnet with reason: Maintenance [production]
09:16 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1241 (T413525)', diff saved to https://phabricator.wikimedia.org/P87608 and previous config saved to /var/cache/conftool/dbconfig/20260116-091623-marostegui.json [production]
09:15 <mutante> attempting soft reboot of instance codesearch9.codesearch - down and can't connect - T414776 [production]
09:14 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2145', diff saved to https://phabricator.wikimedia.org/P87607 and previous config saved to /var/cache/conftool/dbconfig/20260116-091401-marostegui.json [production]
09:06 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1241', diff saved to https://phabricator.wikimedia.org/P87606 and previous config saved to /var/cache/conftool/dbconfig/20260116-090614-marostegui.json [production]
09:03 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2145 (T411163 T411164)', diff saved to https://phabricator.wikimedia.org/P87605 and previous config saved to /var/cache/conftool/dbconfig/20260116-090353-marostegui.json [production]
08:56 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1241', diff saved to https://phabricator.wikimedia.org/P87604 and previous config saved to /var/cache/conftool/dbconfig/20260116-085605-marostegui.json [production]
08:50 <tappof> depool titan2001, cleaning up block 01K88XDMJ9S0T2DR5K00VG9CFE (T410152) [production]
08:45 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1241 (T413525)', diff saved to https://phabricator.wikimedia.org/P87603 and previous config saved to /var/cache/conftool/dbconfig/20260116-084557-marostegui.json [production]
08:32 <marostegui@cumin1003> dbctl commit (dc=all): 'Depooling db2240 (T413525)', diff saved to https://phabricator.wikimedia.org/P87602 and previous config saved to /var/cache/conftool/dbconfig/20260116-083206-marostegui.json [production]
08:31 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2240.codfw.wmnet with reason: Maintenance [production]
07:58 <mutante> phabricator - adding kimpham to WMF-NDA (T414157) [production]
07:58 <mutante> phabricator - adding Martyn.ranyard to WMF-NDA (T413994) [production]
07:54 <mutante> phabricator - addign Johannes_Richter_WMDE to WMF-NDA T414678 [production]
07:02 <larssandergreen> civicrm upgraded from 43808405 to 54fb7415 [production]
06:26 <marostegui@cumin1003> END (PASS) - Cookbook sre.wikireplicas.update-views (exit_code=0) [production]
06:21 <marostegui@cumin1003> START - Cookbook sre.wikireplicas.update-views [production]
06:21 <marostegui@cumin1003> END (PASS) - Cookbook sre.wikireplicas.update-views (exit_code=0) [production]
06:16 <marostegui@cumin1003> START - Cookbook sre.wikireplicas.update-views [production]
05:48 <marostegui@cumin1003> dbctl commit (dc=all): 'Depooling db1169 (T411163 T411164)', diff saved to https://phabricator.wikimedia.org/P87601 and previous config saved to /var/cache/conftool/dbconfig/20260116-054831-marostegui.json [production]
05:48 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3 days, 0:00:00 on db1169.eqiad.wmnet with reason: Maintenance [production]
05:05 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2239.codfw.wmnet with reason: Maintenance [production]
05:05 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2237 (T413525)', diff saved to https://phabricator.wikimedia.org/P87600 and previous config saved to /var/cache/conftool/dbconfig/20260116-050536-marostegui.json [production]
05:01 <marostegui@cumin1003> dbctl commit (dc=all): 'Depooling db1241 (T413525)', diff saved to https://phabricator.wikimedia.org/P87599 and previous config saved to /var/cache/conftool/dbconfig/20260116-050102-marostegui.json [production]
05:00 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1241.eqiad.wmnet with reason: Maintenance [production]
05:00 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1238 (T413525)', diff saved to https://phabricator.wikimedia.org/P87598 and previous config saved to /var/cache/conftool/dbconfig/20260116-050038-marostegui.json [production]
04:55 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2237', diff saved to https://phabricator.wikimedia.org/P87597 and previous config saved to /var/cache/conftool/dbconfig/20260116-045527-marostegui.json [production]
04:50 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1238', diff saved to https://phabricator.wikimedia.org/P87596 and previous config saved to /var/cache/conftool/dbconfig/20260116-045028-marostegui.json [production]
04:45 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2237', diff saved to https://phabricator.wikimedia.org/P87595 and previous config saved to /var/cache/conftool/dbconfig/20260116-044519-marostegui.json [production]
04:40 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1238', diff saved to https://phabricator.wikimedia.org/P87594 and previous config saved to /var/cache/conftool/dbconfig/20260116-044020-marostegui.json [production]
04:35 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2237 (T413525)', diff saved to https://phabricator.wikimedia.org/P87593 and previous config saved to /var/cache/conftool/dbconfig/20260116-043511-marostegui.json [production]
04:30 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1238 (T413525)', diff saved to https://phabricator.wikimedia.org/P87592 and previous config saved to /var/cache/conftool/dbconfig/20260116-043012-marostegui.json [production]
02:38 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3 days, 0:00:00 on dbstore1007.eqiad.wmnet with reason: Maintenance [production]
02:38 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1263 (T411163 T411164)', diff saved to https://phabricator.wikimedia.org/P87591 and previous config saved to /var/cache/conftool/dbconfig/20260116-023806-marostegui.json [production]
02:27 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1263', diff saved to https://phabricator.wikimedia.org/P87590 and previous config saved to /var/cache/conftool/dbconfig/20260116-022758-marostegui.json [production]
02:17 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1263', diff saved to https://phabricator.wikimedia.org/P87589 and previous config saved to /var/cache/conftool/dbconfig/20260116-021748-marostegui.json [production]
02:07 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1263 (T411163 T411164)', diff saved to https://phabricator.wikimedia.org/P87588 and previous config saved to /var/cache/conftool/dbconfig/20260116-020740-marostegui.json [production]
01:14 <mwpresync@deploy2002> Finished scap build-images: Publishing wmf/next image (duration: 13m 05s) [production]
01:00 <mwpresync@deploy2002> Started scap build-images: Publishing wmf/next image [production]
00:45 <marostegui@cumin1003> dbctl commit (dc=all): 'Depooling db2237 (T413525)', diff saved to https://phabricator.wikimedia.org/P87587 and previous config saved to /var/cache/conftool/dbconfig/20260116-004540-marostegui.json [production]
00:45 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2237.codfw.wmnet with reason: Maintenance [production]
00:45 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2236 (T413525)', diff saved to https://phabricator.wikimedia.org/P87586 and previous config saved to /var/cache/conftool/dbconfig/20260116-004514-marostegui.json [production]
00:41 <marostegui@cumin1003> dbctl commit (dc=all): 'Depooling db1238 (T413525)', diff saved to https://phabricator.wikimedia.org/P87585 and previous config saved to /var/cache/conftool/dbconfig/20260116-004117-marostegui.json [production]
00:41 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1238.eqiad.wmnet with reason: Maintenance [production]
00:40 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1221 (T413525)', diff saved to https://phabricator.wikimedia.org/P87584 and previous config saved to /var/cache/conftool/dbconfig/20260116-004052-marostegui.json [production]
00:35 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2236', diff saved to https://phabricator.wikimedia.org/P87583 and previous config saved to /var/cache/conftool/dbconfig/20260116-003506-marostegui.json [production]
00:30 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1221', diff saved to https://phabricator.wikimedia.org/P87582 and previous config saved to /var/cache/conftool/dbconfig/20260116-003044-marostegui.json [production]
00:24 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2236', diff saved to https://phabricator.wikimedia.org/P87581 and previous config saved to /var/cache/conftool/dbconfig/20260116-002457-marostegui.json [production]