1-50 of 10000 results (19ms)
2025-08-01 §
01:11 <mwpresync@deploy1003> Finished scap build-images: Publishing wmf/next image (duration: 10m 44s) [production]
01:00 <mwpresync@deploy1003> Started scap build-images: Publishing wmf/next image [production]
00:59 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2224 (T400854)', diff saved to https://phabricator.wikimedia.org/P80408 and previous config saved to /var/cache/conftool/dbconfig/20250801-005907-ladsgroup.json [production]
00:51 <eileen> * civicrm upgraded from 82a5306d to f202b616 [production]
00:44 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2224', diff saved to https://phabricator.wikimedia.org/P80407 and previous config saved to /var/cache/conftool/dbconfig/20250801-004359-ladsgroup.json [production]
00:28 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2224', diff saved to https://phabricator.wikimedia.org/P80406 and previous config saved to /var/cache/conftool/dbconfig/20250801-002852-ladsgroup.json [production]
00:13 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2224 (T400854)', diff saved to https://phabricator.wikimedia.org/P80405 and previous config saved to /var/cache/conftool/dbconfig/20250801-001345-ladsgroup.json [production]
00:11 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Depooling db2224 (T400854)', diff saved to https://phabricator.wikimedia.org/P80404 and previous config saved to /var/cache/conftool/dbconfig/20250801-001119-ladsgroup.json [production]
00:11 <ladsgroup@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2224.codfw.wmnet with reason: Maintenance [production]
00:10 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2217 (T400854)', diff saved to https://phabricator.wikimedia.org/P80403 and previous config saved to /var/cache/conftool/dbconfig/20250801-001055-ladsgroup.json [production]
2025-07-31 §
23:55 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2217', diff saved to https://phabricator.wikimedia.org/P80402 and previous config saved to /var/cache/conftool/dbconfig/20250731-235547-ladsgroup.json [production]
23:40 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2217', diff saved to https://phabricator.wikimedia.org/P80401 and previous config saved to /var/cache/conftool/dbconfig/20250731-234040-ladsgroup.json [production]
23:25 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2217 (T400854)', diff saved to https://phabricator.wikimedia.org/P80400 and previous config saved to /var/cache/conftool/dbconfig/20250731-232532-ladsgroup.json [production]
23:23 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Depooling db2217 (T400854)', diff saved to https://phabricator.wikimedia.org/P80399 and previous config saved to /var/cache/conftool/dbconfig/20250731-232304-ladsgroup.json [production]
23:22 <ladsgroup@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2217.codfw.wmnet with reason: Maintenance [production]
23:22 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2214 (T400854)', diff saved to https://phabricator.wikimedia.org/P80398 and previous config saved to /var/cache/conftool/dbconfig/20250731-232241-ladsgroup.json [production]
23:07 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2214', diff saved to https://phabricator.wikimedia.org/P80397 and previous config saved to /var/cache/conftool/dbconfig/20250731-230734-ladsgroup.json [production]
22:52 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2214', diff saved to https://phabricator.wikimedia.org/P80396 and previous config saved to /var/cache/conftool/dbconfig/20250731-225226-ladsgroup.json [production]
22:37 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2214 (T400854)', diff saved to https://phabricator.wikimedia.org/P80395 and previous config saved to /var/cache/conftool/dbconfig/20250731-223719-ladsgroup.json [production]
22:34 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Depooling db2214 (T400854)', diff saved to https://phabricator.wikimedia.org/P80394 and previous config saved to /var/cache/conftool/dbconfig/20250731-223453-ladsgroup.json [production]
22:34 <ladsgroup@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2214.codfw.wmnet with reason: Maintenance [production]
22:33 <ladsgroup@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2197.codfw.wmnet with reason: Maintenance [production]
22:33 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2193 (T400854)', diff saved to https://phabricator.wikimedia.org/P80393 and previous config saved to /var/cache/conftool/dbconfig/20250731-223339-ladsgroup.json [production]
22:31 <dancy@deploy1003> build-images aborted: Publishing wmf/next image (duration: 01m 05s) [production]
22:30 <dancy@deploy1003> Started scap build-images: Publishing wmf/next image [production]
22:29 <dancy@deploy1003> Installation of scap version "4.194.2" completed for 2 hosts [production]
22:27 <dancy@deploy1003> Installing scap version "4.194.2" for 2 host(s) [production]
22:18 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2193', diff saved to https://phabricator.wikimedia.org/P80392 and previous config saved to /var/cache/conftool/dbconfig/20250731-221832-ladsgroup.json [production]
22:11 <brett@cumin2002> END (PASS) - Cookbook sre.cdn.roll-upgrade-ats (exit_code=0) Rolling upgrade of ATS on P{cp70[03-16].magru.wmnet} and A:cp - 9.2.11-1wm2 upgrade () [production]
22:09 <dancy@deploy1003> Installation of scap version "4.193.0" completed for 2 hosts [production]
22:08 <dancy@deploy1003> Installing scap version "4.193.0" for 2 host(s) [production]
22:05 <zabe@deploy1003> Finished scap sync-world: Backport for [[gerrit:1174715|Stop setting wgGlobalUsageDatabase (T400169)]] (duration: 08m 24s) [production]
22:04 <brett@cumin2002> END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for ncredir1001.eqiad.wmnet [production]
22:04 <brett@cumin2002> START - Cookbook sre.hosts.remove-downtime for ncredir1001.eqiad.wmnet [production]
22:04 <brett@cumin2002> END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for ncredir1002.eqiad.wmnet [production]
22:03 <brett@cumin2002> START - Cookbook sre.hosts.remove-downtime for ncredir1002.eqiad.wmnet [production]
22:03 <brett@cumin2002> END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for ncredir2001.codfw.wmnet [production]
22:03 <brett@cumin2002> START - Cookbook sre.hosts.remove-downtime for ncredir2001.codfw.wmnet [production]
22:03 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2193', diff saved to https://phabricator.wikimedia.org/P80391 and previous config saved to /var/cache/conftool/dbconfig/20250731-220324-ladsgroup.json [production]
21:59 <zabe@deploy1003> zabe: Continuing with sync [production]
21:58 <zabe@deploy1003> zabe: Backport for [[gerrit:1174715|Stop setting wgGlobalUsageDatabase (T400169)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
21:56 <zabe@deploy1003> Started scap sync-world: Backport for [[gerrit:1174715|Stop setting wgGlobalUsageDatabase (T400169)]] [production]
21:48 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2193 (T400854)', diff saved to https://phabricator.wikimedia.org/P80390 and previous config saved to /var/cache/conftool/dbconfig/20250731-214817-ladsgroup.json [production]
21:46 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Depooling db2193 (T400854)', diff saved to https://phabricator.wikimedia.org/P80389 and previous config saved to /var/cache/conftool/dbconfig/20250731-214654-ladsgroup.json [production]
21:46 <ladsgroup@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2193.codfw.wmnet with reason: Maintenance [production]
21:46 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2180 (T400854)', diff saved to https://phabricator.wikimedia.org/P80388 and previous config saved to /var/cache/conftool/dbconfig/20250731-214631-ladsgroup.json [production]
21:43 <dzahn@cumin2002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ncredir2001.codfw.wmnet with reason: known and WIP [production]
21:43 <dzahn@cumin2002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ncredir1001.eqiad.wmnet with reason: known and WIP [production]
21:42 <dzahn@cumin2002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ncredir1002.eqiad.wmnet with reason: known and WIP [production]
21:38 <dancy@deploy1003> Finished scap sync-world: Backport for [[gerrit:1174795|Fix placement of toolbar insert group on mobile (T400933)]] (duration: 13m 54s) [production]