601-650 of 10000 results (149ms)
2025-04-29 ยง
19:25 <fceratto@cumin1002> dbctl commit (dc=all): 'Depooling db2165 (T392806)', diff saved to https://phabricator.wikimedia.org/P75647 and previous config saved to /var/cache/conftool/dbconfig/20250429-192501-fceratto.json [production]
19:24 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2165.codfw.wmnet with reason: Maintenance [production]
19:24 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2164 (T392806)', diff saved to https://phabricator.wikimedia.org/P75646 and previous config saved to /var/cache/conftool/dbconfig/20250429-192434-fceratto.json [production]
19:09 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2164', diff saved to https://phabricator.wikimedia.org/P75645 and previous config saved to /var/cache/conftool/dbconfig/20250429-190927-fceratto.json [production]
18:58 <fab@deploy1003> Finished deploy [airflow-dags/research@414def7]: (no justification provided) (duration: 00m 50s) [production]
18:58 <fab@deploy1003> Started deploy [airflow-dags/research@414def7]: (no justification provided) [production]
18:54 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2164', diff saved to https://phabricator.wikimedia.org/P75644 and previous config saved to /var/cache/conftool/dbconfig/20250429-185421-fceratto.json [production]
18:39 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2164 (T392806)', diff saved to https://phabricator.wikimedia.org/P75643 and previous config saved to /var/cache/conftool/dbconfig/20250429-183913-fceratto.json [production]
18:30 <fceratto@cumin1002> dbctl commit (dc=all): 'Depooling db2164 (T392806)', diff saved to https://phabricator.wikimedia.org/P75642 and previous config saved to /var/cache/conftool/dbconfig/20250429-183044-fceratto.json [production]
18:30 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2 days, 0:00:00 on db2186.codfw.wmnet with reason: Maintenance [production]
18:30 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2164.codfw.wmnet with reason: Maintenance [production]
18:30 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2163 (T392806)', diff saved to https://phabricator.wikimedia.org/P75641 and previous config saved to /var/cache/conftool/dbconfig/20250429-183000-fceratto.json [production]
18:14 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2163', diff saved to https://phabricator.wikimedia.org/P75640 and previous config saved to /var/cache/conftool/dbconfig/20250429-181453-fceratto.json [production]
18:01 <aokoth@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host aphlict1002.eqiad.wmnet with OS bookworm [production]
17:59 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2163', diff saved to https://phabricator.wikimedia.org/P75639 and previous config saved to /var/cache/conftool/dbconfig/20250429-175946-fceratto.json [production]
17:44 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2163 (T392806)', diff saved to https://phabricator.wikimedia.org/P75638 and previous config saved to /var/cache/conftool/dbconfig/20250429-174438-fceratto.json [production]
17:40 <aokoth@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on aphlict1002.eqiad.wmnet with reason: host reimage [production]
17:37 <aokoth@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on aphlict1002.eqiad.wmnet with reason: host reimage [production]
17:35 <fceratto@cumin1002> dbctl commit (dc=all): 'Depooling db2163 (T392806)', diff saved to https://phabricator.wikimedia.org/P75637 and previous config saved to /var/cache/conftool/dbconfig/20250429-173517-fceratto.json [production]
17:35 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2163.codfw.wmnet with reason: Maintenance [production]
17:34 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2162 (T392806)', diff saved to https://phabricator.wikimedia.org/P75636 and previous config saved to /var/cache/conftool/dbconfig/20250429-173450-fceratto.json [production]
17:28 <aokoth@cumin1002> START - Cookbook sre.hosts.reimage for host aphlict1002.eqiad.wmnet with OS bookworm [production]
17:27 <aokoth@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on aphlict1002.eqiad.wmnet with reason: Bookworm Re-image [production]
17:19 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2162', diff saved to https://phabricator.wikimedia.org/P75635 and previous config saved to /var/cache/conftool/dbconfig/20250429-171943-fceratto.json [production]
17:16 <sukhe> sudo cumin -b1 -s30 'A:durum and not P{durum2002*}' 'run-puppet-agent --enable "rolling out CR 1139873"' [production]
17:10 <sukhe> sudo cumin 'A:durum' 'disable-puppet "rolling out CR 1139873"' [production]
17:04 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2162', diff saved to https://phabricator.wikimedia.org/P75634 and previous config saved to /var/cache/conftool/dbconfig/20250429-170436-fceratto.json [production]
17:02 <aokoth@dns1004> END - running authdns-update [production]
17:00 <aokoth@dns1004> START - running authdns-update [production]
16:49 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2162 (T392806)', diff saved to https://phabricator.wikimedia.org/P75633 and previous config saved to /var/cache/conftool/dbconfig/20250429-164927-fceratto.json [production]
16:40 <fceratto@cumin1002> dbctl commit (dc=all): 'Depooling db2162 (T392806)', diff saved to https://phabricator.wikimedia.org/P75632 and previous config saved to /var/cache/conftool/dbconfig/20250429-164005-fceratto.json [production]
16:39 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2162.codfw.wmnet with reason: Maintenance [production]
16:39 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2154 (T392806)', diff saved to https://phabricator.wikimedia.org/P75631 and previous config saved to /var/cache/conftool/dbconfig/20250429-163939-fceratto.json [production]
16:24 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2154', diff saved to https://phabricator.wikimedia.org/P75630 and previous config saved to /var/cache/conftool/dbconfig/20250429-162432-fceratto.json [production]
16:14 <bking@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cirrussearch2108.codfw.wmnet with OS bullseye [production]
16:09 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2154', diff saved to https://phabricator.wikimedia.org/P75629 and previous config saved to /var/cache/conftool/dbconfig/20250429-160925-fceratto.json [production]
16:01 <krinkle@deploy1003> Finished scap sync-world: Backport for [[gerrit:1138921|missing.php: Simplify code to reduce abstraction and duplication (T113114)]] (duration: 17m 57s) [production]
15:55 <bking@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cirrussearch2106.codfw.wmnet with OS bullseye [production]
15:55 <ebernhardson@deploy1003> Finished deploy [airflow-dags/search@5bff61a]: Update airflow-search with simplified mjolnir dag (duration: 00m 25s) [production]
15:54 <ebernhardson@deploy1003> Started deploy [airflow-dags/search@5bff61a]: Update airflow-search with simplified mjolnir dag [production]
15:54 <krinkle@deploy1003> krinkle: Continuing with sync [production]
15:54 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2154 (T392806)', diff saved to https://phabricator.wikimedia.org/P75628 and previous config saved to /var/cache/conftool/dbconfig/20250429-155419-fceratto.json [production]
15:54 <sukhe@dns1004> END - running authdns-update [production]
15:53 <bking@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cirrussearch2108.codfw.wmnet with reason: host reimage [production]
15:51 <sukhe@dns1004> START - running authdns-update [production]
15:50 <bking@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on cirrussearch2108.codfw.wmnet with reason: host reimage [production]
15:49 <krinkle@deploy1003> krinkle: Backport for [[gerrit:1138921|missing.php: Simplify code to reduce abstraction and duplication (T113114)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
15:46 <fceratto@cumin1002> dbctl commit (dc=all): 'Depooling db2154 (T392806)', diff saved to https://phabricator.wikimedia.org/P75627 and previous config saved to /var/cache/conftool/dbconfig/20250429-154559-fceratto.json [production]
15:45 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2154.codfw.wmnet with reason: Maintenance [production]
15:45 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2152 (T392806)', diff saved to https://phabricator.wikimedia.org/P75626 and previous config saved to /var/cache/conftool/dbconfig/20250429-154533-fceratto.json [production]