551-600 of 10000 results (94ms)
2025-07-23 ยง
18:50 <dduvall@deploy1003> rebuilt and synchronized wikiversions files: group1 to 1.45.0-wmf.11 refs T396372 [production]
18:48 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2225', diff saved to https://phabricator.wikimedia.org/P79771 and previous config saved to /var/cache/conftool/dbconfig/20250723-184801-fceratto.json [production]
18:47 <otto@deploy1003> helmfile [staging] DONE helmfile.d/services/eventgate-logging-external: apply [production]
18:47 <otto@deploy1003> helmfile [staging] START helmfile.d/services/eventgate-logging-external: apply [production]
18:43 <otto@deploy1003> helmfile [staging] DONE helmfile.d/services/eventgate-analytics-external: apply [production]
18:42 <otto@deploy1003> helmfile [staging] START helmfile.d/services/eventgate-analytics-external: apply [production]
18:32 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2225 (T399728)', diff saved to https://phabricator.wikimedia.org/P79770 and previous config saved to /var/cache/conftool/dbconfig/20250723-183254-fceratto.json [production]
18:29 <fceratto@cumin1002> dbctl commit (dc=all): 'Depooling db2225 (T399728)', diff saved to https://phabricator.wikimedia.org/P79769 and previous config saved to /var/cache/conftool/dbconfig/20250723-182951-fceratto.json [production]
18:29 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2225.codfw.wmnet with reason: Maintenance [production]
18:29 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2207 (T399728)', diff saved to https://phabricator.wikimedia.org/P79768 and previous config saved to /var/cache/conftool/dbconfig/20250723-182928-fceratto.json [production]
18:18 <cwhite@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host logstash2032.codfw.wmnet with OS bookworm [production]
18:14 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2207', diff saved to https://phabricator.wikimedia.org/P79767 and previous config saved to /var/cache/conftool/dbconfig/20250723-181420-fceratto.json [production]
17:59 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2207', diff saved to https://phabricator.wikimedia.org/P79766 and previous config saved to /var/cache/conftool/dbconfig/20250723-175912-fceratto.json [production]
17:44 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2207 (T399728)', diff saved to https://phabricator.wikimedia.org/P79765 and previous config saved to /var/cache/conftool/dbconfig/20250723-174405-fceratto.json [production]
17:42 <cmooney@cumin1003> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'configure' for AS: 8309 [production]
17:41 <cmooney@cumin1003> START - Cookbook sre.network.peering with action 'configure' for AS: 8309 [production]
17:41 <fceratto@cumin1002> dbctl commit (dc=all): 'Depooling db2207 (T399728)', diff saved to https://phabricator.wikimedia.org/P79764 and previous config saved to /var/cache/conftool/dbconfig/20250723-174104-fceratto.json [production]
17:40 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2207.codfw.wmnet with reason: Maintenance [production]
17:39 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2197.codfw.wmnet with reason: Maintenance [production]
17:39 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2189 (T399728)', diff saved to https://phabricator.wikimedia.org/P79763 and previous config saved to /var/cache/conftool/dbconfig/20250723-173930-fceratto.json [production]
17:37 <cmooney@cumin1003> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'configure' for AS: 63516 [production]
17:37 <cmooney@cumin1003> START - Cookbook sre.network.peering with action 'configure' for AS: 63516 [production]
17:25 <swfrench-wmf> deleted tags for docker-registry.discovery.wmnet/httpd-bookworm - T378128 [production]
17:24 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2189', diff saved to https://phabricator.wikimedia.org/P79762 and previous config saved to /var/cache/conftool/dbconfig/20250723-172423-fceratto.json [production]
17:23 <swfrench-wmf> deleted tags for docker-registry.discovery.wmnet/httpd-fcgi-bookworm - T378128 [production]
17:22 <swfrench-wmf> deleted tags for docker-registry.discovery.wmnet/mediawiki-httpd-bookworm - T378128 [production]
17:11 <swfrench@deploy1003> Finished scap sync-world: Deploy to remove php-ldap from debug images (duration: 03m 29s) [production]
17:09 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2189', diff saved to https://phabricator.wikimedia.org/P79761 and previous config saved to /var/cache/conftool/dbconfig/20250723-170915-fceratto.json [production]
17:08 <swfrench@deploy1003> Started scap sync-world: Deploy to remove php-ldap from debug images [production]
16:58 <cwhite@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on logstash2032.codfw.wmnet with reason: host reimage [production]
16:54 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2189 (T399728)', diff saved to https://phabricator.wikimedia.org/P79759 and previous config saved to /var/cache/conftool/dbconfig/20250723-165407-fceratto.json [production]
16:53 <cwhite@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on logstash2032.codfw.wmnet with reason: host reimage [production]
16:51 <fceratto@cumin1002> dbctl commit (dc=all): 'Depooling db2189 (T399728)', diff saved to https://phabricator.wikimedia.org/P79758 and previous config saved to /var/cache/conftool/dbconfig/20250723-165106-fceratto.json [production]
16:50 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2189.codfw.wmnet with reason: Maintenance [production]
16:50 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2175 (T399728)', diff saved to https://phabricator.wikimedia.org/P79757 and previous config saved to /var/cache/conftool/dbconfig/20250723-165043-fceratto.json [production]
16:35 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2175', diff saved to https://phabricator.wikimedia.org/P79756 and previous config saved to /var/cache/conftool/dbconfig/20250723-163536-fceratto.json [production]
16:31 <cwhite@cumin2002> START - Cookbook sre.hosts.reimage for host logstash2032.codfw.wmnet with OS bookworm [production]
16:30 <cwhite@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host logstash2031.codfw.wmnet with OS bookworm [production]
16:20 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2175', diff saved to https://phabricator.wikimedia.org/P79755 and previous config saved to /var/cache/conftool/dbconfig/20250723-162028-fceratto.json [production]
16:05 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2175 (T399728)', diff saved to Unable to send diff to phaste and previous config saved to /var/cache/conftool/dbconfig/20250723-160516-fceratto.json [production]
16:02 <fceratto@cumin1002> dbctl commit (dc=all): 'Depooling db2175 (T399728)', diff saved to https://phabricator.wikimedia.org/P79754 and previous config saved to /var/cache/conftool/dbconfig/20250723-160215-fceratto.json [production]
16:02 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2175.codfw.wmnet with reason: Maintenance [production]
16:01 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2148 (T399728)', diff saved to https://phabricator.wikimedia.org/P79753 and previous config saved to /var/cache/conftool/dbconfig/20250723-160152-fceratto.json [production]
15:52 <fceratto@deploy1003> helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . [production]
15:46 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2148', diff saved to https://phabricator.wikimedia.org/P79752 and previous config saved to /var/cache/conftool/dbconfig/20250723-154645-fceratto.json [production]
15:31 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2148', diff saved to https://phabricator.wikimedia.org/P79751 and previous config saved to /var/cache/conftool/dbconfig/20250723-153137-fceratto.json [production]
15:16 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2148 (T399728)', diff saved to https://phabricator.wikimedia.org/P79750 and previous config saved to /var/cache/conftool/dbconfig/20250723-151630-fceratto.json [production]
15:13 <fceratto@cumin1002> dbctl commit (dc=all): 'Depooling db2148 (T399728)', diff saved to https://phabricator.wikimedia.org/P79749 and previous config saved to /var/cache/conftool/dbconfig/20250723-151325-fceratto.json [production]
15:13 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2148.codfw.wmnet with reason: Maintenance [production]
15:03 <cwhite@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on logstash2031.codfw.wmnet with reason: host reimage [production]