101-150 of 10000 results (21ms)
2026-04-06 ยง
16:43 <fceratto@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db1212.eqiad.wmnet with reason: Maintenance [production]
16:42 <fceratto@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1198 (T419635)', diff saved to https://phabricator.wikimedia.org/P90277 and previous config saved to /var/cache/conftool/dbconfig/20260406-164257-fceratto.json [production]
16:35 <wmftkbot> Test Kitchen edge-unique experiments (poll 76973) - adds: logged-out-retention-round8; removes: none; fields: none - xLab/MPIC/TK tips at https://w.wiki/FwuD [analytics]
16:35 <wmftkbot> Test Kitchen edge-unique experiments (poll 76972) - adds: logged-out-retention-round7; removes: none; fields: none - xLab/MPIC/TK tips at https://w.wiki/FwuD [analytics]
16:32 <fceratto@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1198', diff saved to https://phabricator.wikimedia.org/P90276 and previous config saved to /var/cache/conftool/dbconfig/20260406-163249-fceratto.json [production]
16:32 <eevans@cumin1003> START - Cookbook sre.cassandra.roll-restart for nodes matching A:restbase-codfw: Actually upgrade Cassandra to 4.1.11 โ€” T418417 - eevans@cumin1003 [production]
16:31 <eevans@cumin1003> END (PASS) - Cookbook sre.cassandra.roll-restart (exit_code=0) for nodes matching A:restbase-eqiad: Actually upgrade Cassandra to 4.1.11 โ€” T418417 - eevans@cumin1003 [production]
16:22 <fceratto@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1198', diff saved to https://phabricator.wikimedia.org/P90275 and previous config saved to /var/cache/conftool/dbconfig/20260406-162241-fceratto.json [production]
16:12 <fceratto@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1198 (T419635)', diff saved to https://phabricator.wikimedia.org/P90274 and previous config saved to /var/cache/conftool/dbconfig/20260406-161232-fceratto.json [production]
16:06 <fceratto@cumin1003> dbctl commit (dc=all): 'Depooling db1198 (T419635)', diff saved to https://phabricator.wikimedia.org/P90273 and previous config saved to /var/cache/conftool/dbconfig/20260406-160615-fceratto.json [production]
16:06 <fceratto@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db1198.eqiad.wmnet with reason: Maintenance [production]
16:05 <fceratto@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1175 (T419635)', diff saved to https://phabricator.wikimedia.org/P90272 and previous config saved to /var/cache/conftool/dbconfig/20260406-160551-fceratto.json [production]
16:03 <ejegg> civicrm upgraded from 4ee11209 to 9104e70b [fundraising]
16:01 <dancy> Updating docker-pkg files on contint primary for https://gerrit.wikimedia.org/r/c/integration/config/+/1268239 [releng]
15:55 <fceratto@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1175', diff saved to https://phabricator.wikimedia.org/P90271 and previous config saved to /var/cache/conftool/dbconfig/20260406-155542-fceratto.json [production]
15:45 <fceratto@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1175', diff saved to https://phabricator.wikimedia.org/P90270 and previous config saved to /var/cache/conftool/dbconfig/20260406-154534-fceratto.json [production]
15:35 <fceratto@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1175 (T419635)', diff saved to https://phabricator.wikimedia.org/P90269 and previous config saved to /var/cache/conftool/dbconfig/20260406-153526-fceratto.json [production]
15:29 <fceratto@cumin1003> dbctl commit (dc=all): 'Depooling db1175 (T419635)', diff saved to https://phabricator.wikimedia.org/P90268 and previous config saved to /var/cache/conftool/dbconfig/20260406-152908-fceratto.json [production]
15:29 <fceratto@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db1175.eqiad.wmnet with reason: Maintenance [production]
15:24 <fceratto@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db1166.eqiad.wmnet with reason: Maintenance [production]
15:24 <fceratto@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1157 (T419635)', diff saved to https://phabricator.wikimedia.org/P90267 and previous config saved to /var/cache/conftool/dbconfig/20260406-152409-fceratto.json [production]
15:14 <fceratto@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1157', diff saved to https://phabricator.wikimedia.org/P90266 and previous config saved to /var/cache/conftool/dbconfig/20260406-151401-fceratto.json [production]
15:03 <fceratto@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1157', diff saved to https://phabricator.wikimedia.org/P90265 and previous config saved to /var/cache/conftool/dbconfig/20260406-150353-fceratto.json [production]
14:53 <fceratto@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1157 (T419635)', diff saved to https://phabricator.wikimedia.org/P90264 and previous config saved to /var/cache/conftool/dbconfig/20260406-145344-fceratto.json [production]
14:53 <taavi@cumin1003> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
14:53 <taavi@cumin1003> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: allocate lvs vip for dumps-lb.eqiad - taavi@cumin1003" [production]
14:53 <taavi@cumin1003> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: allocate lvs vip for dumps-lb.eqiad - taavi@cumin1003" [production]
14:49 <taavi@cumin1003> START - Cookbook sre.dns.netbox [production]
14:47 <fceratto@cumin1003> dbctl commit (dc=all): 'Depooling db1157 (T419635)', diff saved to https://phabricator.wikimedia.org/P90263 and previous config saved to /var/cache/conftool/dbconfig/20260406-144734-fceratto.json [production]
14:47 <fceratto@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db1157.eqiad.wmnet with reason: Maintenance [production]
14:40 <vgutierrez@cumin1003> END (PASS) - Cookbook sre.cdn.roll-upgrade-haproxy (exit_code=0) rolling upgrade of HAProxy on P{cp[6001,6009].*} and A:cp - 3.2.15 upgrade (T421402) [production]
14:28 <vgutierrez@cumin1003> START - Cookbook sre.cdn.roll-upgrade-haproxy rolling upgrade of HAProxy on P{cp[6001,6009].*} and A:cp - 3.2.15 upgrade (T421402) [production]
14:27 <vgutierrez> fetch haproxy 3.2.15 on thirdparty/haproxy32 (trixie-wikimedia) - T421402 [production]
14:26 <eevans@cumin1003> START - Cookbook sre.cassandra.roll-restart for nodes matching A:restbase-eqiad: Actually upgrade Cassandra to 4.1.11 โ€” T418417 - eevans@cumin1003 [production]
14:24 <fceratto@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db1150.eqiad.wmnet with reason: Maintenance [production]
13:59 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.tofu (exit_code=0) running tofu plan+apply for main branch [admin]
13:58 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.tofu running tofu plan+apply for main branch [admin]
13:56 <andrew@cloudcumin1001> END (FAIL) - Cookbook wmcs.openstack.tofu (exit_code=99) running tofu plan+apply for main branch [admin]
13:55 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.tofu running tofu plan+apply for main branch [admin]
13:54 <andrew@cloudcumin1001> END (FAIL) - Cookbook wmcs.openstack.tofu (exit_code=99) running tofu plan+apply for main branch [admin]
13:54 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.tofu running tofu plan+apply for main branch [admin]
13:53 <andrew@cloudcumin1001> END (FAIL) - Cookbook wmcs.openstack.tofu (exit_code=99) running tofu plan+apply for main branch [admin]
13:52 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.tofu running tofu plan+apply for main branch [admin]
13:20 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on clouddb1013.eqiad.wmnet with reason: Maintenance [production]
13:06 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on clouddb1023.eqiad.wmnet with reason: Maintenance [production]
12:36 <wmbot~lucaswerkmeister@tools-bastion-15> deployed 5f19f74dbf (l10n updates: ms-arab) [tools.wd-image-positions]
12:36 <wmbot~lucaswerkmeister@tools-bastion-15> deployed 68d0059881 (l10n updates: ms-arab) [tools.lexeme-forms]
12:13 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.parsercache (exit_code=0) [production]
12:13 <marostegui@cumin1003> START - Cookbook sre.mysql.parsercache [production]
12:11 <marostegui@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host pc2015.codfw.wmnet with OS trixie [production]