51-100 of 10000 results (23ms)
2026-02-18 ยง
21:19 <jhancock@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" [production]
21:16 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2179', diff saved to https://phabricator.wikimedia.org/P88885 and previous config saved to /var/cache/conftool/dbconfig/20260218-211640-marostegui.json [production]
21:10 <sgimeno@deploy2002> Finished scap sync-world: Backport for [[gerrit:1240032|[Growth] Specify notification delay as int instead of array (T375198 T415536)]] (duration: 07m 48s) [production]
21:10 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host backup2017.codfw.wmnet with OS trixie [production]
21:10 <jhancock@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" [production]
21:10 <jhancock@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" [production]
21:06 <sgimeno@deploy2002> sgimeno: Continuing with sync [production]
21:05 <sgimeno@deploy2002> sgimeno: Backport for [[gerrit:1240032|[Growth] Specify notification delay as int instead of array (T375198 T415536)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
21:03 <sgimeno@deploy2002> Started scap sync-world: Backport for [[gerrit:1240032|[Growth] Specify notification delay as int instead of array (T375198 T415536)]] [production]
21:01 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2179', diff saved to https://phabricator.wikimedia.org/P88884 and previous config saved to /var/cache/conftool/dbconfig/20260218-210132-marostegui.json [production]
20:58 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on backup2018.codfw.wmnet with reason: host reimage [production]
20:54 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on backup2017.codfw.wmnet with reason: host reimage [production]
20:50 <jhancock@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on backup2018.codfw.wmnet with reason: host reimage [production]
20:50 <jhancock@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on backup2017.codfw.wmnet with reason: host reimage [production]
20:46 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2179 (T415786)', diff saved to https://phabricator.wikimedia.org/P88883 and previous config saved to /var/cache/conftool/dbconfig/20260218-204624-marostegui.json [production]
20:38 <eileen> civicrm upgraded from f5020a85 to ac30e19f [fundraising]
20:35 <jhancock@cumin2002> START - Cookbook sre.hosts.reimage for host backup2018.codfw.wmnet with OS trixie [production]
20:34 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host backup2018.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
20:34 <jhancock@cumin2002> START - Cookbook sre.hosts.reimage for host backup2017.codfw.wmnet with OS trixie [production]
20:29 <jhancock@cumin2002> START - Cookbook sre.hosts.provision for host backup2018.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
20:20 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host backup2015.codfw.wmnet with OS trixie [production]
20:20 <jhancock@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" [production]
20:20 <jhancock@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" [production]
20:19 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host backup2016.codfw.wmnet with OS trixie [production]
20:19 <jhancock@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" [production]
20:17 <jeena> Updating development images on contint primary for T415922 [releng]
20:15 <jhancock@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" [production]
20:04 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on backup2015.codfw.wmnet with reason: host reimage [production]
20:01 <jhancock@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on backup2015.codfw.wmnet with reason: host reimage [production]
19:53 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on backup2016.codfw.wmnet with reason: host reimage [production]
19:48 <jhancock@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on backup2016.codfw.wmnet with reason: host reimage [production]
19:45 <jhancock@cumin2002> START - Cookbook sre.hosts.reimage for host backup2015.codfw.wmnet with OS trixie [production]
19:44 <Reedy> Reloading Zuul to deploy https://gerrit.wikimedia.org/r/1240360 [releng]
19:40 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host backup2015.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
19:32 <jhancock@cumin2002> START - Cookbook sre.hosts.reimage for host backup2016.codfw.wmnet with OS trixie [production]
19:30 <jhancock@cumin2002> START - Cookbook sre.hosts.provision for host backup2015.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
19:30 <marostegui@cumin1003> dbctl commit (dc=all): 'Depooling db1221 (T415786)', diff saved to https://phabricator.wikimedia.org/P88882 and previous config saved to /var/cache/conftool/dbconfig/20260218-193017-marostegui.json [production]
19:30 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2 days, 0:00:00 on 6 hosts with reason: Maintenance [production]
19:29 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1221.eqiad.wmnet with reason: Maintenance [production]
19:29 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1199 (T415786)', diff saved to https://phabricator.wikimedia.org/P88881 and previous config saved to /var/cache/conftool/dbconfig/20260218-192929-marostegui.json [production]
19:28 <dancy@deploy2002> rebuilt and synchronized wikiversions files: group1 to 1.46.0-wmf.16 refs T413807 [production]
19:22 <eileen> civicrm upgraded from 66d2e1dd to f5020a85 [fundraising]
19:14 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1199', diff saved to https://phabricator.wikimedia.org/P88880 and previous config saved to /var/cache/conftool/dbconfig/20260218-191420-marostegui.json [production]
19:05 <brett> import haproxykafka 0.3.16+deb13u1 into trixie-wikimedia (T401832) [production]
18:59 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1199', diff saved to https://phabricator.wikimedia.org/P88879 and previous config saved to /var/cache/conftool/dbconfig/20260218-185912-marostegui.json [production]
18:50 <ladsgroup@deploy2002> Finished scap sync-world: Backport for [[gerrit:1240337|Make Pdf thumbs follow the thumb steps (T402792 T414805)]] (duration: 07m 43s) [production]
18:46 <ladsgroup@deploy2002> ladsgroup: Continuing with sync [production]
18:44 <ladsgroup@deploy2002> ladsgroup: Backport for [[gerrit:1240337|Make Pdf thumbs follow the thumb steps (T402792 T414805)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
18:44 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1199 (T415786)', diff saved to https://phabricator.wikimedia.org/P88878 and previous config saved to /var/cache/conftool/dbconfig/20260218-184405-marostegui.json [production]
18:42 <ladsgroup@deploy2002> Started scap sync-world: Backport for [[gerrit:1240337|Make Pdf thumbs follow the thumb steps (T402792 T414805)]] [production]