|
2026-02-23
ยง
|
| 11:35 |
<marostegui@cumin1003> |
END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool pc1011: Depooling pc1 |
[production] |
| 11:35 |
<marostegui@cumin1003> |
END (PASS) - Cookbook sre.mysql.parsercache (exit_code=0) |
[production] |
| 11:34 |
<marostegui@cumin1003> |
START - Cookbook sre.mysql.parsercache |
[production] |
| 11:34 |
<marostegui@cumin1003> |
START - Cookbook sre.mysql.depool depool pc1011: Depooling pc1 |
[production] |
| 11:32 |
<dreamyjazz@deploy2002> |
Finished scap sync-world: Backport for [[gerrit:1240227|Drop $wgIPReputationEnableLoginCaptchaIfIPKnown (T416941)]] (duration: 06m 58s) |
[production] |
| 11:28 |
<dreamyjazz@deploy2002> |
dreamyjazz: Continuing with sync |
[production] |
| 11:28 |
<jayme@cumin1003> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on kubestagemaster2003.codfw.wmnet with reason: host reimage |
[production] |
| 11:27 |
<dreamyjazz@deploy2002> |
dreamyjazz: Backport for [[gerrit:1240227|Drop $wgIPReputationEnableLoginCaptchaIfIPKnown (T416941)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. |
[production] |
| 11:25 |
<dreamyjazz@deploy2002> |
Started scap sync-world: Backport for [[gerrit:1240227|Drop $wgIPReputationEnableLoginCaptchaIfIPKnown (T416941)]] |
[production] |
| 11:23 |
<jayme@cumin1003> |
START - Cookbook sre.hosts.downtime for 2:00:00 on kubestagemaster2003.codfw.wmnet with reason: host reimage |
[production] |
| 11:21 |
<Emperor> |
start reef 18.2.7 upgrade of eqiad apus storage nodes T417396 |
[production] |
| 11:10 |
<marostegui@dns1006> |
END - running authdns-update |
[production] |
| 11:09 |
<marostegui> |
Failover m5-master T414656 |
[production] |
| 11:08 |
<marostegui@dns1006> |
START - running authdns-update |
[production] |
| 11:04 |
<urbanecm@deploy2002> |
Finished scap sync-world: Backport for [[gerrit:1242298|cleanup: Remove unused code]], [[gerrit:1242295|Validate mentor list using a JSON schema (T417422)]], [[gerrit:1242296|Temporarily switch mentor list validation to legacy validator (T417422)]] (duration: 06m 46s) |
[production] |
| 11:02 |
<jayme@cumin1003> |
START - Cookbook sre.hosts.reimage for host kubestagemaster2003.codfw.wmnet with OS trixie |
[production] |
| 11:00 |
<urbanecm@deploy2002> |
urbanecm: Continuing with sync |
[production] |
| 10:59 |
<urbanecm@deploy2002> |
urbanecm: Backport for [[gerrit:1242298|cleanup: Remove unused code]], [[gerrit:1242295|Validate mentor list using a JSON schema (T417422)]], [[gerrit:1242296|Temporarily switch mentor list validation to legacy validator (T417422)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. |
[production] |
| 10:58 |
<jayme@cumin1003> |
START - Cookbook sre.k8s.reimage-stacked-control-plane Reimaging k8s control planes of cluster staging-codfw: trixie upgrade |
[production] |
| 10:57 |
<urbanecm@deploy2002> |
Started scap sync-world: Backport for [[gerrit:1242298|cleanup: Remove unused code]], [[gerrit:1242295|Validate mentor list using a JSON schema (T417422)]], [[gerrit:1242296|Temporarily switch mentor list validation to legacy validator (T417422)]] |
[production] |
| 10:57 |
<fceratto@cumin1003> |
END (PASS) - Cookbook sre.mysql.update-replication (exit_code=0) |
[production] |
| 10:57 |
<fceratto@cumin1003> |
START - Cookbook sre.mysql.update-replication |
[production] |
| 10:56 |
<fceratto@cumin1003> |
END (PASS) - Cookbook sre.mysql.update-replication (exit_code=0) |
[production] |
| 10:56 |
<fceratto@cumin1003> |
START - Cookbook sre.mysql.update-replication |
[production] |
| 10:55 |
<fceratto@cumin1003> |
END (PASS) - Cookbook sre.mysql.update-replication (exit_code=0) |
[production] |
| 10:55 |
<fceratto@cumin1003> |
START - Cookbook sre.mysql.update-replication |
[production] |
| 10:52 |
<fceratto@cumin1003> |
END (PASS) - Cookbook sre.mysql.update-replication (exit_code=0) |
[production] |
| 10:52 |
<fceratto@cumin1003> |
START - Cookbook sre.mysql.update-replication |
[production] |
| 10:43 |
<kamila@cumin1003> |
END (FAIL) - Cookbook sre.k8s.pool-depool-node (exit_code=99) pool for host wikikube-worker2356.codfw.wmnet |
[production] |
| 10:42 |
<kamila@cumin1003> |
START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2356.codfw.wmnet |
[production] |
| 10:41 |
<mvernon@cumin2002> |
END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host apus-fe2005.codfw.wmnet with OS bookworm |
[production] |
| 10:41 |
<mvernon@cumin2002> |
END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - mvernon@cumin2002" |
[production] |
| 10:41 |
<mvernon@cumin2002> |
START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - mvernon@cumin2002" |
[production] |
| 10:36 |
<kamila@cumin1003> |
END (FAIL) - Cookbook sre.k8s.pool-depool-node (exit_code=99) pool for host wikikube-worker2356.codfw.wmnet |
[production] |
| 10:36 |
<kamila@cumin1003> |
START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2356.codfw.wmnet |
[production] |
| 10:23 |
<fceratto@cumin1003> |
END (PASS) - Cookbook sre.mysql.update-replication (exit_code=0) |
[production] |
| 10:21 |
<fceratto@cumin1003> |
START - Cookbook sre.mysql.update-replication |
[production] |
| 10:19 |
<mvernon@cumin2002> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on apus-fe2005.codfw.wmnet with reason: host reimage |
[production] |
| 10:15 |
<mvernon@cumin2002> |
START - Cookbook sre.hosts.downtime for 2:00:00 on apus-fe2005.codfw.wmnet with reason: host reimage |
[production] |
| 10:09 |
<fceratto@cumin1003> |
END (PASS) - Cookbook sre.mysql.update-replication (exit_code=0) |
[production] |
| 10:07 |
<fceratto@cumin1003> |
START - Cookbook sre.mysql.update-replication |
[production] |
| 09:57 |
<mvernon@cumin2002> |
START - Cookbook sre.hosts.reimage for host apus-fe2005.codfw.wmnet with OS bookworm |
[production] |
| 09:57 |
<mvernon@cumin2002> |
END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host apus-fe2004.codfw.wmnet with OS bookworm |
[production] |
| 09:57 |
<mvernon@cumin2002> |
END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - mvernon@cumin2002" |
[production] |
| 09:56 |
<mvernon@cumin2002> |
START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - mvernon@cumin2002" |
[production] |
| 09:55 |
<fceratto@cumin1003> |
END (PASS) - Cookbook sre.mysql.update-replication (exit_code=0) |
[production] |
| 09:54 |
<fceratto@cumin1003> |
START - Cookbook sre.mysql.update-replication |
[production] |
| 09:42 |
<urbanecm@deploy2002> |
Finished scap sync-world: Backport for [[gerrit:1242273|Revert "[Growth] Force legacy validation of GrowthMentorList" (T417422)]] (duration: 06m 00s) |
[production] |
| 09:36 |
<urbanecm@deploy2002> |
Started scap sync-world: Backport for [[gerrit:1242273|Revert "[Growth] Force legacy validation of GrowthMentorList" (T417422)]] |
[production] |
| 09:35 |
<mvernon@cumin2002> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on apus-fe2004.codfw.wmnet with reason: host reimage |
[production] |