|
2025-11-11
ยง
|
| 15:39 |
<wm-bot2> |
Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/19270642915 (https://github.com/cluebotng/component-configs/commits/3fe913812986e82db75d4a6657cba3f697f5649c) |
[tools.cluebotng-review] |
| 15:39 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2246.codfw.wmnet with reason: Maintenance |
[production] |
| 15:39 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2245 (T407997)', diff saved to https://phabricator.wikimedia.org/P85188 and previous config saved to /var/cache/conftool/dbconfig/20251111-153918-marostegui.json |
[production] |
| 15:38 |
<jmm@cumin2002> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti-test2002.codfw.wmnet |
[production] |
| 15:38 |
<wm-bot2> |
Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/19270642949 (https://github.com/cluebotng/component-configs/commits/3fe913812986e82db75d4a6657cba3f697f5649c) |
[tools.cluebotng-staging] |
| 15:37 |
<wm-bot2> |
Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/19270642882 (https://github.com/cluebotng/component-configs/commits/3fe913812986e82db75d4a6657cba3f697f5649c) |
[tools.cluebotng-trainer] |
| 15:37 |
<wm-bot2> |
Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/19270643026 (https://github.com/cluebotng/component-configs/commits/3fe913812986e82db75d4a6657cba3f697f5649c) |
[tools.toolforge-functional-runner] |
| 15:37 |
<wm-bot2> |
Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/19270642926 (https://github.com/cluebotng/component-configs/commits/3fe913812986e82db75d4a6657cba3f697f5649c) |
[tools.cluebot-syncer] |
| 15:37 |
<wm-bot2> |
Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/19270642903 (https://github.com/cluebotng/component-configs/commits/3fe913812986e82db75d4a6657cba3f697f5649c) |
[tools.cluebot3] |
| 15:37 |
<wm-bot2> |
Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/19270642885 (https://github.com/cluebotng/component-configs/commits/3fe913812986e82db75d4a6657cba3f697f5649c) |
[tools.cluebotng-editsets] |
| 15:36 |
<wm-bot2> |
Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/19270642865 (https://github.com/cluebotng/component-configs/commits/3fe913812986e82db75d4a6657cba3f697f5649c) |
[tools.cluebotng] |
| 15:36 |
<wm-bot2> |
Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/19270642940 (https://github.com/cluebotng/component-configs/commits/3fe913812986e82db75d4a6657cba3f697f5649c) |
[tools.cluebotng-monitoring] |
| 15:32 |
<jmm@cumin2002> |
START - Cookbook sre.hosts.reboot-single for host ganeti-test2002.codfw.wmnet |
[production] |
| 15:31 |
<wm-bot2> |
Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/19270294471 (https://github.com/cluebotng/component-configs/commits/df4e433c6a567df4484b7115ddf2c53fe1f9494f) |
[tools.cluebotng-monitoring] |
| 15:30 |
<wm-bot2> |
Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/19270301650 (https://github.com/cluebotng/component-configs/commits/f28dcaec8c5882b4a1b7d861fe7f5e400312a5b4) |
[tools.cluebotng] |
| 15:28 |
<volans@cloudcumin1001> |
END (PASS) - Cookbook wmcs.toolforge.k8s.logging.copy_images_to_registry (exit_code=0) for Loki 3.5.7 (T399313) |
[tools] |
| 15:28 |
<wm-bot2> |
Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/19270313845 (https://github.com/cluebotng/component-configs/commits/900a30b8983bc80a537330fa4345e7952f2081b4) |
[tools.cluebotng-trainer] |
| 15:28 |
<volans@cloudcumin1001> |
Updating container image docker-registry.svc.toolforge.org/grafana/loki:3.5.7 (T399313) |
[tools] |
| 15:28 |
<volans@cloudcumin1001> |
START - Cookbook wmcs.toolforge.k8s.logging.copy_images_to_registry for Loki 3.5.7 (T399313) |
[tools] |
| 15:27 |
<wm-bot2> |
Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/19270285003 (https://github.com/cluebotng/component-configs/commits/e103f6ac56b26a2d6e3c0705c81c75a4419287cc) |
[tools.cluebotng-monitoring] |
| 15:27 |
<wm-bot2> |
Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/19270301618 (https://github.com/cluebotng/component-configs/commits/f28dcaec8c5882b4a1b7d861fe7f5e400312a5b4) |
[tools.cluebotng-staging] |
| 15:27 |
<wm-bot2> |
Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/19270263370 (https://github.com/cluebotng/component-configs/commits/d1674e8f4f6cec3b48e848137ce42585278d4a67) |
[tools.cluebotng-review] |
| 15:26 |
<wm-bot2> |
Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/19270303362 (https://github.com/cluebotng/component-configs/commits/df94fd299dd1ed07436488c348bad61d859da592) |
[tools.cluebot-syncer] |
| 15:25 |
<wm-bot2> |
Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/19270264807 (https://github.com/cluebotng/component-configs/commits/531100511571d8262fc874f0f4cddfa2df3d6c2b) |
[tools.cluebotng-trainer] |
| 15:25 |
<wm-bot2> |
Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/19270264790 (https://github.com/cluebotng/component-configs/commits/531100511571d8262fc874f0f4cddfa2df3d6c2b) |
[tools.toolforge-functional-runner] |
| 15:25 |
<wm-bot2> |
Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/19270276189 (https://github.com/cluebotng/component-configs/commits/040b83debcd71b207ee872095a3d2a1166ccc618) |
[tools.cluebotng-editsets] |
| 15:24 |
<wm-bot2> |
Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/19270254406 (https://github.com/cluebotng/component-configs/commits/5dfa0eff0c51e0d878863a5ac689e59f79d59876) |
[tools.cluebot3] |
| 15:24 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2245', diff saved to https://phabricator.wikimedia.org/P85187 and previous config saved to /var/cache/conftool/dbconfig/20251111-152410-marostegui.json |
[production] |
| 15:09 |
<kostajh> |
UTC afternoon deploys done |
[production] |
| 15:09 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2245', diff saved to https://phabricator.wikimedia.org/P85186 and previous config saved to /var/cache/conftool/dbconfig/20251111-150902-marostegui.json |
[production] |
| 15:04 |
<kharlan@deploy2002> |
Finished scap sync-world: Backport for [[gerrit:1203547|hCaptcha: Use FancyCaptcha for API edits and page creations (T405595)]], [[gerrit:1203797|hCaptcha: Disable addurl trigger for hCaptcha edits (T409822)]] (duration: 12m 38s) |
[production] |
| 14:59 |
<kharlan@deploy2002> |
kharlan: Continuing with sync |
[production] |
| 14:54 |
<kharlan@deploy2002> |
kharlan: Backport for [[gerrit:1203547|hCaptcha: Use FancyCaptcha for API edits and page creations (T405595)]], [[gerrit:1203797|hCaptcha: Disable addurl trigger for hCaptcha edits (T409822)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. |
[production] |
| 14:53 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2245 (T407997)', diff saved to https://phabricator.wikimedia.org/P85185 and previous config saved to /var/cache/conftool/dbconfig/20251111-145355-marostegui.json |
[production] |
| 14:52 |
<kharlan@deploy2002> |
Started scap sync-world: Backport for [[gerrit:1203547|hCaptcha: Use FancyCaptcha for API edits and page creations (T405595)]], [[gerrit:1203797|hCaptcha: Disable addurl trigger for hCaptcha edits (T409822)]] |
[production] |
| 14:49 |
<jmm@cumin2002> |
END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host es2028.codfw.wmnet with OS trixie |
[production] |
| 14:47 |
<kharlan@deploy2002> |
Finished scap sync-world: Backport for [[gerrit:1203824|Instrument hCaptcha risk signal in edits (T405597)]] (duration: 09m 15s) |
[production] |
| 14:47 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Depooling db2245 (T407997)', diff saved to https://phabricator.wikimedia.org/P85184 and previous config saved to /var/cache/conftool/dbconfig/20251111-144711-marostegui.json |
[production] |
| 14:47 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2245.codfw.wmnet with reason: Maintenance |
[production] |
| 14:46 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2240 (T407997)', diff saved to https://phabricator.wikimedia.org/P85183 and previous config saved to /var/cache/conftool/dbconfig/20251111-144648-marostegui.json |
[production] |
| 14:43 |
<kharlan@deploy2002> |
kharlan: Continuing with sync |
[production] |
| 14:40 |
<kharlan@deploy2002> |
kharlan: Backport for [[gerrit:1203824|Instrument hCaptcha risk signal in edits (T405597)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. |
[production] |
| 14:40 |
<cmooney@cumin1003> |
START - Cookbook sre.hosts.dhcp for host sretest1006.eqiad.wmnet |
[production] |
| 14:40 |
<wm-bot2> |
Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/19268985739 (https://github.com/cluebotng/component-configs/commits/f88bf173399c2591eca2357bbc9bff54ee70b731) |
[tools.cluebotng-monitoring] |
| 14:38 |
<kharlan@deploy2002> |
Started scap sync-world: Backport for [[gerrit:1203824|Instrument hCaptcha risk signal in edits (T405597)]] |
[production] |
| 14:35 |
<kharlan@deploy2002> |
Finished scap sync-world: Backport for [[gerrit:1203566|[arwikibooks] Add an alias for project namespace (T409789)]] (duration: 07m 10s) |
[production] |
| 14:33 |
<fceratto@cumin1003> |
END (FAIL) - Cookbook sre.mysql.clone (exit_code=99) of db2230.codfw.wmnet onto db-test2001.codfw.wmnet |
[production] |
| 14:31 |
<kharlan@deploy2002> |
superpes, kharlan: Continuing with sync |
[production] |
| 14:31 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db2240', diff saved to https://phabricator.wikimedia.org/P85182 and previous config saved to /var/cache/conftool/dbconfig/20251111-143140-marostegui.json |
[production] |
| 14:31 |
<kharlan@deploy2002> |
superpes, kharlan: Backport for [[gerrit:1203566|[arwikibooks] Add an alias for project namespace (T409789)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. |
[production] |