|
2025-07-03
ยง
|
| 21:21 |
<jmm@cumin2002> |
END (PASS) - Cookbook sre.ganeti.changedisk (exit_code=0) for changing disk type of bast6003.wikimedia.org to plain |
[production] |
| 21:19 |
<jmm@cumin2002> |
START - Cookbook sre.ganeti.changedisk for changing disk type of bast6003.wikimedia.org to plain |
[production] |
| 21:18 |
<jmm@cumin2002> |
END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti6001.drmrs.wmnet |
[production] |
| 21:17 |
<jmm@cumin2002> |
START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti6001.drmrs.wmnet |
[production] |
| 21:16 |
<jmm@cumin2002> |
END (PASS) - Cookbook sre.ganeti.changedisk (exit_code=0) for changing disk type of bast6003.wikimedia.org to drbd |
[production] |
| 21:16 |
<zabe@deploy1003> |
Finished scap sync-world: Backport for [[gerrit:1166178|special: Do not throw ErrorPageError from getRedirect() (T398167)]], [[gerrit:1166264|Set categorylinks to read new on small wikis (T397912)]] (duration: 08m 37s) |
[production] |
| 21:11 |
<zabe@deploy1003> |
kharlan, zabe: Continuing with sync |
[production] |
| 21:09 |
<zabe@deploy1003> |
kharlan, zabe: Backport for [[gerrit:1166178|special: Do not throw ErrorPageError from getRedirect() (T398167)]], [[gerrit:1166264|Set categorylinks to read new on small wikis (T397912)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. |
[production] |
| 21:08 |
<zabe@deploy1003> |
Started scap sync-world: Backport for [[gerrit:1166178|special: Do not throw ErrorPageError from getRedirect() (T398167)]], [[gerrit:1166264|Set categorylinks to read new on small wikis (T397912)]] |
[production] |
| 20:58 |
<jmm@cumin2002> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host bast1003.wikimedia.org |
[production] |
| 20:55 |
<jmm@cumin2002> |
START - Cookbook sre.ganeti.changedisk for changing disk type of bast6003.wikimedia.org to drbd |
[production] |
| 20:51 |
<jmm@cumin2002> |
START - Cookbook sre.hosts.reboot-single for host bast1003.wikimedia.org |
[production] |
| 20:47 |
<arlolra@deploy1003> |
Finished scap sync-world: Backport for [[gerrit:1166236|Use FallbackContentHandler for undeployed JsonConfig content handlers (T124748)]], [[gerrit:1166012|ExtensionDistributor: Mark 1.44 as stable; remove 1.42 as EOL (T390798 T389313)]] (duration: 08m 27s) |
[production] |
| 20:41 |
<arlolra@deploy1003> |
arlolra, matmarex: Continuing with sync |
[production] |
| 20:40 |
<arlolra@deploy1003> |
arlolra, matmarex: Backport for [[gerrit:1166236|Use FallbackContentHandler for undeployed JsonConfig content handlers (T124748)]], [[gerrit:1166012|ExtensionDistributor: Mark 1.44 as stable; remove 1.42 as EOL (T390798 T389313)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. |
[production] |
| 20:38 |
<arlolra@deploy1003> |
Started scap sync-world: Backport for [[gerrit:1166236|Use FallbackContentHandler for undeployed JsonConfig content handlers (T124748)]], [[gerrit:1166012|ExtensionDistributor: Mark 1.44 as stable; remove 1.42 as EOL (T390798 T389313)]] |
[production] |
| 20:36 |
<cscott@deploy1003> |
Finished scap sync-world: Backport for [[gerrit:1166206|skin: Omit "rendered with" phrase when the message is disabled (T398616)]] (duration: 08m 30s) |
[production] |
| 20:30 |
<cscott@deploy1003> |
cscott: Continuing with sync |
[production] |
| 20:29 |
<cscott@deploy1003> |
cscott: Backport for [[gerrit:1166206|skin: Omit "rendered with" phrase when the message is disabled (T398616)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. |
[production] |
| 20:27 |
<cscott@deploy1003> |
Started scap sync-world: Backport for [[gerrit:1166206|skin: Omit "rendered with" phrase when the message is disabled (T398616)]] |
[production] |
| 20:11 |
<zabe@deploy1003> |
Finished scap sync-world: Backport for [[gerrit:1166133|Use correct index on categorylinks (T385890)]] (duration: 08m 32s) |
[production] |
| 20:06 |
<zabe@deploy1003> |
zabe: Continuing with sync |
[production] |
| 20:05 |
<zabe@deploy1003> |
zabe: Backport for [[gerrit:1166133|Use correct index on categorylinks (T385890)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. |
[production] |
| 20:03 |
<zabe@deploy1003> |
Started scap sync-world: Backport for [[gerrit:1166133|Use correct index on categorylinks (T385890)]] |
[production] |
| 19:36 |
<joal@deploy1003> |
Finished deploy [airflow-dags/analytics@7ba4a7b]: BUGFIX - Synchronize artifact for airflow_dags/analytics (duration: 01m 02s) |
[production] |
| 19:35 |
<joal@deploy1003> |
Started deploy [airflow-dags/analytics@7ba4a7b]: BUGFIX - Synchronize artifact for airflow_dags/analytics |
[production] |
| 19:34 |
<joal@deploy1003> |
Finished deploy [airflow-dags/analytics_test@7ba4a7b]: BUGFIX - Synchronize artifact for airflow_dags/analytics_test (duration: 00m 16s) |
[production] |
| 19:34 |
<joal@deploy1003> |
Started deploy [airflow-dags/analytics_test@7ba4a7b]: BUGFIX - Synchronize artifact for airflow_dags/analytics_test |
[production] |
| 17:33 |
<stevemunene@cumin1002> |
END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host an-worker1176.eqiad.wmnet with OS bullseye |
[production] |
| 17:26 |
<joal@deploy1003> |
Finished deploy [airflow-dags/analytics@9088e59]: Synchronize artifacts for airflow_dags/analytics (duration: 00m 40s) |
[production] |
| 17:25 |
<joal@deploy1003> |
Started deploy [airflow-dags/analytics@9088e59]: Synchronize artifacts for airflow_dags/analytics |
[production] |
| 17:24 |
<joal@deploy1003> |
Finished deploy [airflow-dags/analytics_test@9088e59]: Synchronize artifacat for airflow_dags/analytics_test (duration: 00m 15s) |
[production] |
| 17:24 |
<joal@deploy1003> |
Started deploy [airflow-dags/analytics_test@9088e59]: Synchronize artifacat for airflow_dags/analytics_test |
[production] |
| 17:18 |
<stevemunene@cumin1002> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on an-worker1176.eqiad.wmnet with reason: host reimage |
[production] |
| 17:15 |
<stevemunene@cumin1002> |
START - Cookbook sre.hosts.downtime for 2:00:00 on an-worker1176.eqiad.wmnet with reason: host reimage |
[production] |
| 17:13 |
<cmooney@cumin1003> |
END (PASS) - Cookbook sre.netbox.update-extras (exit_code=0) rolling restart_daemons on A:netbox |
[production] |
| 17:13 |
<cmooney@cumin1003> |
START - Cookbook sre.netbox.update-extras rolling restart_daemons on A:netbox |
[production] |
| 17:13 |
<cmooney@cumin1003> |
END (PASS) - Cookbook sre.netbox.update-extras (exit_code=0) rolling restart_daemons on A:netbox-canary |
[production] |
| 17:12 |
<cmooney@cumin1003> |
START - Cookbook sre.netbox.update-extras rolling restart_daemons on A:netbox-canary |
[production] |
| 17:01 |
<stevemunene@cumin1002> |
START - Cookbook sre.hosts.reimage for host an-worker1176.eqiad.wmnet with OS bullseye |
[production] |
| 16:32 |
<hnowlan@deploy1003> |
helmfile [eqiad] DONE helmfile.d/services/api-gateway: apply |
[production] |
| 16:32 |
<hnowlan@deploy1003> |
helmfile [eqiad] START helmfile.d/services/api-gateway: apply |
[production] |
| 16:32 |
<hnowlan@deploy1003> |
helmfile [codfw] DONE helmfile.d/services/api-gateway: apply |
[production] |
| 16:31 |
<hnowlan@deploy1003> |
helmfile [codfw] START helmfile.d/services/api-gateway: apply |
[production] |
| 16:11 |
<vgutierrez> |
repooling cp7006 |
[production] |
| 16:09 |
<vgutierrez@cumin1002> |
END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for cp7006.magru.wmnet |
[production] |
| 16:09 |
<vgutierrez@cumin1002> |
START - Cookbook sre.hosts.remove-downtime for cp7006.magru.wmnet |
[production] |
| 15:52 |
<hnowlan@deploy1003> |
helmfile [eqiad] DONE helmfile.d/services/api-gateway: apply |
[production] |
| 15:52 |
<hnowlan@deploy1003> |
helmfile [eqiad] START helmfile.d/services/api-gateway: apply |
[production] |
| 15:46 |
<hnowlan@deploy1003> |
helmfile [codfw] DONE helmfile.d/services/api-gateway: apply |
[production] |