|
2025-09-25
ยง
|
| 07:36 |
<jforrester@deploy1003> |
Started scap sync-world: Backport for [[gerrit:1190698|ExperimentXLabManager: allow to re-enroll a user in experiments (T401308)]] |
[production] |
| 07:36 |
<jmm@cumin2002> |
END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1026.eqiad.wmnet |
[production] |
| 07:36 |
<jforrester@deploy1003> |
Finished scap sync-world: Backport for [[gerrit:1190702|Growth [testwiki]: enable new notifications and reduce scheduling time (T404085)]], [[gerrit:1189617|mswikiquote: set timezone, sitename and project namespace (T404700)]], [[gerrit:1189616|mswikiquote: add logo (T404700)]] (duration: 13m 36s) |
[production] |
| 07:35 |
<jmm@cumin2002> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti1026.eqiad.wmnet |
[production] |
| 07:31 |
<jforrester@deploy1003> |
anzx, jforrester, sgimeno: Continuing with sync |
[production] |
| 07:29 |
<jmm@cumin2002> |
START - Cookbook sre.hosts.reboot-single for host ganeti1026.eqiad.wmnet |
[production] |
| 07:28 |
<jforrester@deploy1003> |
anzx, jforrester, sgimeno: Backport for [[gerrit:1190702|Growth [testwiki]: enable new notifications and reduce scheduling time (T404085)]], [[gerrit:1189617|mswikiquote: set timezone, sitename and project namespace (T404700)]], [[gerrit:1189616|mswikiquote: add logo (T404700)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. |
[production] |
| 07:24 |
<jmm@cumin2002> |
START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1026.eqiad.wmnet |
[production] |
| 07:23 |
<jmm@cumin2002> |
END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1025.eqiad.wmnet |
[production] |
| 07:23 |
<jmm@cumin2002> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti1025.eqiad.wmnet |
[production] |
| 07:22 |
<jforrester@deploy1003> |
Started scap sync-world: Backport for [[gerrit:1190702|Growth [testwiki]: enable new notifications and reduce scheduling time (T404085)]], [[gerrit:1189617|mswikiquote: set timezone, sitename and project namespace (T404700)]], [[gerrit:1189616|mswikiquote: add logo (T404700)]] |
[production] |
| 07:17 |
<jmm@cumin2002> |
START - Cookbook sre.hosts.reboot-single for host ganeti1025.eqiad.wmnet |
[production] |
| 07:07 |
<jmm@cumin2002> |
START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1025.eqiad.wmnet |
[production] |
| 07:06 |
<jmm@cumin2002> |
END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1024.eqiad.wmnet |
[production] |
| 07:06 |
<jmm@cumin2002> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti1024.eqiad.wmnet |
[production] |
| 07:00 |
<jmm@cumin2002> |
START - Cookbook sre.hosts.reboot-single for host ganeti1024.eqiad.wmnet |
[production] |
| 06:52 |
<jmm@cumin2002> |
START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1024.eqiad.wmnet |
[production] |
| 06:50 |
<jmm@cumin2002> |
END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1023.eqiad.wmnet |
[production] |
| 06:50 |
<jmm@cumin2002> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti1023.eqiad.wmnet |
[production] |
| 06:44 |
<jmm@cumin2002> |
START - Cookbook sre.hosts.reboot-single for host ganeti1023.eqiad.wmnet |
[production] |
| 06:43 |
<jmm@cumin2002> |
START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1023.eqiad.wmnet |
[production] |
| 06:33 |
<kharlan@deploy1003> |
Finished scap sync-world: Backport for [[gerrit:1191233|CheckUser/UserInfoCard: Phase 2 enable by default on pilot wikis (T405342)]] (duration: 11m 22s) |
[production] |
| 06:31 |
<gehel> |
restarting blazegraph on wdqs-main@codfw |
[production] |
| 06:28 |
<kharlan@deploy1003> |
kharlan: Continuing with sync |
[production] |
| 06:26 |
<kharlan@deploy1003> |
kharlan: Backport for [[gerrit:1191233|CheckUser/UserInfoCard: Phase 2 enable by default on pilot wikis (T405342)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. |
[production] |
| 06:21 |
<kharlan@deploy1003> |
Started scap sync-world: Backport for [[gerrit:1191233|CheckUser/UserInfoCard: Phase 2 enable by default on pilot wikis (T405342)]] |
[production] |
| 05:30 |
<kart_> |
staging: Updated cxserver to 2025-09-25-051716-production (T394982) |
[production] |
| 05:27 |
<kartik@deploy1003> |
helmfile [staging] DONE helmfile.d/services/cxserver: apply |
[production] |
| 05:26 |
<kartik@deploy1003> |
helmfile [staging] START helmfile.d/services/cxserver: apply |
[production] |
| 05:03 |
<eileen> |
civicrm upgraded from c1a08ee7 to a53165c1 |
[production] |
| 04:56 |
<eileen> |
civicrm upgraded from 67156d98 to c1a08ee7 |
[production] |
| 03:35 |
<eileen> |
civicrm upgraded from c9211920 to 67156d98 |
[production] |
| 02:18 |
<eileen> |
civicrm upgraded from 6ce95d83 to c9211920 |
[production] |
| 01:33 |
<jclark@cumin1002> |
END (PASS) - Cookbook sre.dns.netbox (exit_code=0) |
[production] |
| 01:31 |
<jclark@cumin1002> |
START - Cookbook sre.dns.netbox |
[production] |
| 01:29 |
<jclark@cumin1002> |
END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host an-worker1210.eqiad.wmnet with OS bullseye |
[production] |
| 01:29 |
<jclark@cumin1002> |
START - Cookbook sre.hosts.reimage for host an-worker1210.eqiad.wmnet with OS bullseye |
[production] |
| 01:20 |
<jclark@cumin1002> |
END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host an-worker1210.eqiad.wmnet with OS bullseye |
[production] |
| 01:20 |
<jclark@cumin1002> |
START - Cookbook sre.hosts.reimage for host an-worker1210.eqiad.wmnet with OS bullseye |
[production] |
| 01:15 |
<jclark@cumin1002> |
END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host an-worker1210.eqiad.wmnet with OS bullseye |
[production] |
| 01:15 |
<jclark@cumin1002> |
START - Cookbook sre.hosts.reimage for host an-worker1210.eqiad.wmnet with OS bullseye |
[production] |
| 01:13 |
<jclark@cumin1002> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host an-worker1231.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED |
[production] |
| 01:11 |
<jclark@cumin1002> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host an-worker1229.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED |
[production] |
| 01:11 |
<jclark@cumin1002> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host an-worker1230.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED |
[production] |
| 01:11 |
<jclark@cumin1002> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host an-worker1232.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED |
[production] |
| 01:08 |
<jclark@cumin1002> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host an-worker1216.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED |
[production] |
| 00:49 |
<eileen> |
civicrm upgraded from cf8bdf15 to 6ce95d83 |
[production] |
| 00:48 |
<jclark@cumin1002> |
START - Cookbook sre.hosts.provision for host an-worker1216.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED |
[production] |
| 00:48 |
<jclark@cumin1002> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host an-worker1228.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED |
[production] |
| 00:46 |
<jclark@cumin1002> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host an-worker1227.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED |
[production] |