|
2024-01-08
§
|
| 11:35 |
<marostegui@cumin1002> |
START - Cookbook sre.hosts.downtime for 2:00:00 on db2117.codfw.wmnet with reason: host reimage |
[production] |
| 11:29 |
<ladsgroup@deploy2002> |
Finished scap: Backport for [[gerrit:988456|Stop writing to the old columns of pagelinks in testwiki (T352010)]] (duration: 10m 02s) |
[production] |
| 11:23 |
<ladsgroup@deploy2002> |
ladsgroup: Continuing with sync |
[production] |
| 11:20 |
<ladsgroup@deploy2002> |
ladsgroup: Backport for [[gerrit:988456|Stop writing to the old columns of pagelinks in testwiki (T352010)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) |
[production] |
| 11:19 |
<ladsgroup@deploy2002> |
Started scap: Backport for [[gerrit:988456|Stop writing to the old columns of pagelinks in testwiki (T352010)]] |
[production] |
| 11:17 |
<marostegui@cumin1002> |
START - Cookbook sre.hosts.reimage for host db2117.codfw.wmnet with OS bookworm |
[production] |
| 11:14 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Depool db2117 T354506', diff saved to https://phabricator.wikimedia.org/P54533 and previous config saved to /var/cache/conftool/dbconfig/20240108-111452-root.json |
[production] |
| 10:36 |
<XioNoX> |
repool eqsin - T332395 |
[production] |
| 10:33 |
<pfischer@deploy2002> |
helmfile [staging] DONE helmfile.d/services/cirrus-streaming-updater: apply |
[production] |
| 10:32 |
<pfischer@deploy2002> |
helmfile [staging] START helmfile.d/services/cirrus-streaming-updater: apply |
[production] |
| 10:21 |
<ladsgroup@deploy2002> |
Finished scap: Backport for [[gerrit:987861|styles: Replace obsolete WikimediaUI Base var with Codex alias]] (duration: 07m 32s) |
[production] |
| 10:20 |
<klausman@deploy2002> |
helmfile [ml-staging-codfw] DONE helmfile.d/admin 'apply'. |
[production] |
| 10:20 |
<klausman@deploy2002> |
helmfile [ml-staging-codfw] START helmfile.d/admin 'apply'. |
[production] |
| 10:15 |
<ladsgroup@deploy2002> |
volker-e and ladsgroup: Continuing with sync |
[production] |
| 10:15 |
<ladsgroup@deploy2002> |
volker-e and ladsgroup: Backport for [[gerrit:987861|styles: Replace obsolete WikimediaUI Base var with Codex alias]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) |
[production] |
| 10:14 |
<ladsgroup@deploy2002> |
Started scap: Backport for [[gerrit:987861|styles: Replace obsolete WikimediaUI Base var with Codex alias]] |
[production] |
| 10:11 |
<ladsgroup@deploy2002> |
Finished scap: Backport for [[gerrit:987657|Set commonswiki pagelinks migration stage to READ NEW (T351237)]] (duration: 08m 52s) |
[production] |
| 10:05 |
<ladsgroup@deploy2002> |
ladsgroup: Continuing with sync |
[production] |
| 10:04 |
<ladsgroup@deploy2002> |
ladsgroup: Backport for [[gerrit:987657|Set commonswiki pagelinks migration stage to READ NEW (T351237)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) |
[production] |
| 10:02 |
<ladsgroup@deploy2002> |
Started scap: Backport for [[gerrit:987657|Set commonswiki pagelinks migration stage to READ NEW (T351237)]] |
[production] |
| 09:54 |
<XioNoX> |
asw1-eqsin> request system reboot - T332395 |
[production] |
| 09:32 |
<Emperor> |
reboot ms-be2074-80 before adding them to the rings T353149 |
[production] |
| 09:32 |
<Emperor> |
reboot ms-be1072-82 before adding them to the rings T353149 |
[production] |
| 09:24 |
<XioNoX> |
start install process on asw1-eqsin - T332395 |
[production] |
| 09:05 |
<ayounsi@cumin1002> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on 35 hosts with reason: eqsin switch upgrade |
[production] |
| 09:04 |
<ayounsi@cumin1002> |
START - Cookbook sre.hosts.downtime for 2:00:00 on 35 hosts with reason: eqsin switch upgrade |
[production] |
| 09:03 |
<XioNoX> |
depool eqsin for switch upgrade - T332395 |
[production] |
| 08:27 |
<xSavitar> |
UTC morning backport window done. |
[production] |
| 08:26 |
<derick@deploy2002> |
Finished scap: Backport for [[gerrit:974508|wmf-config: Remove unused wgStatsCacheType setting (T336004)]] (duration: 09m 11s) |
[production] |
| 08:19 |
<derick@deploy2002> |
derick and d3r1ck01: Continuing with sync |
[production] |
| 08:18 |
<derick@deploy2002> |
derick and d3r1ck01: Backport for [[gerrit:974508|wmf-config: Remove unused wgStatsCacheType setting (T336004)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) |
[production] |
| 08:17 |
<derick@deploy2002> |
Started scap: Backport for [[gerrit:974508|wmf-config: Remove unused wgStatsCacheType setting (T336004)]] |
[production] |
|
2024-01-05
§
|
| 23:49 |
<thcipriani@deploy2002> |
Finished deploy [gerrit/gerrit@de3a994]: Removing survey banner [[gerrit:987995]] (gerrit.wikimedia.org only this deploy) (duration: 00m 08s) |
[production] |
| 23:49 |
<thcipriani@deploy2002> |
Started deploy [gerrit/gerrit@de3a994]: Removing survey banner [[gerrit:987995]] (gerrit.wikimedia.org only this deploy) |
[production] |
| 23:31 |
<thcipriani@deploy2002> |
Finished deploy [gerrit/gerrit@de3a994]: Removing survey banner [[gerrit:987995]] (gerrit-replicas only this deploy) (duration: 00m 06s) |
[production] |
| 23:31 |
<thcipriani@deploy2002> |
Started deploy [gerrit/gerrit@de3a994]: Removing survey banner [[gerrit:987995]] (gerrit-replicas only this deploy) |
[production] |
| 23:25 |
<thcipriani> |
deploying gerrit to remove survey banner https://gerrit.wikimedia.org/r/987995 (no downtime needed) |
[production] |
| 19:29 |
<eevans@cumin1002> |
END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for restbase2034.codfw.wmnet |
[production] |
| 19:29 |
<eevans@cumin1002> |
START - Cookbook sre.hosts.remove-downtime for restbase2034.codfw.wmnet |
[production] |
| 19:23 |
<eevans@cumin1002> |
conftool action : set/weight=10; selector: cluster=restbase,dc=codfw,name=restbase2034.codfw.wmnet |
[production] |
| 19:07 |
<mutante> |
vrts1001 - sudo systemctl start clamav-daemon |
[production] |
| 17:14 |
<pfischer@deploy2002> |
helmfile [staging] DONE helmfile.d/services/cirrus-streaming-updater: apply |
[production] |
| 17:13 |
<pfischer@deploy2002> |
helmfile [staging] START helmfile.d/services/cirrus-streaming-updater: apply |
[production] |
| 16:43 |
<jelto@deploy2002> |
helmfile [staging] DONE helmfile.d/services/miscweb: apply |
[production] |
| 16:42 |
<jelto@deploy2002> |
helmfile [staging] START helmfile.d/services/miscweb: apply |
[production] |
| 16:40 |
<jelto@deploy2002> |
helmfile [staging] DONE helmfile.d/services/miscweb: apply |
[production] |
| 16:30 |
<jelto@deploy2002> |
helmfile [staging] START helmfile.d/services/miscweb: apply |
[production] |