|
2022-06-07
ยง
|
| 21:09 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] START helmfile.d/services/mwdebug: apply |
[production] |
| 21:04 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 21:00 |
<urbanecm@deploy1002> |
Synchronized wmf-config/InitialiseSettings.php: afc847a6865be01dff94653feae0d4c9fc9952f6: Make new topic tool available as opt-out almost everywhere; phase 3 (T309368) (duration: 03m 37s) |
[production] |
| 20:58 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] START helmfile.d/services/mwdebug: apply |
[production] |
| 20:58 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 20:53 |
<urbanecm@deploy1002> |
Finished scap: DiscussionTools backports + r803526 (T310053, T297990) (duration: 24m 43s) |
[production] |
| 20:52 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] START helmfile.d/services/mwdebug: apply |
[production] |
| 20:28 |
<urbanecm@deploy1002> |
Started scap: DiscussionTools backports + r803526 (T310053, T297990) |
[production] |
| 20:27 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 20:26 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] START helmfile.d/services/mwdebug: apply |
[production] |
| 20:26 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 20:22 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] START helmfile.d/services/mwdebug: apply |
[production] |
| 20:17 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 20:14 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] START helmfile.d/services/mwdebug: apply |
[production] |
| 20:14 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 20:13 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] START helmfile.d/services/mwdebug: apply |
[production] |
| 20:08 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 20:04 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] START helmfile.d/services/mwdebug: apply |
[production] |
| 20:04 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 20:00 |
<jforrester@deploy1002> |
Synchronized wmf-config/CommonSettings.php: Config: [[gerrit:802772|extdist: Drop 1.36, now EOL (T309864)]] (duration: 03m 26s) |
[production] |
| 19:57 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] START helmfile.d/services/mwdebug: apply |
[production] |
| 19:57 |
<jforrester@deploy1002> |
Synchronized wmf-config/CommonSettings.php: Config: [[gerrit:802612|extdist: 1.38 is now stable]] (duration: 03m 44s) |
[production] |
| 18:46 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 18:40 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] START helmfile.d/services/mwdebug: apply |
[production] |
| 18:40 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 18:33 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] START helmfile.d/services/mwdebug: apply |
[production] |
| 18:08 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 18:07 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] START helmfile.d/services/mwdebug: apply |
[production] |
| 18:07 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 18:06 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] START helmfile.d/services/mwdebug: apply |
[production] |
| 18:06 |
<dduvall@deploy1002> |
rebuilt and synchronized wikiversions files: group0 wikis to 1.39.0-wmf.15 refs T308068 |
[production] |
| 18:01 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 17:58 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] START helmfile.d/services/mwdebug: apply |
[production] |
| 17:58 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 17:51 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] START helmfile.d/services/mwdebug: apply |
[production] |
| 17:45 |
<dduvall@deploy1002> |
Pruned MediaWiki: 1.39.0-wmf.13 (duration: 01m 49s) |
[production] |
| 17:43 |
<dduvall@deploy1002> |
Finished scap: testwikis wikis to 1.39.0-wmf.15 refs T308068 (duration: 30m 22s) |
[production] |
| 17:37 |
<pt1979@cumin1001> |
START - Cookbook sre.hosts.dhcp for host clouddumps1001.wikimedia.org |
[production] |
| 17:36 |
<pt1979@cumin1001> |
END (PASS) - Cookbook sre.hosts.dhcp (exit_code=0) for host clouddumps1001.wikimedia.org |
[production] |
| 17:36 |
<pt1979@cumin1001> |
START - Cookbook sre.hosts.dhcp for host clouddumps1001.wikimedia.org |
[production] |
| 17:29 |
<jmm@cumin2002> |
END (PASS) - Cookbook sre.ganeti.reboot-vm (exit_code=0) for VM webperf2004.codfw.wmnet |
[production] |
| 17:21 |
<jmm@cumin2002> |
START - Cookbook sre.ganeti.reboot-vm for VM webperf2004.codfw.wmnet |
[production] |
| 17:13 |
<dduvall@deploy1002> |
Started scap: testwikis wikis to 1.39.0-wmf.15 refs T308068 |
[production] |
| 16:56 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 16:50 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] START helmfile.d/services/mwdebug: apply |
[production] |
| 16:50 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 16:43 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] START helmfile.d/services/mwdebug: apply |
[production] |
| 16:32 |
<dduvall> |
scap deploy-promote testwikis failed at invocation of logstash_checker.py ("logstash_checker.py: error: argument --delay: invalid int value: '40.406498670578'") T308068 |
[production] |
| 16:21 |
<dduvall@deploy1002> |
scap failed: RuntimeError scap failed: average error rate on 8/8 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org for details) (duration: 14m 27s) |
[production] |
| 16:21 |
<dduvall@deploy1002> |
scap failed: average error rate on 8/8 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org for details) |
[production] |