|
2019-10-30
ยง
|
| 20:07 |
<twentyafterfour@deploy1001> |
deploy aborted: (no justification provided) (duration: 00m 07s) |
[production] |
| 20:07 |
<twentyafterfour@deploy1001> |
Started deploy [design/style-guide@4d8d085]: (no justification provided) |
[production] |
| 20:06 |
<twentyafterfour@deploy1001> |
Finished deploy [design/style-guide@4d8d085]: (no justification provided) (duration: 00m 23s) |
[production] |
| 20:06 |
<twentyafterfour@deploy1001> |
Started deploy [design/style-guide@4d8d085]: (no justification provided) |
[production] |
| 20:04 |
<twentyafterfour@deploy1001> |
Finished deploy [design/style-guide@4d8d085]: (no justification provided) (duration: 00m 05s) |
[production] |
| 20:03 |
<twentyafterfour@deploy1001> |
Started deploy [design/style-guide@4d8d085]: (no justification provided) |
[production] |
| 19:42 |
<wm-bot> |
<jeanfred> Deploy latest from Git master: 289a41b, 02a1a4f, e8d4363 (T224226) |
[tools.integraality] |
| 19:35 |
<gehel@cumin1001> |
END (PASS) - Cookbook sre.elasticsearch.rolling-upgrade (exit_code=0) |
[production] |
| 19:16 |
<zhuyifei1999_> |
SIGSTOP ffmpeg process running on tools-sgebastion-07 |
[tools.faebot] |
| 19:11 |
<hauskater> |
Disabled explicit mirroring of rCICF to GitHub via Diffusion URI; let Gerrit replication take over |
[releng] |
| 19:06 |
<brennen@deploy1001> |
Synchronized php: group1 wikis to 1.35.0-wmf.4 (duration: 01m 00s) |
[production] |
| 19:05 |
<brennen@deploy1001> |
rebuilt and synchronized wikiversions files: group1 wikis to 1.35.0-wmf.4 |
[production] |
| 19:05 |
<mutante> |
moscovium - stop and remove rsync server, purge rsync package T180641 |
[production] |
| 18:51 |
<James_F> |
Zuul: Add CI for new XSL extension |
[releng] |
| 18:33 |
<jforrester@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: T222851 Migrate to Kask for Echo seen-time storage (duration: 01m 01s) |
[production] |
| 17:43 |
<elukey> |
upload cergen 0.2.5-1+deb10u1 to buster-wikimedia component/cergen |
[production] |
| 17:41 |
<elukey> |
run reprepro clearvanished on install1002 to clean leftovers of buster-wikimedia|thirdparty/elastic7 |
[production] |
| 17:37 |
<twentyafterfour@deploy1001> |
Finished deploy [design/style-guide@4d8d085]: (no justification provided) (duration: 00m 04s) |
[production] |
| 17:37 |
<twentyafterfour@deploy1001> |
Started deploy [design/style-guide@4d8d085]: (no justification provided) |
[production] |
| 17:29 |
<ladsgroup@deploy1001> |
Synchronized php-1.35.0-wmf.4/extensions/Wikibase: Revert 16:05 UTC T236928 (duration: 01m 05s) |
[production] |
| 17:26 |
<ladsgroup@deploy1001> |
Synchronized php-1.35.0-wmf.3/extensions/Wikibase: Revert 16:02 UTC T236928 (duration: 01m 04s) |
[production] |
| 16:59 |
<jynus> |
killed rebuildItemTerms on mwmaint1002 |
[production] |
| 16:58 |
<James_F> |
Zuul: Add Echo as a phan and real dependency for MachineVision |
[releng] |
| 16:05 |
<ladsgroup@deploy1001> |
Synchronized php-1.35.0-wmf.4/extensions/Wikibase: Wikibase deadlock reduction, [[gerrit:547244|Stop locking and use DISTINCT when finding used terms to delete]] (T234948) (duration: 01m 04s) |
[production] |
| 16:02 |
<ladsgroup@deploy1001> |
Synchronized php-1.35.0-wmf.3/extensions/Wikibase: Wikibase deadlock reduction, [[gerrit:547243|Stop locking and use DISTINCT when finding used terms to delete]] (T236466) (duration: 01m 05s) |
[production] |
| 15:56 |
<hauskater> |
gerrit : created https://gerrit.wikimedia.org/r/#/admin/projects/mediawiki/extensions/XLS # T236914 |
[releng] |
| 15:48 |
<godog> |
roll restart logstash after https://gerrit.wikimedia.org/r/c/operations/puppet/+/544217 |
[production] |
| 15:46 |
<ladsgroup@deploy1001> |
Synchronized php-1.35.0-wmf.3/extensions/Wikibase: Wikibase deadlock reduction, [[gerrit:547236|Shorten out when there is nothing to clean up]] (T236466) (duration: 01m 06s) |
[production] |
| 15:41 |
<ladsgroup@deploy1001> |
Synchronized php-1.35.0-wmf.4/extensions/Wikibase: Wikibase deadlock reduction, [[gerrit:547236|Shorten out when there is nothing to clean up]] (T236466) (duration: 01m 05s) |
[production] |
| 15:36 |
<gehel@cumin1001> |
START - Cookbook sre.elasticsearch.rolling-upgrade |
[production] |
| 15:29 |
<gehel@cumin1001> |
END (ERROR) - Cookbook sre.elasticsearch.rolling-upgrade (exit_code=97) |
[production] |
| 15:23 |
<gehel> |
shutting down elastic1039 to be ready for disk swap - T236601 |
[production] |
| 15:10 |
<effie> |
enable-puppet in mw* hosts |
[production] |
| 15:02 |
<gehel@cumin1001> |
START - Cookbook sre.elasticsearch.rolling-upgrade |
[production] |
| 15:00 |
<ottomata> |
disabling eventlogging-consumer mysql on eventlog1002 |
[analytics] |
| 14:50 |
<jforrester@deploy1001> |
Synchronized wmf-config/CommonSettings.php: T210174 Load Wikisource extension when wmgUseWikisource is true (duration: 01m 01s) |
[production] |
| 14:48 |
<jforrester@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: T236502 Define wmgUseWikisource as default-false (duration: 01m 22s) |
[production] |
| 14:40 |
<ema> |
pool cp5008 with ATS backend T227432 |
[production] |
| 14:32 |
<effie> |
disable puppet on all mw* hosts |
[production] |
| 14:20 |
<gehel@cumin1001> |
END (FAIL) - Cookbook sre.elasticsearch.rolling-upgrade (exit_code=99) |
[production] |
| 14:19 |
<ema@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 14:15 |
<ema@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 14:04 |
<gehel@cumin1001> |
END (PASS) - Cookbook sre.elasticsearch.force-shard-allocation (exit_code=0) |
[production] |
| 14:04 |
<gehel@cumin1001> |
START - Cookbook sre.elasticsearch.force-shard-allocation |
[production] |
| 14:04 |
<gehel@cumin1001> |
START - Cookbook sre.elasticsearch.rolling-upgrade |
[production] |
| 13:53 |
<arturo> |
replacing SSL cert in tools-proxy-x server apparently OK (merged https://gerrit.wikimedia.org/r/c/operations/puppet/+/545679) T235252 |
[tools] |
| 13:48 |
<arturo> |
replacing SSL cert in tools-proxy-x server (live-hacking https://gerrit.wikimedia.org/r/c/operations/puppet/+/545679 first for testing) T235252 |
[tools] |
| 13:39 |
<arturo> |
icinga downtime toolschecker for 1h for replacing SSL cert T235252 |
[tools] |
| 13:39 |
<andrew@deploy1001> |
Finished deploy [horizon/deploy@53028ab]: Rolling out improvments to the puppet git archiver (duration: 03m 38s) |
[production] |
| 13:36 |
<andrew@deploy1001> |
Started deploy [horizon/deploy@53028ab]: Rolling out improvments to the puppet git archiver |
[production] |