|
2019-10-30
ยง
|
| 23:08 |
<XioNoX> |
power cycle cr3-esams re1 - T236598 |
[production] |
| 22:29 |
<mutante> |
scandium - live hack /srv/mediawiki/wmf-config/InitialiseSettings.php - set wmgMemoryLimit to 850 (*1024 *1024), restart php7.2-fpm (T236833) |
[production] |
| 22:22 |
<andrew@deploy1001> |
Finished deploy [horizon/deploy@2d551d8]: Rolling out a currently-turned-off puppet edit mode (duration: 03m 15s) |
[production] |
| 22:19 |
<andrew@deploy1001> |
Started deploy [horizon/deploy@2d551d8]: Rolling out a currently-turned-off puppet edit mode |
[production] |
| 22:08 |
<ppchelko@deploy1001> |
Finished deploy [restbase/deploy@fa934c8]: Bump parsoid mirroring to 25% and fix 412: T235902, T236837 (duration: 13m 54s) |
[production] |
| 21:55 |
<ppchelko@deploy1001> |
Started deploy [restbase/deploy@fa934c8]: Bump parsoid mirroring to 25% and fix 412: T235902, T236837 |
[production] |
| 21:31 |
<ppchelko@deploy1001> |
Finished deploy [restbase/deploy@88cf547]: Parsoid mirroring followups: T236837, T236838 (duration: 14m 04s) |
[production] |
| 21:17 |
<ppchelko@deploy1001> |
Started deploy [restbase/deploy@88cf547]: Parsoid mirroring followups: T236837, T236838 |
[production] |
| 20:47 |
<twentyafterfour@deploy1001> |
Finished deploy [design/style-guide@4d8d085]: (no justification provided) (duration: 00m 03s) |
[production] |
| 20:47 |
<twentyafterfour@deploy1001> |
Started deploy [design/style-guide@4d8d085]: (no justification provided) |
[production] |
| 20:46 |
<twentyafterfour@deploy1001> |
Finished deploy [design/style-guide@4d8d085]: (no justification provided) (duration: 00m 04s) |
[production] |
| 20:46 |
<twentyafterfour@deploy1001> |
Started deploy [design/style-guide@4d8d085]: (no justification provided) |
[production] |
| 20:42 |
<arlolra> |
Updated Parsoid to 5ac1623 (T235656, T233818, T234549, T227209, T236112) |
[production] |
| 20:29 |
<otto@deploy1001> |
Synchronized wmf-config/LabsServices.php: Syncing LabsServices.php change for beta eventgate instance replacement (duration: 01m 01s) |
[production] |
| 20:28 |
<arlolra@deploy1001> |
Finished deploy [parsoid/deploy@a69ec92]: Updating Parsoid to 5ac1623 (duration: 09m 10s) |
[production] |
| 20:25 |
<twentyafterfour@deploy1001> |
Finished deploy [design/style-guide@4d8d085]: (no justification provided) (duration: 00m 18s) |
[production] |
| 20:24 |
<twentyafterfour@deploy1001> |
Started deploy [design/style-guide@4d8d085]: (no justification provided) |
[production] |
| 20:19 |
<arlolra@deploy1001> |
Started deploy [parsoid/deploy@a69ec92]: Updating Parsoid to 5ac1623 |
[production] |
| 20:17 |
<mholloway-shell@deploy1001> |
Synchronized wmf-config/InitialiseSettings-labs.php: WikimediaEditorTasks: Enable edit streaks on beta (duration: 01m 03s) |
[production] |
| 20:11 |
<twentyafterfour@deploy1001> |
Finished deploy [design/style-guide@4d8d085]: (no justification provided) (duration: 00m 03s) |
[production] |
| 20:10 |
<twentyafterfour@deploy1001> |
Started deploy [design/style-guide@4d8d085]: (no justification provided) |
[production] |
| 20:10 |
<twentyafterfour@deploy1001> |
Finished deploy [design/style-guide@4d8d085]: (no justification provided) (duration: 00m 51s) |
[production] |
| 20:09 |
<twentyafterfour@deploy1001> |
Started deploy [design/style-guide@4d8d085]: (no justification provided) |
[production] |
| 20:07 |
<twentyafterfour@deploy1001> |
deploy aborted: (no justification provided) (duration: 00m 07s) |
[production] |
| 20:07 |
<twentyafterfour@deploy1001> |
Started deploy [design/style-guide@4d8d085]: (no justification provided) |
[production] |
| 20:06 |
<twentyafterfour@deploy1001> |
Finished deploy [design/style-guide@4d8d085]: (no justification provided) (duration: 00m 23s) |
[production] |
| 20:06 |
<twentyafterfour@deploy1001> |
Started deploy [design/style-guide@4d8d085]: (no justification provided) |
[production] |
| 20:04 |
<twentyafterfour@deploy1001> |
Finished deploy [design/style-guide@4d8d085]: (no justification provided) (duration: 00m 05s) |
[production] |
| 20:03 |
<twentyafterfour@deploy1001> |
Started deploy [design/style-guide@4d8d085]: (no justification provided) |
[production] |
| 19:35 |
<gehel@cumin1001> |
END (PASS) - Cookbook sre.elasticsearch.rolling-upgrade (exit_code=0) |
[production] |
| 19:06 |
<brennen@deploy1001> |
Synchronized php: group1 wikis to 1.35.0-wmf.4 (duration: 01m 00s) |
[production] |
| 19:05 |
<brennen@deploy1001> |
rebuilt and synchronized wikiversions files: group1 wikis to 1.35.0-wmf.4 |
[production] |
| 19:05 |
<mutante> |
moscovium - stop and remove rsync server, purge rsync package T180641 |
[production] |
| 18:33 |
<jforrester@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: T222851 Migrate to Kask for Echo seen-time storage (duration: 01m 01s) |
[production] |
| 17:43 |
<elukey> |
upload cergen 0.2.5-1+deb10u1 to buster-wikimedia component/cergen |
[production] |
| 17:41 |
<elukey> |
run reprepro clearvanished on install1002 to clean leftovers of buster-wikimedia|thirdparty/elastic7 |
[production] |
| 17:37 |
<twentyafterfour@deploy1001> |
Finished deploy [design/style-guide@4d8d085]: (no justification provided) (duration: 00m 04s) |
[production] |
| 17:37 |
<twentyafterfour@deploy1001> |
Started deploy [design/style-guide@4d8d085]: (no justification provided) |
[production] |
| 17:29 |
<ladsgroup@deploy1001> |
Synchronized php-1.35.0-wmf.4/extensions/Wikibase: Revert 16:05 UTC T236928 (duration: 01m 05s) |
[production] |
| 17:26 |
<ladsgroup@deploy1001> |
Synchronized php-1.35.0-wmf.3/extensions/Wikibase: Revert 16:02 UTC T236928 (duration: 01m 04s) |
[production] |
| 16:59 |
<jynus> |
killed rebuildItemTerms on mwmaint1002 |
[production] |
| 16:05 |
<ladsgroup@deploy1001> |
Synchronized php-1.35.0-wmf.4/extensions/Wikibase: Wikibase deadlock reduction, [[gerrit:547244|Stop locking and use DISTINCT when finding used terms to delete]] (T234948) (duration: 01m 04s) |
[production] |
| 16:02 |
<ladsgroup@deploy1001> |
Synchronized php-1.35.0-wmf.3/extensions/Wikibase: Wikibase deadlock reduction, [[gerrit:547243|Stop locking and use DISTINCT when finding used terms to delete]] (T236466) (duration: 01m 05s) |
[production] |
| 15:48 |
<godog> |
roll restart logstash after https://gerrit.wikimedia.org/r/c/operations/puppet/+/544217 |
[production] |
| 15:46 |
<ladsgroup@deploy1001> |
Synchronized php-1.35.0-wmf.3/extensions/Wikibase: Wikibase deadlock reduction, [[gerrit:547236|Shorten out when there is nothing to clean up]] (T236466) (duration: 01m 06s) |
[production] |
| 15:41 |
<ladsgroup@deploy1001> |
Synchronized php-1.35.0-wmf.4/extensions/Wikibase: Wikibase deadlock reduction, [[gerrit:547236|Shorten out when there is nothing to clean up]] (T236466) (duration: 01m 05s) |
[production] |
| 15:36 |
<gehel@cumin1001> |
START - Cookbook sre.elasticsearch.rolling-upgrade |
[production] |
| 15:29 |
<gehel@cumin1001> |
END (ERROR) - Cookbook sre.elasticsearch.rolling-upgrade (exit_code=97) |
[production] |
| 15:23 |
<gehel> |
shutting down elastic1039 to be ready for disk swap - T236601 |
[production] |
| 15:10 |
<effie> |
enable-puppet in mw* hosts |
[production] |