5651-5700 of 10000 results (71ms)
2019-10-30 ยง
21:17 <ppchelko@deploy1001> Started deploy [restbase/deploy@88cf547]: Parsoid mirroring followups: T236837, T236838 [production]
20:47 <twentyafterfour@deploy1001> Finished deploy [design/style-guide@4d8d085]: (no justification provided) (duration: 00m 03s) [production]
20:47 <twentyafterfour@deploy1001> Started deploy [design/style-guide@4d8d085]: (no justification provided) [production]
20:46 <twentyafterfour@deploy1001> Finished deploy [design/style-guide@4d8d085]: (no justification provided) (duration: 00m 04s) [production]
20:46 <twentyafterfour@deploy1001> Started deploy [design/style-guide@4d8d085]: (no justification provided) [production]
20:42 <arlolra> Updated Parsoid to 5ac1623 (T235656, T233818, T234549, T227209, T236112) [production]
20:29 <otto@deploy1001> Synchronized wmf-config/LabsServices.php: Syncing LabsServices.php change for beta eventgate instance replacement (duration: 01m 01s) [production]
20:28 <arlolra@deploy1001> Finished deploy [parsoid/deploy@a69ec92]: Updating Parsoid to 5ac1623 (duration: 09m 10s) [production]
20:25 <twentyafterfour@deploy1001> Finished deploy [design/style-guide@4d8d085]: (no justification provided) (duration: 00m 18s) [production]
20:24 <twentyafterfour@deploy1001> Started deploy [design/style-guide@4d8d085]: (no justification provided) [production]
20:19 <arlolra@deploy1001> Started deploy [parsoid/deploy@a69ec92]: Updating Parsoid to 5ac1623 [production]
20:17 <mholloway-shell@deploy1001> Synchronized wmf-config/InitialiseSettings-labs.php: WikimediaEditorTasks: Enable edit streaks on beta (duration: 01m 03s) [production]
20:11 <twentyafterfour@deploy1001> Finished deploy [design/style-guide@4d8d085]: (no justification provided) (duration: 00m 03s) [production]
20:10 <twentyafterfour@deploy1001> Started deploy [design/style-guide@4d8d085]: (no justification provided) [production]
20:10 <twentyafterfour@deploy1001> Finished deploy [design/style-guide@4d8d085]: (no justification provided) (duration: 00m 51s) [production]
20:09 <twentyafterfour@deploy1001> Started deploy [design/style-guide@4d8d085]: (no justification provided) [production]
20:07 <twentyafterfour@deploy1001> deploy aborted: (no justification provided) (duration: 00m 07s) [production]
20:07 <twentyafterfour@deploy1001> Started deploy [design/style-guide@4d8d085]: (no justification provided) [production]
20:06 <twentyafterfour@deploy1001> Finished deploy [design/style-guide@4d8d085]: (no justification provided) (duration: 00m 23s) [production]
20:06 <twentyafterfour@deploy1001> Started deploy [design/style-guide@4d8d085]: (no justification provided) [production]
20:04 <twentyafterfour@deploy1001> Finished deploy [design/style-guide@4d8d085]: (no justification provided) (duration: 00m 05s) [production]
20:03 <twentyafterfour@deploy1001> Started deploy [design/style-guide@4d8d085]: (no justification provided) [production]
19:35 <gehel@cumin1001> END (PASS) - Cookbook sre.elasticsearch.rolling-upgrade (exit_code=0) [production]
19:06 <brennen@deploy1001> Synchronized php: group1 wikis to 1.35.0-wmf.4 (duration: 01m 00s) [production]
19:05 <brennen@deploy1001> rebuilt and synchronized wikiversions files: group1 wikis to 1.35.0-wmf.4 [production]
19:05 <mutante> moscovium - stop and remove rsync server, purge rsync package T180641 [production]
18:33 <jforrester@deploy1001> Synchronized wmf-config/InitialiseSettings.php: T222851 Migrate to Kask for Echo seen-time storage (duration: 01m 01s) [production]
17:43 <elukey> upload cergen 0.2.5-1+deb10u1 to buster-wikimedia component/cergen [production]
17:41 <elukey> run reprepro clearvanished on install1002 to clean leftovers of buster-wikimedia|thirdparty/elastic7 [production]
17:37 <twentyafterfour@deploy1001> Finished deploy [design/style-guide@4d8d085]: (no justification provided) (duration: 00m 04s) [production]
17:37 <twentyafterfour@deploy1001> Started deploy [design/style-guide@4d8d085]: (no justification provided) [production]
17:29 <ladsgroup@deploy1001> Synchronized php-1.35.0-wmf.4/extensions/Wikibase: Revert 16:05 UTC T236928 (duration: 01m 05s) [production]
17:26 <ladsgroup@deploy1001> Synchronized php-1.35.0-wmf.3/extensions/Wikibase: Revert 16:02 UTC T236928 (duration: 01m 04s) [production]
16:59 <jynus> killed rebuildItemTerms on mwmaint1002 [production]
16:05 <ladsgroup@deploy1001> Synchronized php-1.35.0-wmf.4/extensions/Wikibase: Wikibase deadlock reduction, [[gerrit:547244|Stop locking and use DISTINCT when finding used terms to delete]] (T234948) (duration: 01m 04s) [production]
16:02 <ladsgroup@deploy1001> Synchronized php-1.35.0-wmf.3/extensions/Wikibase: Wikibase deadlock reduction, [[gerrit:547243|Stop locking and use DISTINCT when finding used terms to delete]] (T236466) (duration: 01m 05s) [production]
15:48 <godog> roll restart logstash after https://gerrit.wikimedia.org/r/c/operations/puppet/+/544217 [production]
15:46 <ladsgroup@deploy1001> Synchronized php-1.35.0-wmf.3/extensions/Wikibase: Wikibase deadlock reduction, [[gerrit:547236|Shorten out when there is nothing to clean up]] (T236466) (duration: 01m 06s) [production]
15:41 <ladsgroup@deploy1001> Synchronized php-1.35.0-wmf.4/extensions/Wikibase: Wikibase deadlock reduction, [[gerrit:547236|Shorten out when there is nothing to clean up]] (T236466) (duration: 01m 05s) [production]
15:36 <gehel@cumin1001> START - Cookbook sre.elasticsearch.rolling-upgrade [production]
15:29 <gehel@cumin1001> END (ERROR) - Cookbook sre.elasticsearch.rolling-upgrade (exit_code=97) [production]
15:23 <gehel> shutting down elastic1039 to be ready for disk swap - T236601 [production]
15:10 <effie> enable-puppet in mw* hosts [production]
15:02 <gehel@cumin1001> START - Cookbook sre.elasticsearch.rolling-upgrade [production]
14:50 <jforrester@deploy1001> Synchronized wmf-config/CommonSettings.php: T210174 Load Wikisource extension when wmgUseWikisource is true (duration: 01m 01s) [production]
14:48 <jforrester@deploy1001> Synchronized wmf-config/InitialiseSettings.php: T236502 Define wmgUseWikisource as default-false (duration: 01m 22s) [production]
14:40 <ema> pool cp5008 with ATS backend T227432 [production]
14:32 <effie> disable puppet on all mw* hosts [production]
14:20 <gehel@cumin1001> END (FAIL) - Cookbook sre.elasticsearch.rolling-upgrade (exit_code=99) [production]
14:19 <ema@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]