1-50 of 10000 results (66ms)
2020-01-22 ยง
23:46 <James_F> <RoanKattouw> T236104 happened again, and this time I'm leaving it broken so I can investigate. Please don't use do any MW deployments (use scap) for now [production]
23:31 <eileen> civicrm revision changed from 036b742316 to fbd5c35fb0, config revision is 74a355670a [production]
23:28 <eileen> civicrm revision changed from 7595104180 to 036b742316, config revision is 74a355670a [production]
23:14 <eileen> civicrm revision changed from c74092ad63 to 7595104180, config revision is 74a355670a [production]
23:06 <XioNoX> configure flowspec on cr3-knams [production]
22:39 <catrope@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Enable homepage on ukwiki, huwiki, hywiki (T238320, T231720, T230478, T230676) (duration: 01m 05s) [production]
22:30 <catrope@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Enable help panel on ukwiki, huwiki, hywiki (T238319, T231720, T230478, T230676) (duration: 01m 04s) [production]
22:19 <catrope@deploy1001> Synchronized php-1.35.0-wmf.16/extensions/CodeReview/: T243337 (duration: 01m 06s) [production]
22:13 <catrope@deploy1001> Finished scap: i18n changes for SWAT: Special page aliases for GrowthExperiments (T230676); messages for machinevision-tester group (T243440); fix namespace names for atj (T243125) (duration: 40m 48s) [production]
21:32 <catrope@deploy1001> Started scap: i18n changes for SWAT: Special page aliases for GrowthExperiments (T230676); messages for machinevision-tester group (T243440); fix namespace names for atj (T243125) [production]
21:28 <arlolra> Updated Parsoid to 7390988 (T242513, T243008, T241146) [production]
21:18 <arlolra@deploy1001> Finished deploy [parsoid/deploy@e8610ff]: Updating Parsoid to 7390988 (duration: 08m 28s) [production]
21:10 <arlolra@deploy1001> Started deploy [parsoid/deploy@e8610ff]: Updating Parsoid to 7390988 [production]
20:07 <brennen@deploy1001> Synchronized php: group1 wikis to 1.35.0-wmf.16 (duration: 01m 05s) [production]
20:06 <brennen@deploy1001> rebuilt and synchronized wikiversions files: group1 wikis to 1.35.0-wmf.16 [production]
19:46 <catrope@deploy1001> Synchronized php-1.35.0-wmf.16/extensions/WikimediaMessages/: Remove temporary partial block banner (T240300) (duration: 01m 06s) [production]
19:45 <catrope@deploy1001> Synchronized php-1.35.0-wmf.15/extensions/WikimediaMessages/: Remove temporary partial block banner (T240300) (duration: 01m 10s) [production]
19:43 <gehel> restart tilerator / kartotherian on maps* servers [production]
19:36 <catrope@deploy1001> Synchronized php-1.35.0-wmf.16/extensions/WikimediaEvents/: InukaPageView: update schema version (T238029) (duration: 01m 07s) [production]
19:26 <catrope@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Enable UnderstandingFirstDay on ukwiki, huwiki, hywiki (T238294) (duration: 01m 06s) [production]
17:46 <arturo> forcing by hand the first sync on sodium for openstack packages (T238820) [production]
16:40 <vgutierrez> removing nginx from the caching cluster [production]
16:26 <moritzm> installing tiff security updates for buster [production]
16:21 <vgutierrez> copied prometheus-trafficserver-exporter from stretch to buster on apt.w.o - T242093 [production]
16:13 <XioNoX> update logging target for pfw3-eqiad - T243343 [production]
16:07 <XioNoX> update logging target for pfw3-codfw - T243343 [production]
15:43 <vgutierrez> uploaded vhtcpd 0.1.2-2 to apt.w.o (buster) - T242093 [production]
15:38 <marostegui> Compress wikidatawiki.wbt_text wikidatawiki.wbt_text_in_lang on db1124:3318 (this might cause lag on s8 labs) - T232446 [production]
15:29 <vgutierrez> uploaded fifo-log-demux 0.6.1 to apt.w.o (buster) - T242093 [production]
14:54 <papaul> FW upgrade on db2085 [production]
14:53 <vgutierrez> copied python3-logstash to apt.w.o (buster) - T242093 [production]
14:50 <vgutierrez> copied python3-file-read-backwards to apt.w.o (buster) - T242093 [production]
14:39 <marostegui> Stop MySQL on db2085:3311 and db2085:3318 for onsite maintenance - T243148 [production]
14:39 <marostegui> Stop MySQL on db2085:3311 and db2085:3318 for onsite maintenance - [production]
14:18 <akosiaris> upload etherpad-lite_1.7.5-3 to apt.wikimedia.org buster-wikimedia/main T224580 [production]
13:07 <Amir1> EU SWAT is over [production]
13:03 <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: Revert: [[gerrit:562578|Set useEntitySourceBasedFederation to true for Wikidata (T241972)]] (duration: 01m 05s) [production]
13:02 <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: Revert: [[gerrit:562578|Set useEntitySourceBasedFederation to true for Wikidata (T241972)]] (duration: 01m 05s) [production]
12:59 <effie> restart npre on notebook1003 [production]
12:57 <hoo> Updated the Wikidata property suggester with data from the 2020-01-06 JSON dump and applied the T132839 workarounds [production]
12:51 <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:562578|Set useEntitySourceBasedFederation to true for Wikidata (T241972)]] (duration: 01m 05s) [production]
12:50 <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:562578|Set useEntitySourceBasedFederation to true for Wikidata (T241972)]] (duration: 01m 06s) [production]
12:47 <jbond42> disable puppet fleat wide - upgrade jdk on puppetdb [production]
12:46 <ladsgroup@deploy1001> Synchronized php-1.35.0-wmf.15/extensions/WikibaseQualityConstraints: [[gerrit:566504|Better dependency injection of base URI in ConstraintParameterParser (T241972)]] (duration: 01m 05s) [production]
12:43 <ladsgroup@deploy1001> scap failed: average error rate on 4/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/db09a36be5ed3e81155041f7d46ad040 for details) [production]
12:36 <ladsgroup@deploy1001> Synchronized php-1.35.0-wmf.16/extensions/WikibaseQualityConstraints: [[gerrit:566505|Better dependency injection of base URI in ConstraintParameterParser (T241972)]] (duration: 01m 14s) [production]
12:35 <effie> enable puppet and restart mtail on mw* and wtp* [production]
12:30 <vgutierrez> uploaded trafficserver 8.0.5-1wm13 to apt.w.o (buster) - T242093 [production]
12:17 <effie> Disable puppet on mw* and wtp* to merge 563206 [production]
12:15 <jmm@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) [production]