6401-6450 of 10000 results (85ms)
2020-01-22 ยง
21:18 <arlolra@deploy1001> Finished deploy [parsoid/deploy@e8610ff]: Updating Parsoid to 7390988 (duration: 08m 28s) [production]
21:10 <arlolra@deploy1001> Started deploy [parsoid/deploy@e8610ff]: Updating Parsoid to 7390988 [production]
20:07 <brennen@deploy1001> Synchronized php: group1 wikis to 1.35.0-wmf.16 (duration: 01m 05s) [production]
20:06 <brennen@deploy1001> rebuilt and synchronized wikiversions files: group1 wikis to 1.35.0-wmf.16 [production]
19:46 <catrope@deploy1001> Synchronized php-1.35.0-wmf.16/extensions/WikimediaMessages/: Remove temporary partial block banner (T240300) (duration: 01m 06s) [production]
19:45 <catrope@deploy1001> Synchronized php-1.35.0-wmf.15/extensions/WikimediaMessages/: Remove temporary partial block banner (T240300) (duration: 01m 10s) [production]
19:43 <gehel> restart tilerator / kartotherian on maps* servers [production]
19:36 <catrope@deploy1001> Synchronized php-1.35.0-wmf.16/extensions/WikimediaEvents/: InukaPageView: update schema version (T238029) (duration: 01m 07s) [production]
19:26 <catrope@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Enable UnderstandingFirstDay on ukwiki, huwiki, hywiki (T238294) (duration: 01m 06s) [production]
17:46 <arturo> forcing by hand the first sync on sodium for openstack packages (T238820) [production]
16:40 <vgutierrez> removing nginx from the caching cluster [production]
16:26 <moritzm> installing tiff security updates for buster [production]
16:21 <vgutierrez> copied prometheus-trafficserver-exporter from stretch to buster on apt.w.o - T242093 [production]
16:13 <XioNoX> update logging target for pfw3-eqiad - T243343 [production]
16:07 <XioNoX> update logging target for pfw3-codfw - T243343 [production]
15:43 <vgutierrez> uploaded vhtcpd 0.1.2-2 to apt.w.o (buster) - T242093 [production]
15:38 <marostegui> Compress wikidatawiki.wbt_text wikidatawiki.wbt_text_in_lang on db1124:3318 (this might cause lag on s8 labs) - T232446 [production]
15:29 <vgutierrez> uploaded fifo-log-demux 0.6.1 to apt.w.o (buster) - T242093 [production]
14:54 <papaul> FW upgrade on db2085 [production]
14:53 <vgutierrez> copied python3-logstash to apt.w.o (buster) - T242093 [production]
14:50 <vgutierrez> copied python3-file-read-backwards to apt.w.o (buster) - T242093 [production]
14:39 <marostegui> Stop MySQL on db2085:3311 and db2085:3318 for onsite maintenance - T243148 [production]
14:39 <marostegui> Stop MySQL on db2085:3311 and db2085:3318 for onsite maintenance - [production]
14:18 <akosiaris> upload etherpad-lite_1.7.5-3 to apt.wikimedia.org buster-wikimedia/main T224580 [production]
13:07 <Amir1> EU SWAT is over [production]
13:03 <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: Revert: [[gerrit:562578|Set useEntitySourceBasedFederation to true for Wikidata (T241972)]] (duration: 01m 05s) [production]
13:02 <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: Revert: [[gerrit:562578|Set useEntitySourceBasedFederation to true for Wikidata (T241972)]] (duration: 01m 05s) [production]
12:59 <effie> restart npre on notebook1003 [production]
12:57 <hoo> Updated the Wikidata property suggester with data from the 2020-01-06 JSON dump and applied the T132839 workarounds [production]
12:51 <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:562578|Set useEntitySourceBasedFederation to true for Wikidata (T241972)]] (duration: 01m 05s) [production]
12:50 <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:562578|Set useEntitySourceBasedFederation to true for Wikidata (T241972)]] (duration: 01m 06s) [production]
12:47 <jbond42> disable puppet fleat wide - upgrade jdk on puppetdb [production]
12:46 <ladsgroup@deploy1001> Synchronized php-1.35.0-wmf.15/extensions/WikibaseQualityConstraints: [[gerrit:566504|Better dependency injection of base URI in ConstraintParameterParser (T241972)]] (duration: 01m 05s) [production]
12:43 <ladsgroup@deploy1001> scap failed: average error rate on 4/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/db09a36be5ed3e81155041f7d46ad040 for details) [production]
12:36 <ladsgroup@deploy1001> Synchronized php-1.35.0-wmf.16/extensions/WikibaseQualityConstraints: [[gerrit:566505|Better dependency injection of base URI in ConstraintParameterParser (T241972)]] (duration: 01m 14s) [production]
12:35 <effie> enable puppet and restart mtail on mw* and wtp* [production]
12:30 <vgutierrez> uploaded trafficserver 8.0.5-1wm13 to apt.w.o (buster) - T242093 [production]
12:17 <effie> Disable puppet on mw* and wtp* to merge 563206 [production]
12:15 <jmm@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) [production]
12:14 <jmm@cumin1001> START - Cookbook sre.hosts.decommission [production]
11:40 <moritzm> restarting apache on puppetboard/graphite/webperf to pick up OpenLDAP update [production]
11:38 <cormacparle__> disabled wikitech 2fa for Cparle [production]
11:16 <moritzm> restarting exim on MXes to pick up new openldap [production]
11:04 <moritzm> restarting mw canaries to pick up openldap update [production]
10:09 <marostegui> Stop MySQL on es2023 to "clone" es2024 - T243052 [production]
10:04 <moritzm> installing openldap security updates on stretch [production]
08:45 <moritzm> upload prometheus-etherpad-exporter 0.2 to buster-wikimedia T224580 [production]
08:27 <marostegui> Stop MySQL on es2021 to "clone" es2023 - T243052 [production]
06:16 <marostegui> Remove partitions from db1103:3314 - T239453 [production]
06:15 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1103:3314 T239453', diff saved to https://phabricator.wikimedia.org/P10242 and previous config saved to /var/cache/conftool/dbconfig/20200122-061522-marostegui.json [production]