451-500 of 10000 results (63ms)
2020-01-22 §
16:21 <vgutierrez> copied prometheus-trafficserver-exporter from stretch to buster on apt.w.o - T242093 [production]
16:13 <XioNoX> update logging target for pfw3-eqiad - T243343 [production]
16:07 <XioNoX> update logging target for pfw3-codfw - T243343 [production]
15:43 <vgutierrez> uploaded vhtcpd 0.1.2-2 to apt.w.o (buster) - T242093 [production]
15:38 <marostegui> Compress wikidatawiki.wbt_text wikidatawiki.wbt_text_in_lang on db1124:3318 (this might cause lag on s8 labs) - T232446 [production]
15:29 <vgutierrez> uploaded fifo-log-demux 0.6.1 to apt.w.o (buster) - T242093 [production]
14:54 <papaul> FW upgrade on db2085 [production]
14:53 <vgutierrez> copied python3-logstash to apt.w.o (buster) - T242093 [production]
14:50 <vgutierrez> copied python3-file-read-backwards to apt.w.o (buster) - T242093 [production]
14:39 <marostegui> Stop MySQL on db2085:3311 and db2085:3318 for onsite maintenance - T243148 [production]
14:39 <marostegui> Stop MySQL on db2085:3311 and db2085:3318 for onsite maintenance - [production]
14:18 <akosiaris> upload etherpad-lite_1.7.5-3 to apt.wikimedia.org buster-wikimedia/main T224580 [production]
13:07 <Amir1> EU SWAT is over [production]
13:03 <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: Revert: [[gerrit:562578|Set useEntitySourceBasedFederation to true for Wikidata (T241972)]] (duration: 01m 05s) [production]
13:02 <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: Revert: [[gerrit:562578|Set useEntitySourceBasedFederation to true for Wikidata (T241972)]] (duration: 01m 05s) [production]
12:59 <effie> restart npre on notebook1003 [production]
12:57 <hoo> Updated the Wikidata property suggester with data from the 2020-01-06 JSON dump and applied the T132839 workarounds [production]
12:51 <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:562578|Set useEntitySourceBasedFederation to true for Wikidata (T241972)]] (duration: 01m 05s) [production]
12:50 <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:562578|Set useEntitySourceBasedFederation to true for Wikidata (T241972)]] (duration: 01m 06s) [production]
12:47 <jbond42> disable puppet fleat wide - upgrade jdk on puppetdb [production]
12:46 <ladsgroup@deploy1001> Synchronized php-1.35.0-wmf.15/extensions/WikibaseQualityConstraints: [[gerrit:566504|Better dependency injection of base URI in ConstraintParameterParser (T241972)]] (duration: 01m 05s) [production]
12:43 <ladsgroup@deploy1001> scap failed: average error rate on 4/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/db09a36be5ed3e81155041f7d46ad040 for details) [production]
12:36 <ladsgroup@deploy1001> Synchronized php-1.35.0-wmf.16/extensions/WikibaseQualityConstraints: [[gerrit:566505|Better dependency injection of base URI in ConstraintParameterParser (T241972)]] (duration: 01m 14s) [production]
12:35 <effie> enable puppet and restart mtail on mw* and wtp* [production]
12:30 <vgutierrez> uploaded trafficserver 8.0.5-1wm13 to apt.w.o (buster) - T242093 [production]
12:17 <effie> Disable puppet on mw* and wtp* to merge 563206 [production]
12:15 <jmm@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) [production]
12:14 <jmm@cumin1001> START - Cookbook sre.hosts.decommission [production]
11:40 <moritzm> restarting apache on puppetboard/graphite/webperf to pick up OpenLDAP update [production]
11:38 <cormacparle__> disabled wikitech 2fa for Cparle [production]
11:16 <moritzm> restarting exim on MXes to pick up new openldap [production]
11:04 <moritzm> restarting mw canaries to pick up openldap update [production]
10:09 <marostegui> Stop MySQL on es2023 to "clone" es2024 - T243052 [production]
10:04 <moritzm> installing openldap security updates on stretch [production]
08:45 <moritzm> upload prometheus-etherpad-exporter 0.2 to buster-wikimedia T224580 [production]
08:27 <marostegui> Stop MySQL on es2021 to "clone" es2023 - T243052 [production]
06:16 <marostegui> Remove partitions from db1103:3314 - T239453 [production]
06:15 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1103:3314 T239453', diff saved to https://phabricator.wikimedia.org/P10242 and previous config saved to /var/cache/conftool/dbconfig/20200122-061522-marostegui.json [production]
06:14 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db2091:3314 T239453', diff saved to https://phabricator.wikimedia.org/P10241 and previous config saved to /var/cache/conftool/dbconfig/20200122-061429-marostegui.json [production]
01:13 <catrope@deploy1001> Synchronized wmf-config/InitialiseSettings.php: resync, the last sync only took on half the appservers (duration: 01m 05s) [production]
00:31 <catrope@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Enable topics in suggested edits on cswiki, kowiki, arwiki, viwiki (duration: 01m 05s) [production]
00:26 <catrope@deploy1001> Synchronized php-1.35.0-wmf.15/extensions/GrowthExperiments/: SWAT for T242811, T242052 (duration: 01m 05s) [production]
2020-01-21 §
20:09 <brennen@deploy1001> rebuilt and synchronized wikiversions files: group0 to 1.35.0-wmf.16 [production]
19:59 <mutante> puppet-compilers: syncing facts from puppetmasters to 3 compiler instances [production]
19:55 <XioNoX> restart mr1-esams for software upgrade - T242097 [production]
19:46 <ppchelko@deploy1001> Finished deploy [cpjobqueue/deploy@1ca3071]: Add separate rule for machine vision jobs T241072 (duration: 01m 11s) [production]
19:45 <ppchelko@deploy1001> Started deploy [cpjobqueue/deploy@1ca3071]: Add separate rule for machine vision jobs T241072 [production]
19:40 <andrew@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) [production]
19:39 <andrew@cumin1001> START - Cookbook sre.hosts.decommission [production]
19:39 <XioNoX> mr1-esams> request system software add /var/tmp/junos-srxsme-18.2R3-S2... - T242097 [production]