|
2020-01-22
§
|
| 16:13 |
<XioNoX> |
update logging target for pfw3-eqiad - T243343 |
[production] |
| 16:07 |
<XioNoX> |
update logging target for pfw3-codfw - T243343 |
[production] |
| 15:43 |
<vgutierrez> |
uploaded vhtcpd 0.1.2-2 to apt.w.o (buster) - T242093 |
[production] |
| 15:38 |
<marostegui> |
Compress wikidatawiki.wbt_text wikidatawiki.wbt_text_in_lang on db1124:3318 (this might cause lag on s8 labs) - T232446 |
[production] |
| 15:29 |
<vgutierrez> |
uploaded fifo-log-demux 0.6.1 to apt.w.o (buster) - T242093 |
[production] |
| 14:54 |
<papaul> |
FW upgrade on db2085 |
[production] |
| 14:53 |
<vgutierrez> |
copied python3-logstash to apt.w.o (buster) - T242093 |
[production] |
| 14:50 |
<vgutierrez> |
copied python3-file-read-backwards to apt.w.o (buster) - T242093 |
[production] |
| 14:39 |
<marostegui> |
Stop MySQL on db2085:3311 and db2085:3318 for onsite maintenance - T243148 |
[production] |
| 14:39 |
<marostegui> |
Stop MySQL on db2085:3311 and db2085:3318 for onsite maintenance - |
[production] |
| 14:18 |
<akosiaris> |
upload etherpad-lite_1.7.5-3 to apt.wikimedia.org buster-wikimedia/main T224580 |
[production] |
| 13:07 |
<Amir1> |
EU SWAT is over |
[production] |
| 13:03 |
<ladsgroup@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: Revert: [[gerrit:562578|Set useEntitySourceBasedFederation to true for Wikidata (T241972)]] (duration: 01m 05s) |
[production] |
| 13:02 |
<ladsgroup@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: Revert: [[gerrit:562578|Set useEntitySourceBasedFederation to true for Wikidata (T241972)]] (duration: 01m 05s) |
[production] |
| 12:59 |
<effie> |
restart npre on notebook1003 |
[production] |
| 12:57 |
<hoo> |
Updated the Wikidata property suggester with data from the 2020-01-06 JSON dump and applied the T132839 workarounds |
[production] |
| 12:51 |
<ladsgroup@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:562578|Set useEntitySourceBasedFederation to true for Wikidata (T241972)]] (duration: 01m 05s) |
[production] |
| 12:50 |
<ladsgroup@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:562578|Set useEntitySourceBasedFederation to true for Wikidata (T241972)]] (duration: 01m 06s) |
[production] |
| 12:47 |
<jbond42> |
disable puppet fleat wide - upgrade jdk on puppetdb |
[production] |
| 12:46 |
<ladsgroup@deploy1001> |
Synchronized php-1.35.0-wmf.15/extensions/WikibaseQualityConstraints: [[gerrit:566504|Better dependency injection of base URI in ConstraintParameterParser (T241972)]] (duration: 01m 05s) |
[production] |
| 12:43 |
<ladsgroup@deploy1001> |
scap failed: average error rate on 4/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/db09a36be5ed3e81155041f7d46ad040 for details) |
[production] |
| 12:36 |
<ladsgroup@deploy1001> |
Synchronized php-1.35.0-wmf.16/extensions/WikibaseQualityConstraints: [[gerrit:566505|Better dependency injection of base URI in ConstraintParameterParser (T241972)]] (duration: 01m 14s) |
[production] |
| 12:35 |
<effie> |
enable puppet and restart mtail on mw* and wtp* |
[production] |
| 12:30 |
<vgutierrez> |
uploaded trafficserver 8.0.5-1wm13 to apt.w.o (buster) - T242093 |
[production] |
| 12:17 |
<effie> |
Disable puppet on mw* and wtp* to merge 563206 |
[production] |
| 12:15 |
<jmm@cumin1001> |
END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) |
[production] |
| 12:14 |
<jmm@cumin1001> |
START - Cookbook sre.hosts.decommission |
[production] |
| 11:40 |
<moritzm> |
restarting apache on puppetboard/graphite/webperf to pick up OpenLDAP update |
[production] |
| 11:38 |
<cormacparle__> |
disabled wikitech 2fa for Cparle |
[production] |
| 11:16 |
<moritzm> |
restarting exim on MXes to pick up new openldap |
[production] |
| 11:04 |
<moritzm> |
restarting mw canaries to pick up openldap update |
[production] |
| 10:09 |
<marostegui> |
Stop MySQL on es2023 to "clone" es2024 - T243052 |
[production] |
| 10:04 |
<moritzm> |
installing openldap security updates on stretch |
[production] |
| 08:45 |
<moritzm> |
upload prometheus-etherpad-exporter 0.2 to buster-wikimedia T224580 |
[production] |
| 08:27 |
<marostegui> |
Stop MySQL on es2021 to "clone" es2023 - T243052 |
[production] |
| 06:16 |
<marostegui> |
Remove partitions from db1103:3314 - T239453 |
[production] |
| 06:15 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Depool db1103:3314 T239453', diff saved to https://phabricator.wikimedia.org/P10242 and previous config saved to /var/cache/conftool/dbconfig/20200122-061522-marostegui.json |
[production] |
| 06:14 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Repool db2091:3314 T239453', diff saved to https://phabricator.wikimedia.org/P10241 and previous config saved to /var/cache/conftool/dbconfig/20200122-061429-marostegui.json |
[production] |
| 01:13 |
<catrope@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: resync, the last sync only took on half the appservers (duration: 01m 05s) |
[production] |
| 00:31 |
<catrope@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Enable topics in suggested edits on cswiki, kowiki, arwiki, viwiki (duration: 01m 05s) |
[production] |
| 00:26 |
<catrope@deploy1001> |
Synchronized php-1.35.0-wmf.15/extensions/GrowthExperiments/: SWAT for T242811, T242052 (duration: 01m 05s) |
[production] |
|
2020-01-21
§
|
| 20:09 |
<brennen@deploy1001> |
rebuilt and synchronized wikiversions files: group0 to 1.35.0-wmf.16 |
[production] |
| 19:59 |
<mutante> |
puppet-compilers: syncing facts from puppetmasters to 3 compiler instances |
[production] |
| 19:55 |
<XioNoX> |
restart mr1-esams for software upgrade - T242097 |
[production] |
| 19:46 |
<ppchelko@deploy1001> |
Finished deploy [cpjobqueue/deploy@1ca3071]: Add separate rule for machine vision jobs T241072 (duration: 01m 11s) |
[production] |
| 19:45 |
<ppchelko@deploy1001> |
Started deploy [cpjobqueue/deploy@1ca3071]: Add separate rule for machine vision jobs T241072 |
[production] |
| 19:40 |
<andrew@cumin1001> |
END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) |
[production] |
| 19:39 |
<andrew@cumin1001> |
START - Cookbook sre.hosts.decommission |
[production] |
| 19:39 |
<XioNoX> |
mr1-esams> request system software add /var/tmp/junos-srxsme-18.2R3-S2... - T242097 |
[production] |
| 19:39 |
<andrew@cumin1001> |
END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) |
[production] |