2019-06-07
§
|
23:29 |
<marxarelli> |
deploying zuul changes for https://gerrit.wikimedia.org/r/c/integration/config/+/510602 |
[releng] |
23:28 |
<marxarelli> |
updating jenkins jobs for https://gerrit.wikimedia.org/r/c/integration/config/+/510602 |
[releng] |
18:56 |
<herron> |
performing rolling reboots of logstash codfw frontends for security updates |
[production] |
18:22 |
<cstone> |
Update payments-wiki revision changed from c6c7bbf71e to 75abd71cc1 |
[production] |
17:42 |
<joal> |
Drop currently unused /wmf/data/wmf/webrequest_subset folder |
[analytics] |
17:34 |
<Lucas_WMDE> |
wikibase-test-T225312 deleted instance (test over) |
[wikidata-dev] |
17:29 |
<elukey> |
chown -R analytics:analytics-privatedata-users + chmod o-rw /wmf/data/wmf/netflow on HDFS |
[analytics] |
17:21 |
<Lucas_WMDE> |
wikibase-test-T225312 sudo a2ensite 50-wikiba-se.conf |
[wikidata-dev] |
17:18 |
<mforns> |
restarted turnilo to clear deleted datasource |
[analytics] |
17:17 |
<elukey> |
restart turnilo to remove the old netflow datasource's settings |
[analytics] |
17:15 |
<Lucas_WMDE> |
wikibase-test-T225312 added proxy |
[wikidata-dev] |
17:07 |
<Lucas_WMDE> |
wikidata-test-T225312 created instance |
[wikidata-dev] |
17:06 |
<Lucas_WMDE> |
set default hiera config for role::wikibase prefix (T225312) |
[wikidata-dev] |
17:06 |
<Lucas_WMDE> |
set default hiera config for role::wikibase prefix |
[wikidata-dev] |
17:05 |
<Lucas_WMDE> |
wikibase-test-T225307 deleted instance, no longer needed for testing T225312 |
[wikidata-dev] |
17:01 |
<mforns> |
restarted turnilo to clear deleted datasource |
[analytics] |
16:59 |
<Lucas_WMDE> |
wikibase-test-T225307 edited hiera config and rebooted (investigating T225312) |
[wikidata-dev] |
16:50 |
<Lucas_WMDE> |
other-test-T225307 deleted instance (no longer needed for T225312) |
[wikidata-dev] |
16:36 |
<Lucas_WMDE> |
other-test-T225307 testing T225307 with an instance whose name does not start with wikibase- |
[wikidata-dev] |
16:35 |
<Lucas_WMDE> |
wikibase-test-T225307 testing T225307 with an instance whose name starts with wikibase- |
[wikidata-dev] |
16:18 |
<joal> |
rerun webrequest-load-wf-text-2019-6-7-14 after failure |
[analytics] |
15:34 |
<godog> |
bounce rsyslog on wezen - T199406 |
[production] |
15:09 |
<elukey> |
restart thorium for kernel upgrades |
[production] |
14:00 |
<ema> |
pool cp3039 w/ ATS backend T222937 |
[production] |
13:30 |
<godog> |
cherry pick https://gerrit.wikimedia.org/r/c/operations/puppet/+/515058 |
[releng] |
13:15 |
<ema> |
depool cp3039 and reimage as upload_ats T222937 |
[production] |
13:04 |
<arturo> |
aborrero@cumin1001:~ $ sudo cumin "P{R:Systemd::Timer::Job}" "puppet agent --enable && run-puppet-agent" (patch already merged) |
[production] |
13:03 |
<arturo> |
aborrero@cumin1001:~$ sudo cumin "P{R:Systemd::Timer::Job}" "puppet agent --disable 'arturo merging systemd timer nrpe change'" (19 hosts affected) merging: https://gerrit.wikimedia.org/r/c/operations/puppet/+/514988 |
[production] |
11:45 |
<ema> |
pool cp3043 w/ ATS backend T222937 |
[production] |
10:51 |
<jbond42> |
upload libcpp-hocon0.1.6_0.1.6-1~bpo9+1_amd64.deb to wikimedia-stretch component/facter3 |
[production] |
10:45 |
<jbond42> |
upload libleatherman-data_1.4.0+dfsg-1\~bpo9+1_all.deb to wikimedia-stretch component/facter3 |
[production] |
10:43 |
<ema> |
depool cp3043 and reimage as upload_ats T222937 |
[production] |
10:30 |
<Lucas_WMDE> |
wikibase-mud deleted instance (SSH didn’t work, we found another server we could use) |
[wikidata-dev] |
10:09 |
<_joe_> |
restarting php-fpm on the codfw hosts to pick up the recent changes in opcache |
[production] |
09:59 |
<joal> |
Kill wikitext-history job to prevent more resource-consuption becasue of failures |
[analytics] |
09:59 |
<jbond42> |
upload libleatherman1.4.0_1.4.0+dfsg-1~bpo9+1_amd64.deb to wikimedia-stretch component/facter3 |
[production] |
09:49 |
<jbond42> |
upload libleatherman1.4.0_1.4.0+dfsg-1~bpo8+1_amd64.deb to wikimedia-jessie component/facter3 |
[production] |
09:35 |
<Lucas_WMDE> |
wikibase-mud created instance |
[wikidata-dev] |
09:30 |
<Lucas_WMDE> |
wikidata-mud created instance |
[wikidata-dev] |
09:16 |
<mobrovac@deploy1001> |
scap-helm mathoid finished |
[production] |
09:16 |
<mobrovac@deploy1001> |
scap-helm mathoid cluster codfw completed |
[production] |
09:16 |
<mobrovac@deploy1001> |
scap-helm mathoid cluster eqiad completed |
[production] |
09:16 |
<mobrovac@deploy1001> |
scap-helm mathoid upgrade production stable/mathoid -f mathoid-values.yaml [namespace: mathoid, clusters: eqiad,codfw] |
[production] |
09:00 |
<marostegui> |
Upgrade x1 codfw hosts in preparation for its failover T220170 |
[production] |
08:46 |
<elukey> |
start the reboot of the Analytics Hadoop's worker nodes for kernel+openjdk upgrades |
[production] |