3101-3150 of 10000 results (83ms)
2019-06-08 §
08:17 <joal> Manually re-run patched refine_eventlogging_analytics on an-coord1001 with flags "--ignore_failure_flag=true --since 48" [analytics]
08:12 <elukey> remove org.wikimedia.analytics.refinery.job.refine.filter_out_non_wiki_hostname from refine's transform functions temporarily to unblock T225342 [analytics]
07:37 <elukey> manual run of monitor_refine_eventlogging_analytics [analytics]
07:28 <joal> Manually run refine_eventlogging_analytics on an-coord1001 with flag --ignore_failure_flag=true [analytics]
00:49 <James_F> Updating docker-pkg files on contint1001 to build mediawiki-phan:0.2.0 based on php72 T223847 [releng]
2019-06-07 §
23:29 <marxarelli> deploying zuul changes for https://gerrit.wikimedia.org/r/c/integration/config/+/510602 [releng]
23:28 <marxarelli> updating jenkins jobs for https://gerrit.wikimedia.org/r/c/integration/config/+/510602 [releng]
18:56 <herron> performing rolling reboots of logstash codfw frontends for security updates [production]
18:22 <cstone> Update payments-wiki revision changed from c6c7bbf71e to 75abd71cc1 [production]
17:42 <joal> Drop currently unused /wmf/data/wmf/webrequest_subset folder [analytics]
17:34 <Lucas_WMDE> wikibase-test-T225312 deleted instance (test over) [wikidata-dev]
17:29 <elukey> chown -R analytics:analytics-privatedata-users + chmod o-rw /wmf/data/wmf/netflow on HDFS [analytics]
17:21 <Lucas_WMDE> wikibase-test-T225312 sudo a2ensite 50-wikiba-se.conf [wikidata-dev]
17:18 <mforns> restarted turnilo to clear deleted datasource [analytics]
17:17 <elukey> restart turnilo to remove the old netflow datasource's settings [analytics]
17:15 <Lucas_WMDE> wikibase-test-T225312 added proxy [wikidata-dev]
17:07 <Lucas_WMDE> wikidata-test-T225312 created instance [wikidata-dev]
17:06 <Lucas_WMDE> set default hiera config for role::wikibase prefix (T225312) [wikidata-dev]
17:06 <Lucas_WMDE> set default hiera config for role::wikibase prefix [wikidata-dev]
17:05 <Lucas_WMDE> wikibase-test-T225307 deleted instance, no longer needed for testing T225312 [wikidata-dev]
17:01 <mforns> restarted turnilo to clear deleted datasource [analytics]
16:59 <Lucas_WMDE> wikibase-test-T225307 edited hiera config and rebooted (investigating T225312) [wikidata-dev]
16:50 <Lucas_WMDE> other-test-T225307 deleted instance (no longer needed for T225312) [wikidata-dev]
16:36 <Lucas_WMDE> other-test-T225307 testing T225307 with an instance whose name does not start with wikibase- [wikidata-dev]
16:35 <Lucas_WMDE> wikibase-test-T225307 testing T225307 with an instance whose name starts with wikibase- [wikidata-dev]
16:18 <joal> rerun webrequest-load-wf-text-2019-6-7-14 after failure [analytics]
15:34 <godog> bounce rsyslog on wezen - T199406 [production]
15:09 <elukey> restart thorium for kernel upgrades [production]
14:00 <ema> pool cp3039 w/ ATS backend T222937 [production]
13:30 <godog> cherry pick https://gerrit.wikimedia.org/r/c/operations/puppet/+/515058 [releng]
13:15 <ema> depool cp3039 and reimage as upload_ats T222937 [production]
13:04 <arturo> aborrero@cumin1001:~ $ sudo cumin "P{R:Systemd::Timer::Job}" "puppet agent --enable && run-puppet-agent" (patch already merged) [production]
13:03 <arturo> aborrero@cumin1001:~$ sudo cumin "P{R:Systemd::Timer::Job}" "puppet agent --disable 'arturo merging systemd timer nrpe change'" (19 hosts affected) merging: https://gerrit.wikimedia.org/r/c/operations/puppet/+/514988 [production]
11:45 <ema> pool cp3043 w/ ATS backend T222937 [production]
10:51 <jbond42> upload libcpp-hocon0.1.6_0.1.6-1~bpo9+1_amd64.deb to wikimedia-stretch component/facter3 [production]
10:45 <jbond42> upload libleatherman-data_1.4.0+dfsg-1\~bpo9+1_all.deb to wikimedia-stretch component/facter3 [production]
10:43 <ema> depool cp3043 and reimage as upload_ats T222937 [production]
10:30 <Lucas_WMDE> wikibase-mud deleted instance (SSH didn’t work, we found another server we could use) [wikidata-dev]
10:09 <_joe_> restarting php-fpm on the codfw hosts to pick up the recent changes in opcache [production]
09:59 <joal> Kill wikitext-history job to prevent more resource-consuption becasue of failures [analytics]
09:59 <jbond42> upload libleatherman1.4.0_1.4.0+dfsg-1~bpo9+1_amd64.deb to wikimedia-stretch component/facter3 [production]
09:49 <jbond42> upload libleatherman1.4.0_1.4.0+dfsg-1~bpo8+1_amd64.deb to wikimedia-jessie component/facter3 [production]
09:35 <Lucas_WMDE> wikibase-mud created instance [wikidata-dev]
09:30 <Lucas_WMDE> wikidata-mud created instance [wikidata-dev]
09:16 <mobrovac@deploy1001> scap-helm mathoid finished [production]
09:16 <mobrovac@deploy1001> scap-helm mathoid cluster codfw completed [production]
09:16 <mobrovac@deploy1001> scap-helm mathoid cluster eqiad completed [production]
09:16 <mobrovac@deploy1001> scap-helm mathoid upgrade production stable/mathoid -f mathoid-values.yaml [namespace: mathoid, clusters: eqiad,codfw] [production]
09:00 <marostegui> Upgrade x1 codfw hosts in preparation for its failover T220170 [production]
08:46 <elukey> start the reboot of the Analytics Hadoop's worker nodes for kernel+openjdk upgrades [production]