2001-2050 of 10000 results (47ms)
2017-11-15 ยง
15:40 <addshore@tin> Started scap: Revert partial scap: Update extensions/Wikidata to new wmf/1.31.0-wmf.8 branch, second try (T180539) [production]
15:29 <moritzm> installing perl security updates on trusty (Debian hosts fixed two months ago) [production]
15:14 <ladsgroup@tin> scap aborted: Update extensions/Wikidata to new wmf/1.31.0-wmf.8 branch, second try (T180539) (duration: 03m 48s) [production]
15:13 <moritzm> removing unused kernels from prometheus* [production]
15:11 <ladsgroup@tin> Started scap: Update extensions/Wikidata to new wmf/1.31.0-wmf.8 branch, second try (T180539) [production]
15:05 <moritzm> rebooting kubestagetcd* for update to 4.9.51 [production]
14:57 <ladsgroup@tin> scap aborted: Update extensions/Wikidata to new wmf/1.31.0-wmf.8 branch (T180539) (duration: 00m 31s) [production]
14:57 <ladsgroup@tin> Started scap: Update extensions/Wikidata to new wmf/1.31.0-wmf.8 branch (T180539) [production]
14:42 <Amir1> deployed ORES change for wikidata (gerrit:391197, phab:T180450) [production]
14:41 <ladsgroup@tin> Synchronized wmf-config/InitialiseSettings.php: (no justification provided) (duration: 00m 49s) [production]
14:37 <mobrovac> restbase creating Cassandra 3 revision tables on restbase1009 - T179421 [production]
14:30 <zfilipin@tin> Synchronized wmf-config/: SWAT: [[gerrit:378833|Remove wgContentTranslationEnableSuggestions]] (duration: 00m 51s) [production]
14:27 <ema> cache_upload: upgrade varnish to 4.1.8-1wm2 [production]
14:22 <zfilipin@tin> Synchronized wmf-config/CommonSettings-labs.php: SWAT: [[gerrit:320200|Beta: Explicitly set cookieDomain for ContentTranslationSiteTemplates (T149879)]] (duration: 00m 49s) [production]
14:18 <ema> repool cp4024 T174891 [production]
14:17 <mutante> wtp2017 - systemctl start ferm (ferm wasnt running due to failed DNS lookup for prometheus2003 sometime in the past) [production]
14:12 <zfilipin@tin> Synchronized php-1.31.0-wmf.8/extensions/EventBus/EventBus.php: SWAT: [[gerrit:391535|Increase request timeout to match kafka produce timeout (T180017)]] (duration: 00m 50s) [production]
14:11 <godog> upgrade hpsa firmware to 6.06 on restbase2004 - T180562 T141756 [production]
14:10 <ema> upgrade varnish to 4.1.8-1wm2 on cp4024 (cache_upload, depooled) [production]
14:04 <jynus> reload haproxy on dbproxy1010 [production]
14:00 <moritzm> installing openssl updates on kafka and hadoop clusters [production]
13:34 <ema> cache_text: upgrade varnish to 4.1.8-1wm2 [production]
13:31 <ppchelko@tin> Started restart [changeprop/deploy@065a06e]: Restart to rebalance all rules T179684 [production]
13:14 <moritzm> rebooting video scalers in eqiad for update to 4.9.51 (and to pick up openssl update) [production]
13:07 <ema> upgrade varnish to 4.1.8-1wm2 on cp3030 (cache_text) [production]
12:41 <elukey> re-enable eventlogging after maintenance [production]
12:24 <jynus> deploying dns change for m4-master [production]
12:19 <ema> cache_misc: upgrade varnish to 5.1.3-1wm3 [production]
12:09 <elukey> executed sysctl -w net.netfilter.nf_conntrack_tcp_timeout_time_wait=65 on all jobrunners [production]
12:01 <ema> upgrade varnish to 5.1.3-1wm3 on cp3007 (cache_misc) [production]
11:58 <ema> varnish 4.1.8-1wm2 uploaded to apt.w.o (main) [production]
11:50 <ema> varnish 5.1.3-1wm3 uploaded to apt.w.o (experimental) [production]
11:45 <jynus> restart haproxy on dbproxy1009 [production]
11:32 <marostegui> Stop MySQL on db1046 [production]
10:58 <moritzm> rebooting job runners in eqiad for update to 4.9.51 (and to pick up openssl update) [production]
10:29 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1106, optimizing wikidatawiki.wb_terms (duration: 00m 49s) [production]
10:09 <ppchelko@tin> Finished deploy [trending-edits/deploy@a0e1fe3]: Update node-rdkafka to v1.x attempt 4 T179786 (duration: 04m 51s) [production]
10:04 <ppchelko@tin> Started deploy [trending-edits/deploy@a0e1fe3]: Update node-rdkafka to v1.x attempt 4 T179786 [production]
10:04 <ppchelko@tin> Finished deploy [trending-edits/deploy@a0e1fe3]: Update node-rdkafka to v1.x attempt 3, force T179786 (duration: 04m 44s) [production]
09:59 <ppchelko@tin> Started deploy [trending-edits/deploy@a0e1fe3]: Update node-rdkafka to v1.x attempt 3, force T179786 [production]
09:59 <ppchelko@tin> Finished deploy [trending-edits/deploy@a0e1fe3]: Update node-rdkafka to v1.x attempt 2 T179786 (duration: 03m 32s) [production]
09:58 <ppchelko@tin> (no justification provided) [production]
09:55 <ppchelko@tin> Started deploy [trending-edits/deploy@a0e1fe3]: Update node-rdkafka to v1.x attempt 2 T179786 [production]
09:55 <ppchelko@tin> Finished deploy [trending-edits/deploy@a0e1fe3]: Update node-rdkafka to v1.x T179786 (duration: 02m 44s) [production]
09:53 <godog> reboot restbase2004 - T180562 [production]
09:52 <ppchelko@tin> Started deploy [trending-edits/deploy@a0e1fe3]: Update node-rdkafka to v1.x T179786 [production]
09:52 <mobrovac@tin> Started restart [restbase/deploy@c76a665]: Pick up the new seeds definition - T179422 [production]
09:51 <ppchelko@tin> Started deploy [trending-edits/deploy@a0e1fe3]: Update node-rdkafka to v1.x T179786 [production]
09:32 <godog> restart cassandra on restbase2002-b - T180568 [production]
09:30 <moritzm> updating openssl on database hosts [production]