401-450 of 10000 results (16ms)
2017-11-15 ยง
19:01 <urandom> Restarting Cassandra instances on restbase2001.codfw.wmnet (T180568) [production]
18:38 <Jamesofur> removed 2FA from User:Einsbor after verification for votewiki, stewardwiki and SUL [production]
18:20 <moritzm> rebooting auth* servers for update to 4.9.51 [production]
18:20 <moritzm> rebooting auth [production]
17:57 <demon@tin> Synchronized docroot/search.wikimedia.org/index.php: removing support for non-wikipedias (duration: 00m 49s) [production]
16:03 <addshore@tin> Finished scap: Revert partial scap: Update extensions/Wikidata to new wmf/1.31.0-wmf.8 branch, second try (T180539) (duration: 23m 48s) [production]
15:56 <oblivian@tin> Finished deploy [docker-pkg/deploy@9b319d2]: Adding do extension to jinja2, needed for contint images (duration: 00m 18s) [production]
15:56 <oblivian@tin> Started deploy [docker-pkg/deploy@9b319d2]: Adding do extension to jinja2, needed for contint images [production]
15:55 <ema> restart pybal on lvs[12]00[36] for config change https://gerrit.wikimedia.org/r/#/c/389964/ [production]
15:43 <jynus> shutting down labsdb1009 for maintenance T179244 [production]
15:40 <addshore@tin> Started scap: Revert partial scap: Update extensions/Wikidata to new wmf/1.31.0-wmf.8 branch, second try (T180539) [production]
15:29 <moritzm> installing perl security updates on trusty (Debian hosts fixed two months ago) [production]
15:14 <ladsgroup@tin> scap aborted: Update extensions/Wikidata to new wmf/1.31.0-wmf.8 branch, second try (T180539) (duration: 03m 48s) [production]
15:13 <moritzm> removing unused kernels from prometheus* [production]
15:11 <ladsgroup@tin> Started scap: Update extensions/Wikidata to new wmf/1.31.0-wmf.8 branch, second try (T180539) [production]
15:05 <moritzm> rebooting kubestagetcd* for update to 4.9.51 [production]
14:57 <ladsgroup@tin> scap aborted: Update extensions/Wikidata to new wmf/1.31.0-wmf.8 branch (T180539) (duration: 00m 31s) [production]
14:57 <ladsgroup@tin> Started scap: Update extensions/Wikidata to new wmf/1.31.0-wmf.8 branch (T180539) [production]
14:42 <Amir1> deployed ORES change for wikidata (gerrit:391197, phab:T180450) [production]
14:41 <ladsgroup@tin> Synchronized wmf-config/InitialiseSettings.php: (no justification provided) (duration: 00m 49s) [production]
14:37 <mobrovac> restbase creating Cassandra 3 revision tables on restbase1009 - T179421 [production]
14:30 <zfilipin@tin> Synchronized wmf-config/: SWAT: [[gerrit:378833|Remove wgContentTranslationEnableSuggestions]] (duration: 00m 51s) [production]
14:27 <ema> cache_upload: upgrade varnish to 4.1.8-1wm2 [production]
14:22 <zfilipin@tin> Synchronized wmf-config/CommonSettings-labs.php: SWAT: [[gerrit:320200|Beta: Explicitly set cookieDomain for ContentTranslationSiteTemplates (T149879)]] (duration: 00m 49s) [production]
14:18 <ema> repool cp4024 T174891 [production]
14:17 <mutante> wtp2017 - systemctl start ferm (ferm wasnt running due to failed DNS lookup for prometheus2003 sometime in the past) [production]
14:12 <zfilipin@tin> Synchronized php-1.31.0-wmf.8/extensions/EventBus/EventBus.php: SWAT: [[gerrit:391535|Increase request timeout to match kafka produce timeout (T180017)]] (duration: 00m 50s) [production]
14:11 <godog> upgrade hpsa firmware to 6.06 on restbase2004 - T180562 T141756 [production]
14:10 <ema> upgrade varnish to 4.1.8-1wm2 on cp4024 (cache_upload, depooled) [production]
14:04 <jynus> reload haproxy on dbproxy1010 [production]
14:00 <moritzm> installing openssl updates on kafka and hadoop clusters [production]
13:34 <ema> cache_text: upgrade varnish to 4.1.8-1wm2 [production]
13:31 <ppchelko@tin> Started restart [changeprop/deploy@065a06e]: Restart to rebalance all rules T179684 [production]
13:14 <moritzm> rebooting video scalers in eqiad for update to 4.9.51 (and to pick up openssl update) [production]
13:07 <ema> upgrade varnish to 4.1.8-1wm2 on cp3030 (cache_text) [production]
12:41 <elukey> re-enable eventlogging after maintenance [production]
12:24 <jynus> deploying dns change for m4-master [production]
12:19 <ema> cache_misc: upgrade varnish to 5.1.3-1wm3 [production]
12:09 <elukey> executed sysctl -w net.netfilter.nf_conntrack_tcp_timeout_time_wait=65 on all jobrunners [production]
12:01 <ema> upgrade varnish to 5.1.3-1wm3 on cp3007 (cache_misc) [production]
11:58 <ema> varnish 4.1.8-1wm2 uploaded to apt.w.o (main) [production]
11:50 <ema> varnish 5.1.3-1wm3 uploaded to apt.w.o (experimental) [production]
11:45 <jynus> restart haproxy on dbproxy1009 [production]
11:32 <marostegui> Stop MySQL on db1046 [production]
10:58 <moritzm> rebooting job runners in eqiad for update to 4.9.51 (and to pick up openssl update) [production]
10:29 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1106, optimizing wikidatawiki.wb_terms (duration: 00m 49s) [production]
10:09 <ppchelko@tin> Finished deploy [trending-edits/deploy@a0e1fe3]: Update node-rdkafka to v1.x attempt 4 T179786 (duration: 04m 51s) [production]
10:04 <ppchelko@tin> Started deploy [trending-edits/deploy@a0e1fe3]: Update node-rdkafka to v1.x attempt 4 T179786 [production]
10:04 <ppchelko@tin> Finished deploy [trending-edits/deploy@a0e1fe3]: Update node-rdkafka to v1.x attempt 3, force T179786 (duration: 04m 44s) [production]
09:59 <ppchelko@tin> Started deploy [trending-edits/deploy@a0e1fe3]: Update node-rdkafka to v1.x attempt 3, force T179786 [production]