|
2017-11-15
ยง
|
| 15:56 |
<oblivian@tin> |
Started deploy [docker-pkg/deploy@9b319d2]: Adding do extension to jinja2, needed for contint images |
[production] |
| 15:55 |
<ema> |
restart pybal on lvs[12]00[36] for config change https://gerrit.wikimedia.org/r/#/c/389964/ |
[production] |
| 15:43 |
<jynus> |
shutting down labsdb1009 for maintenance T179244 |
[production] |
| 15:40 |
<addshore@tin> |
Started scap: Revert partial scap: Update extensions/Wikidata to new wmf/1.31.0-wmf.8 branch, second try (T180539) |
[production] |
| 15:29 |
<moritzm> |
installing perl security updates on trusty (Debian hosts fixed two months ago) |
[production] |
| 15:14 |
<ladsgroup@tin> |
scap aborted: Update extensions/Wikidata to new wmf/1.31.0-wmf.8 branch, second try (T180539) (duration: 03m 48s) |
[production] |
| 15:13 |
<moritzm> |
removing unused kernels from prometheus* |
[production] |
| 15:11 |
<ladsgroup@tin> |
Started scap: Update extensions/Wikidata to new wmf/1.31.0-wmf.8 branch, second try (T180539) |
[production] |
| 15:05 |
<moritzm> |
rebooting kubestagetcd* for update to 4.9.51 |
[production] |
| 14:57 |
<ladsgroup@tin> |
scap aborted: Update extensions/Wikidata to new wmf/1.31.0-wmf.8 branch (T180539) (duration: 00m 31s) |
[production] |
| 14:57 |
<ladsgroup@tin> |
Started scap: Update extensions/Wikidata to new wmf/1.31.0-wmf.8 branch (T180539) |
[production] |
| 14:42 |
<Amir1> |
deployed ORES change for wikidata (gerrit:391197, phab:T180450) |
[production] |
| 14:41 |
<ladsgroup@tin> |
Synchronized wmf-config/InitialiseSettings.php: (no justification provided) (duration: 00m 49s) |
[production] |
| 14:37 |
<mobrovac> |
restbase creating Cassandra 3 revision tables on restbase1009 - T179421 |
[production] |
| 14:30 |
<zfilipin@tin> |
Synchronized wmf-config/: SWAT: [[gerrit:378833|Remove wgContentTranslationEnableSuggestions]] (duration: 00m 51s) |
[production] |
| 14:27 |
<ema> |
cache_upload: upgrade varnish to 4.1.8-1wm2 |
[production] |
| 14:22 |
<zfilipin@tin> |
Synchronized wmf-config/CommonSettings-labs.php: SWAT: [[gerrit:320200|Beta: Explicitly set cookieDomain for ContentTranslationSiteTemplates (T149879)]] (duration: 00m 49s) |
[production] |
| 14:18 |
<ema> |
repool cp4024 T174891 |
[production] |
| 14:17 |
<mutante> |
wtp2017 - systemctl start ferm (ferm wasnt running due to failed DNS lookup for prometheus2003 sometime in the past) |
[production] |
| 14:12 |
<zfilipin@tin> |
Synchronized php-1.31.0-wmf.8/extensions/EventBus/EventBus.php: SWAT: [[gerrit:391535|Increase request timeout to match kafka produce timeout (T180017)]] (duration: 00m 50s) |
[production] |
| 14:11 |
<godog> |
upgrade hpsa firmware to 6.06 on restbase2004 - T180562 T141756 |
[production] |
| 14:10 |
<ema> |
upgrade varnish to 4.1.8-1wm2 on cp4024 (cache_upload, depooled) |
[production] |
| 14:04 |
<jynus> |
reload haproxy on dbproxy1010 |
[production] |
| 14:00 |
<moritzm> |
installing openssl updates on kafka and hadoop clusters |
[production] |
| 13:34 |
<ema> |
cache_text: upgrade varnish to 4.1.8-1wm2 |
[production] |
| 13:31 |
<ppchelko@tin> |
Started restart [changeprop/deploy@065a06e]: Restart to rebalance all rules T179684 |
[production] |
| 13:14 |
<moritzm> |
rebooting video scalers in eqiad for update to 4.9.51 (and to pick up openssl update) |
[production] |
| 13:07 |
<ema> |
upgrade varnish to 4.1.8-1wm2 on cp3030 (cache_text) |
[production] |
| 12:41 |
<elukey> |
re-enable eventlogging after maintenance |
[production] |
| 12:24 |
<jynus> |
deploying dns change for m4-master |
[production] |
| 12:19 |
<ema> |
cache_misc: upgrade varnish to 5.1.3-1wm3 |
[production] |
| 12:09 |
<elukey> |
executed sysctl -w net.netfilter.nf_conntrack_tcp_timeout_time_wait=65 on all jobrunners |
[production] |
| 12:01 |
<ema> |
upgrade varnish to 5.1.3-1wm3 on cp3007 (cache_misc) |
[production] |
| 11:58 |
<ema> |
varnish 4.1.8-1wm2 uploaded to apt.w.o (main) |
[production] |
| 11:50 |
<ema> |
varnish 5.1.3-1wm3 uploaded to apt.w.o (experimental) |
[production] |
| 11:45 |
<jynus> |
restart haproxy on dbproxy1009 |
[production] |
| 11:32 |
<marostegui> |
Stop MySQL on db1046 |
[production] |
| 10:58 |
<moritzm> |
rebooting job runners in eqiad for update to 4.9.51 (and to pick up openssl update) |
[production] |
| 10:29 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Depool db1106, optimizing wikidatawiki.wb_terms (duration: 00m 49s) |
[production] |
| 10:09 |
<ppchelko@tin> |
Finished deploy [trending-edits/deploy@a0e1fe3]: Update node-rdkafka to v1.x attempt 4 T179786 (duration: 04m 51s) |
[production] |
| 10:04 |
<ppchelko@tin> |
Started deploy [trending-edits/deploy@a0e1fe3]: Update node-rdkafka to v1.x attempt 4 T179786 |
[production] |
| 10:04 |
<ppchelko@tin> |
Finished deploy [trending-edits/deploy@a0e1fe3]: Update node-rdkafka to v1.x attempt 3, force T179786 (duration: 04m 44s) |
[production] |
| 09:59 |
<ppchelko@tin> |
Started deploy [trending-edits/deploy@a0e1fe3]: Update node-rdkafka to v1.x attempt 3, force T179786 |
[production] |
| 09:59 |
<ppchelko@tin> |
Finished deploy [trending-edits/deploy@a0e1fe3]: Update node-rdkafka to v1.x attempt 2 T179786 (duration: 03m 32s) |
[production] |
| 09:58 |
<ppchelko@tin> |
(no justification provided) |
[production] |
| 09:55 |
<ppchelko@tin> |
Started deploy [trending-edits/deploy@a0e1fe3]: Update node-rdkafka to v1.x attempt 2 T179786 |
[production] |
| 09:55 |
<ppchelko@tin> |
Finished deploy [trending-edits/deploy@a0e1fe3]: Update node-rdkafka to v1.x T179786 (duration: 02m 44s) |
[production] |
| 09:53 |
<godog> |
reboot restbase2004 - T180562 |
[production] |
| 09:52 |
<ppchelko@tin> |
Started deploy [trending-edits/deploy@a0e1fe3]: Update node-rdkafka to v1.x T179786 |
[production] |
| 09:52 |
<mobrovac@tin> |
Started restart [restbase/deploy@c76a665]: Pick up the new seeds definition - T179422 |
[production] |