2017-11-15
ยง
|
19:37 |
<gehel> |
upgrade of elasticsearch codfw completed, cluster still recovering - T178411 |
[production] |
19:34 |
<catrope@tin> |
Synchronized wmf-config/InitialiseSettings.php: Enable Minerva download icon on all wikis (T179914) (duration: 00m 48s) |
[production] |
19:30 |
<chasemp> |
labstore1004:~# service nfs-kernel-server restart |
[production] |
19:19 |
<catrope@tin> |
Synchronized php-1.31.0-wmf.8/resources/src/mediawiki.rcfilters/mw.rcfilters.UriProcessor.js: T180577 (duration: 00m 49s) |
[production] |
19:16 |
<catrope@tin> |
Synchronized php-1.31.0-wmf.7/skins/MinervaNeue/resources/skins.minerva.scripts/init.js: Limit download button to Google Chrome (T179529, T179914) (duration: 00m 49s) |
[production] |
19:14 |
<catrope@tin> |
Synchronized wmf-config/flaggedrevs.php: Enable RCFilters on all remaining wikis (T177445) (duration: 00m 49s) |
[production] |
19:01 |
<urandom> |
Restarting Cassandra instances on restbase2001.codfw.wmnet (T180568) |
[production] |
18:38 |
<Jamesofur> |
removed 2FA from User:Einsbor after verification for votewiki, stewardwiki and SUL |
[production] |
18:20 |
<moritzm> |
rebooting auth* servers for update to 4.9.51 |
[production] |
18:20 |
<moritzm> |
rebooting auth |
[production] |
17:57 |
<demon@tin> |
Synchronized docroot/search.wikimedia.org/index.php: removing support for non-wikipedias (duration: 00m 49s) |
[production] |
16:03 |
<addshore@tin> |
Finished scap: Revert partial scap: Update extensions/Wikidata to new wmf/1.31.0-wmf.8 branch, second try (T180539) (duration: 23m 48s) |
[production] |
15:56 |
<oblivian@tin> |
Finished deploy [docker-pkg/deploy@9b319d2]: Adding do extension to jinja2, needed for contint images (duration: 00m 18s) |
[production] |
15:56 |
<oblivian@tin> |
Started deploy [docker-pkg/deploy@9b319d2]: Adding do extension to jinja2, needed for contint images |
[production] |
15:55 |
<ema> |
restart pybal on lvs[12]00[36] for config change https://gerrit.wikimedia.org/r/#/c/389964/ |
[production] |
15:43 |
<jynus> |
shutting down labsdb1009 for maintenance T179244 |
[production] |
15:40 |
<addshore@tin> |
Started scap: Revert partial scap: Update extensions/Wikidata to new wmf/1.31.0-wmf.8 branch, second try (T180539) |
[production] |
15:29 |
<moritzm> |
installing perl security updates on trusty (Debian hosts fixed two months ago) |
[production] |
15:14 |
<ladsgroup@tin> |
scap aborted: Update extensions/Wikidata to new wmf/1.31.0-wmf.8 branch, second try (T180539) (duration: 03m 48s) |
[production] |
15:13 |
<moritzm> |
removing unused kernels from prometheus* |
[production] |
15:11 |
<ladsgroup@tin> |
Started scap: Update extensions/Wikidata to new wmf/1.31.0-wmf.8 branch, second try (T180539) |
[production] |
15:05 |
<moritzm> |
rebooting kubestagetcd* for update to 4.9.51 |
[production] |
14:57 |
<ladsgroup@tin> |
scap aborted: Update extensions/Wikidata to new wmf/1.31.0-wmf.8 branch (T180539) (duration: 00m 31s) |
[production] |
14:57 |
<ladsgroup@tin> |
Started scap: Update extensions/Wikidata to new wmf/1.31.0-wmf.8 branch (T180539) |
[production] |
14:42 |
<Amir1> |
deployed ORES change for wikidata (gerrit:391197, phab:T180450) |
[production] |
14:41 |
<ladsgroup@tin> |
Synchronized wmf-config/InitialiseSettings.php: (no justification provided) (duration: 00m 49s) |
[production] |
14:37 |
<mobrovac> |
restbase creating Cassandra 3 revision tables on restbase1009 - T179421 |
[production] |
14:30 |
<zfilipin@tin> |
Synchronized wmf-config/: SWAT: [[gerrit:378833|Remove wgContentTranslationEnableSuggestions]] (duration: 00m 51s) |
[production] |
14:27 |
<ema> |
cache_upload: upgrade varnish to 4.1.8-1wm2 |
[production] |
14:22 |
<zfilipin@tin> |
Synchronized wmf-config/CommonSettings-labs.php: SWAT: [[gerrit:320200|Beta: Explicitly set cookieDomain for ContentTranslationSiteTemplates (T149879)]] (duration: 00m 49s) |
[production] |
14:18 |
<ema> |
repool cp4024 T174891 |
[production] |
14:17 |
<mutante> |
wtp2017 - systemctl start ferm (ferm wasnt running due to failed DNS lookup for prometheus2003 sometime in the past) |
[production] |
14:12 |
<zfilipin@tin> |
Synchronized php-1.31.0-wmf.8/extensions/EventBus/EventBus.php: SWAT: [[gerrit:391535|Increase request timeout to match kafka produce timeout (T180017)]] (duration: 00m 50s) |
[production] |
14:11 |
<godog> |
upgrade hpsa firmware to 6.06 on restbase2004 - T180562 T141756 |
[production] |
14:10 |
<ema> |
upgrade varnish to 4.1.8-1wm2 on cp4024 (cache_upload, depooled) |
[production] |
14:04 |
<jynus> |
reload haproxy on dbproxy1010 |
[production] |
14:00 |
<moritzm> |
installing openssl updates on kafka and hadoop clusters |
[production] |
13:34 |
<ema> |
cache_text: upgrade varnish to 4.1.8-1wm2 |
[production] |
13:31 |
<ppchelko@tin> |
Started restart [changeprop/deploy@065a06e]: Restart to rebalance all rules T179684 |
[production] |
13:14 |
<moritzm> |
rebooting video scalers in eqiad for update to 4.9.51 (and to pick up openssl update) |
[production] |
13:07 |
<ema> |
upgrade varnish to 4.1.8-1wm2 on cp3030 (cache_text) |
[production] |
12:41 |
<elukey> |
re-enable eventlogging after maintenance |
[production] |
12:24 |
<jynus> |
deploying dns change for m4-master |
[production] |
12:19 |
<ema> |
cache_misc: upgrade varnish to 5.1.3-1wm3 |
[production] |
12:09 |
<elukey> |
executed sysctl -w net.netfilter.nf_conntrack_tcp_timeout_time_wait=65 on all jobrunners |
[production] |
12:01 |
<ema> |
upgrade varnish to 5.1.3-1wm3 on cp3007 (cache_misc) |
[production] |
11:58 |
<ema> |
varnish 4.1.8-1wm2 uploaded to apt.w.o (main) |
[production] |
11:50 |
<ema> |
varnish 5.1.3-1wm3 uploaded to apt.w.o (experimental) |
[production] |
11:45 |
<jynus> |
restart haproxy on dbproxy1009 |
[production] |
11:32 |
<marostegui> |
Stop MySQL on db1046 |
[production] |