|
2016-02-01
§
|
| 23:46 |
<bd808> |
Elasticsearch index template for beta logstash cluster making crappy guesses about syslog events; dropped 2016-02-01 index; trying to fix default mappings |
[releng] |
| 23:08 |
<bd808> |
HHVM logs causing rejections during document parse when inserting in Elasticsearch from logstash. They contain a "timestamp" field that looks like "Feb 1 22:56:39" which is making the mapper in Elasticsearch sad. |
[releng] |
| 23:02 |
<bd808> |
Elasticsearch on deployment-logstash2 rejecting all documents with 400 status. Investigating |
[releng] |
| 22:50 |
<bd808> |
Copying deployment-logstash2.deployment-prep:/var/log/logstash/logstash.log to /srv for debugging later |
[releng] |
| 22:48 |
<bd808> |
deployment-logstash2.deployment-prep:/var/log/logstash/logstash.log is 11G of fail! |
[releng] |
| 22:46 |
<bd808> |
root partition on deployment-logstash2 full |
[releng] |
| 22:43 |
<bd808> |
No data in logstash since 2016-01-30T06:55:37.838Z; investigating |
[releng] |
| 19:28 |
<ori@mira> |
Synchronized docroot/wikipedia.org/speed-tests: I5b48a491390: Speed trials: add preconnect (duration: 01m 27s) |
[production] |
| 18:54 |
<bblack> |
banned obj.http.Content-Length == 13817 on all cache_text |
[production] |
| 18:54 |
<mutante> |
LDAP - added elukey to "ops" group |
[production] |
| 18:11 |
<mutante> |
planet1001 - rebooting for upgrade |
[production] |
| 17:54 |
<hoo> |
restarted hhvm on mw1253 |
[production] |
| 17:06 |
<thcipriani@mira> |
Synchronized wmf-config: SWAT: Use extension registration for Graph [[gerrit:266433]] (duration: 01m 29s) |
[production] |
| 16:59 |
<thcipriani@mira> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: Enable SandboxLink on or.wikipedia.org [[gerrit:267194]] (duration: 01m 31s) |
[production] |
| 16:54 |
<thcipriani@mira> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: Enable WikidataPageBanner on es.wikivoyage [[gerrit:267195]] (duration: 01m 29s) |
[production] |
| 16:52 |
<_joe_> |
restarted pybal on lvs1001 |
[production] |
| 16:47 |
<_joe_> |
installing the new HHVM package to the api appserver cluster in eqiad |
[production] |
| 16:38 |
<thcipriani@mira> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: Set WikidataPageBanner namespaces on fr.wikivoyage [[gerrit:266541]] (duration: 01m 26s) |
[production] |
| 16:32 |
<thcipriani@mira> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: Namespace configuration on cu.wikipedia [[gerrit:265885]] (duration: 01m 26s) |
[production] |
| 16:26 |
<thcipriani@mira> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: Centralise all VisualEditor feedback pages except for a few wikis [[gerrit:258206]] (duration: 01m 30s) |
[production] |
| 16:22 |
<thcipriani@mira> |
Synchronized dblists/visualeditor-default.dblist: SWAT: Enable VisualEditor by default for some other wikis [[gerrit:264765]] (duration: 01m 58s) |
[production] |
| 16:05 |
<ema> |
hhvm restarted on mw1072 |
[production] |
| 15:54 |
<krenair@mira> |
Synchronized wmf-config/interwiki.cdb: Updating interwiki cache (duration: 01m 52s) |
[production] |
| 15:48 |
<bblack> |
restarted pybal on lvs1004 (lvs1003 above was a bad log message!) |
[production] |
| 15:42 |
<bblack> |
restarted pybal on lvs1003 |
[production] |
| 15:33 |
<hashar> |
Image ci-jessie-wikimedia-1454339883 in wmflabs-eqiad is ready |
[releng] |
| 15:13 |
<bblack> |
cp3042 repooled |
[production] |
| 15:10 |
<ema> |
restarting hhvm on mw1057 |
[production] |
| 15:01 |
<hashar> |
Refreshing Nodepool image. Might have npm/grunt properly set up |
[releng] |
| 14:33 |
<chasemp> |
labstore1002 cfg scheduling |
[production] |
| 14:04 |
<godog> |
set ms-be1019 swift weight to 4000 |
[production] |
| 13:33 |
<moritzm> |
rolling reboot of xenon/cerium/praseodymium for kernel update (and updating to new openjdk-8) |
[production] |
| 12:40 |
<_joe_> |
depooling cp3042 from esams uploads |
[production] |
| 12:15 |
<_joe_> |
backing up tin homes before reimaging |
[production] |
| 11:59 |
<moritzm> |
rolling reboot of ms-be1016 to ms-be1021 for kernel update |
[production] |
| 11:39 |
<moritzm> |
uploaded openjdk-8 8u72-b15-1~bpo8+1 for jessie-wikimedia to carbon |
[production] |
| 11:34 |
<moritzm> |
uploaded openssl 1.0.2f for jessie-wikimedia to carbon |
[production] |
| 11:19 |
<godog> |
repool restbase1007 |
[production] |
| 10:32 |
<godog> |
reboot ms-be1010, xfs |
[production] |
| 10:27 |
<jynus> |
partitioning revision and logging for db2037 and db2044 (s4) |
[production] |
| 03:15 |
<legoktm> |
deploying https://gerrit.wikimedia.org/r/267630 |
[releng] |
| 00:04 |
<tstarling@mira> |
Synchronized php-1.27.0-wmf.11/includes: (no message) (duration: 01m 31s) |
[production] |