|
2016-06-09
§
|
| 16:37 |
<hashar> |
Manually deleting old zuul references on scandium.eqiad.wmnet . Running in a screen |
[releng] |
| 16:32 |
<hashar> |
rebuild Nodepool jessie image ci-jessie-wikimedia-1465489579 |
[releng] |
| 16:03 |
<hashar> |
Restarting Nodepool |
[releng] |
| 15:31 |
<elukey> |
added topic override retention.bytes=536870912000 to Kafka webrequest_text (T136690) |
[production] |
| 15:28 |
<bd808> |
Fixed broken iso image builder by manually running apt for T136146 |
[mediawiki-vagrant] |
| 15:22 |
<hashar> |
Cleaning git-daemon on gallium (was used by zuul-merger) T137418 |
[production] |
| 15:19 |
<aude@tin> |
Synchronized wmf-config/InitialiseSettings.php: Add *.nara.gov to wgCopyUploadDomains (duration: 00m 40s) |
[production] |
| 14:47 |
<mobrovac> |
change-prop stopped on scb1002 |
[production] |
| 14:38 |
<elukey> |
Tested temp setting retention.bytes=2G for Analytics kafka topic webrequest_misc |
[production] |
| 14:37 |
<elukey> |
Tested retention.bytes=2G for kafka webrequest_misc |
[analytics] |
| 14:37 |
<hashar> |
Removing zuul-merger from gallium |
[production] |
| 14:36 |
<elukey> |
Tested retention.bytes=2G for kafka webrequest_misc - setting removed |
[analytics] |
| 14:33 |
<hashar> |
stopped / disabled zuul-merger on gallium T137418 |
[production] |
| 14:12 |
<mobrovac> |
change-prop restarting on scb1001 for update |
[production] |
| 14:07 |
<urandom> |
Re-enabling puppet on xenon.eqiad.wmnet, forcing a run, and restarting Cassandra : T137419 |
[production] |
| 13:52 |
<mobrovac> |
change-prop restarting on scb1002 for update |
[production] |
| 13:45 |
<mobrovac> |
change-prop deploying 2161403c |
[production] |
| 13:26 |
<urandom> |
Restarting Cassandra on xenon.eqiad.wmnet to apply 2G file cache : T137419 |
[production] |
| 12:50 |
<urandom> |
Restarting Cassandra on xenon.eqiad.wmnet : T126629 |
[production] |
| 12:33 |
<tgr@tin> |
Synchronized php-1.28.0-wmf.5/extensions/LdapAuthentication/LdapPrimaryAuthenticationProvider.php: deploy [[gerrit:293459]] to fix wikitech API login / morebots (T137377) (duration: 00m 47s) |
[production] |
| 12:19 |
<tgr> |
deploying [[gerrit:293459]] to fix morebots (T137377) |
[production] |
| 12:11 |
<urandom> |
Restarting Cassandra on xenon.eqiad.wmnet : T126629 |
[production] |
| 12:06 |
<urandom> |
Temporarily disabling puppet on xenon.eqiad.wmnet to test settings : T126629 |
[production] |
| 11:33 |
<Amir1> |
manually restarting ores-uwsgi and celery-ores-worker in scb100[12] |
[production] |
| 10:51 |
<urandom> |
Restarting Cassandra on {cerium,praseodymium}.eqiad.wmnet (RESTBase staging) : T126629 |
[production] |
| 09:16 |
<gehel> |
lowering disk high watermark to rebalance disk usage on elasticsearch eqiad cluster |
[production] |
| 09:05 |
<Amir1> |
restarting uwsgi-ores celery-ores-worker in scb1001 and scb1002 |
[production] |
| 08:54 |
<moritzm> |
installing libtasn security updates |
[production] |
| 08:38 |
<moritzm> |
rolling restart of app server canaries for libtasn security update |
[production] |
| 08:37 |
<Amir1> |
rebooting ores-compute-01 |
[ores] |
| 07:22 |
<moritzm> |
removed /var/log/logstash/logstash.1 on logstash1001, logspam (similar to the what is described in https://github.com/logstash-plugins/logstash-output-elasticsearch/issues/144) depleted the space on the root partition |
[production] |
| 02:55 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Thu Jun 9 02:55:20 UTC 2016 (duration 6m 19s) |
[production] |
| 02:53 |
<mutante> |
ms-be2012 ran out of disk due to huge syslog, deleted log, restarted rsyslogd |
[production] |
| 02:49 |
<mwdeploy@tin> |
scap sync-l10n completed (1.28.0-wmf.5) (duration: 11m 02s) |
[production] |
| 02:26 |
<mwdeploy@tin> |
scap sync-l10n completed (1.28.0-wmf.4) (duration: 11m 00s) |
[production] |
| 00:21 |
<mutante> |
logging is also broken here, test ..pling |
[releng] |
| 00:19 |
<mutante> |
is a valid project |
[tools] |
| 00:19 |
<mutante> |
how about this |
[git] |
| 00:18 |
<mutante> |
but this is |
[wikistats] |
| 00:17 |
<mutante> |
test log |
[wikistats] |
| 00:16 |
<ejegg> |
updated payments from de11bfe2273d0bcaa0e713389b2d91e8b3567a1d to c6ea2ca699aa78a90f64c77d860f69421e9a7782 |
[production] |
| 00:15 |
<mutante> |
restarted the log bot |
[production] |
| 00:11 |
<mutante> |
restarted the log bot |
[production] |
| 00:06 |
<mutante> |
meta T46791 |
[production] |
| 00:03 |
<twentyafterfour> |
Preparing to deploy phabricator update. Tagged release/2016-06-08/1 |
[production] |