2015-08-11
§
|
16:35 |
<valhallasw`cloud> |
forced rescheduling of all bots as they all seem to be offline |
[tools.morebots] |
16:23 |
<bd808> |
logstash upgrade on logstash1003 complete |
[production] |
16:20 |
<bd808> |
logstash upgrade on logstash1002 complete |
[production] |
16:16 |
<bd808> |
logstash upgrade on logstash1001 complete |
[production] |
16:14 |
<zhuyifei1999_> |
Upgraded MediaWiki to 1.25.2 |
[commonsarchive] |
15:50 |
<jynus> |
nuking db1002-db1007 on icinga |
[production] |
15:49 |
<bd808> |
upgrading logstash on logstash1001 |
[production] |
15:47 |
<bd808> |
Trebuchet deploy of logstash/plugins: Add logstash-filter-prune 0.1.5 (36144b2) |
[production] |
15:36 |
<bd808> |
Disabled puppet on logstash100[1-3] in preparation for upgrade to 1.5.3 |
[production] |
15:31 |
<bd808@tin> |
Synchronized wmf-config/InitialiseSettings.php: logging: Only send info and higher to logstash by default (4388a84) 2/2 (actually rebased this time) (duration: 00m 11s) |
[production] |
15:30 |
<bd808@tin> |
Synchronized wmf-config/logging.php: logging: Only send info and higher to logstash by default (4388a84) 1/2 (actually rebased this time) (duration: 00m 11s) |
[production] |
15:17 |
<bd808@tin> |
Synchronized wmf-config/InitialiseSettings.php: Touched wmf-config/InitialiseSettings.php (duration: 00m 13s) |
[production] |
15:12 |
<bd808@tin> |
Synchronized wmf-config/InitialiseSettings.php: logging: Only send info and higher to logstash by default (4388a84) 2/2 (duration: 00m 12s) |
[production] |
15:11 |
<bd808@tin> |
Synchronized wmf-config/logging.php: logging: Only send info and higher to logstash by default (4388a84) 1/2 (duration: 00m 12s) |
[production] |
11:36 |
<hashar> |
Fixed puppet on integration-slave-trusty-1017 . The puppet.conf servername had: <tt>integration-puppetmaster.</tt> , appended the sub domain/domain to it. |
[releng] |
10:45 |
<jynus> |
general maintenance on db1042 (restart, upgrade, db reconstruction) |
[production] |
10:38 |
<godog> |
upgrade cassandra on restbase1007 |
[production] |
10:31 |
<godog> |
upgrade cassandra on restbase1002 |
[production] |
10:25 |
<godog> |
upgrade cassandra on restbase1001 |
[production] |
09:56 |
<paravoid> |
switched routing-system autonomous-system to eqiad's subAS on cr1-eqiad/cr2--eqiad |
[production] |
09:09 |
<godog> |
reboot ms-be2009, cpu soft lockup |
[production] |
05:27 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Tue Aug 11 05:27:33 UTC 2015 (duration 27m 32s) |
[production] |
02:26 |
<l10nupdate@tin> |
LocalisationUpdate completed (1.26wmf17) at 2015-08-11 02:26:58+00:00 |
[production] |
02:23 |
<l10nupdate@tin> |
Synchronized php-1.26wmf17/cache/l10n: l10nupdate for 1.26wmf17 (duration: 06m 48s) |
[production] |
02:02 |
<legoktm> |
deleted beta-recompile-math-texvc-eqiad from jenkins |
[releng] |
02:01 |
<legoktm> |
deploying https://gerrit.wikimedia.org/r/229376 |
[releng] |
01:27 |
<legoktm> |
deploying https://gerrit.wikimedia.org/r/230619 |
[releng] |
01:20 |
<ori@tin> |
Synchronized php-1.26wmf17/includes/resourceloader/ResourceLoader.php: I2089b21fc: Revert resourceloader: Add must-revalidate to Cache-Control (duration: 00m 12s) |
[production] |
00:45 |
<bd808> |
Logstash properly creating new indices again and logs are being collected |
[releng] |
00:42 |
<bd808> |
Fixed default mapping for logstash indices to have 0 replicas |
[releng] |
00:40 |
<bd808> |
Crap! logstash errors are my fault. I updated the default index mapping and neglected to correct the replica count. Missing all data from 2015-08-08 to now |
[releng] |
00:36 |
<bd808> |
Elasticsearch index for logstash-2015.08.10 missing/corrupt |
[releng] |
00:34 |
<bd808> |
Restarted elasticsearch on deployment-logstash2 |
[releng] |
00:32 |
<bd808> |
Started logstash on deployment-logstash2; process had died from OOM |
[releng] |
00:10 |
<mutante> |
apache restart on krypton |
[production] |
00:02 |
<marxarelli> |
clearing disk space on integrations-slave-trusty-1011, integrations-slave-trusty-1012, integrations-slave-trusty-1013 |
[releng] |
2015-08-10
§
|
23:57 |
<marxarelli> |
clearing disk space on integrations-slave-trusty-1016 with `find /mnt/jenkins-workspace/workspace -mindepth 1 -maxdepth 1 -type d -mtime +15 -exec rm -rf {} \;` |
[releng] |
23:57 |
<marxarelli> |
clearing disk space on integrations-slave-trusty-1014 with `find /mnt/jenkins-workspace/workspace -mindepth 1 -maxdepth 1 -type d -mtime +15 -exec rm -rf {} \;` |
[releng] |
23:53 |
<ebernhardson@tin> |
Synchronized wmf-config/CirrusSearch-common.php: Limit the number of states in a cirrussearch query (duration: 00m 11s) |
[production] |
23:53 |
<marxarelli> |
clearing disk space on integrations-slave-trusty-1014 |
[releng] |
23:44 |
<krenair@tin> |
Synchronized php-1.26wmf17/extensions/TimedMediaHandler/TimedMediaIframeOutput.php: https://gerrit.wikimedia.org/r/#/c/230656/ (duration: 00m 12s) |
[production] |
23:40 |
<ori@tin> |
Synchronized multiversion/MWMultiVersion.php: I511999: Convert multiversion scripts to use wikiversions.php (duration: 00m 12s) |
[production] |
23:11 |
<krenair@tin> |
Synchronized wmf-config/InitialiseSettings.php: (no message) (duration: 00m 12s) |
[production] |
23:07 |
<krenair@tin> |
Synchronized wmf-config: https://gerrit.wikimedia.org/r/#/c/228040/ (duration: 00m 14s) |
[production] |
23:04 |
<ori> |
deployed scap a404a39b32... Build wikiversions.php in addition to wikiversions.cdb |
[production] |
23:04 |
<bd808> |
updated scap to a404a39: Build wikiversions.php in addition to wikiversions.cdb |
[releng] |
22:51 |
<bd808> |
testing https://gerrit.wikimedia.org/r/#/c/230679 via cherry-pick to /srv/deployment/scap/scap |
[releng] |
22:22 |
<mutante> |
restart gitblit |
[production] |
21:53 |
<mutante> |
krypton unloaded mod proxy_balancer |
[production] |
20:57 |
<ori> |
Synchronized php-1.26wmf17/includes/cache/MessageCache.php: I2089b21fc: MessageCache: use APC for local caching, rather than files (duration: 00m 12s) |
[production] |