|
2015-06-27
§
|
| 23:30 |
<bd808> |
Deleted corrupt shards on logstash1004 and logstash1005. Recovery in process |
[production] |
| 20:12 |
<ori> |
Delegated full access to Google Webmaster Tools for myself (olivneh@). |
[production] |
| 04:58 |
<LocalisationUpdate> |
ResourceLoader cache refresh completed at Sat Jun 27 04:58:46 UTC 2015 (duration 58m 45s) |
[production] |
| 02:42 |
<legoktm> |
deploying https://gerrit.wikimedia.org/r/221343 & https://gerrit.wikimedia.org/r/221344 |
[releng] |
| 02:36 |
<Krinkle> |
Reloading Zuul to deploy https://gerrit.wikimedia.org/r/221342 |
[releng] |
| 02:23 |
<LocalisationUpdate> |
completed (1.26wmf11) at 2015-06-27 02:23:40+00:00 |
[production] |
| 02:22 |
<Krinkle> |
Reloading Zuul to deploy https://gerrit.wikimedia.org/r/221338 |
[releng] |
| 02:20 |
<l10nupdate> |
Synchronized php-1.26wmf11/cache/l10n: (no message) (duration: 05m 46s) |
[production] |
| 02:15 |
<legoktm> |
deploying https://gerrit.wikimedia.org/r/#/c/221337/ |
[releng] |
| 01:56 |
<legoktm> |
deploying https://gerrit.wikimedia.org/r/221333 & https://gerrit.wikimedia.org/r/221334 |
[releng] |
| 01:42 |
<legoktm> |
deploying https://gerrit.wikimedia.org/r/221331 |
[releng] |
| 01:36 |
<legoktm> |
deploying https://gerrit.wikimedia.org/r/221330 |
[releng] |
| 01:28 |
<legoktm> |
deploying https://gerrit.wikimedia.org/r/221329 |
[releng] |
| 01:13 |
<legoktm> |
deploying https://gerrit.wikimedia.org/r/221328 |
[releng] |
| 00:15 |
<legoktm> |
deploying https://gerrit.wikimedia.org/r/221316 & https://gerrit.wikimedia.org/r/221318 |
[releng] |
|
2015-06-26
§
|
| 23:57 |
<bd808> |
Logstash log ingestion working again after forcing recovery of replicas for logstash-2015.06.26; new logs were being rejected with only a primary shard available |
[production] |
| 23:54 |
<bd808> |
re-enabled allocation on logstash elasticsearch cluster |
[production] |
| 23:05 |
<bblack> |
restarted gitblit on antimony, AGAIN |
[production] |
| 22:57 |
<mutante> |
restarted gitblit |
[production] |
| 22:44 |
<catrope> |
Synchronized php-1.26wmf11/extensions/Flow: Temporarily make subpages in Flow-occupied namespaces non-Flow again (duration: 00m 14s) |
[production] |
| 22:39 |
<marxarelli> |
Reloading Zuul to deploy I3deec5e5a7ce7eee75268d0546eafb3e4145fdc7 |
[releng] |
| 22:36 |
<bd808> |
set indices.recovery.concurrent_streams to 4 on logstash ES cluster |
[production] |
| 22:36 |
<godog> |
set indices.recovery.max_bytes_per_sec to 10mb on logstash ES cluster |
[production] |
| 22:25 |
<godog> |
set indices.recovery.max_bytes_per_sec to 50mb on logstash ES cluster |
[production] |
| 22:25 |
<jamesofur> |
Reset email address of User:Chwms identity verified in person at editathon |
[production] |
| 22:20 |
<marxarelli> |
Reloading Zuul to deploy I7affe14e878d5c1fc4bcb4dfc7f2d1494cd795b7 |
[releng] |
| 22:09 |
<bd808> |
restarted logstash on logstash1001 |
[production] |
| 21:45 |
<legoktm> |
deploying https://gerrit.wikimedia.org/r/221295 |
[releng] |
| 21:21 |
<marxarelli|lunch> |
running `jenkins-jobs update` to deploy I7affe14e878d5c1fc4bcb4dfc7f2d1494cd795b7 |
[releng] |
| 21:10 |
<urandom> |
taking xenon down to be rebootstrapped |
[production] |
| 20:10 |
<bd808> |
Deleted 4 corrupt indices (logstash-2015.05.30 logstash-2015.05.31 logstash-2015.06.03 logstash-2015.06.06) on logstash1004 |
[production] |
| 19:58 |
<bd808> |
stopping elasticsearch on logstash1004 to cleanup corrupt shards |
[production] |
| 18:46 |
<marxarelli> |
running `jenkins-jobs update '*bundle*'` to deploy Icb31cf57bee0483800b41a2fb60d236fcd2d004e |
[releng] |
| 17:05 |
<mutante> |
zirconium - manual cleanup, removing planet |
[production] |
| 17:04 |
<godog> |
reverted cronolog puppetmaster patch, restarting apache |
[production] |
| 14:17 |
<Krenair> |
Deployed patch for T103391 |
[production] |
| 12:23 |
<krenair> |
Synchronized wmf-config/wikitech.php: https://gerrit.wikimedia.org/r/#/c/221105/ (duration: 00m 12s) |
[production] |
| 12:18 |
<_joe_> |
added conf1001 to the etcd cluster |
[production] |
| 07:57 |
<krinkle> |
Synchronized php-1.26wmf11/extensions/Popups: T103610 (duration: 00m 11s) |
[production] |
| 06:04 |
<LocalisationUpdate> |
ResourceLoader cache refresh completed at Fri Jun 26 06:04:14 UTC 2015 (duration 4m 13s) |
[production] |
| 05:22 |
<twentyafterfour> |
restarted apache on iridium to fix phabricator fatal |
[production] |
| 02:33 |
<LocalisationUpdate> |
completed (1.26wmf11) at 2015-06-26 02:33:33+00:00 |
[production] |
| 02:30 |
<l10nupdate> |
Synchronized php-1.26wmf11/cache/l10n: (no message) (duration: 05m 36s) |
[production] |