|
2015-06-26
§
|
| 23:57 |
<bd808> |
Logstash log ingestion working again after forcing recovery of replicas for logstash-2015.06.26; new logs were being rejected with only a primary shard available |
[production] |
| 23:54 |
<bd808> |
re-enabled allocation on logstash elasticsearch cluster |
[production] |
| 23:05 |
<bblack> |
restarted gitblit on antimony, AGAIN |
[production] |
| 22:57 |
<mutante> |
restarted gitblit |
[production] |
| 22:44 |
<catrope> |
Synchronized php-1.26wmf11/extensions/Flow: Temporarily make subpages in Flow-occupied namespaces non-Flow again (duration: 00m 14s) |
[production] |
| 22:36 |
<bd808> |
set indices.recovery.concurrent_streams to 4 on logstash ES cluster |
[production] |
| 22:36 |
<godog> |
set indices.recovery.max_bytes_per_sec to 10mb on logstash ES cluster |
[production] |
| 22:25 |
<godog> |
set indices.recovery.max_bytes_per_sec to 50mb on logstash ES cluster |
[production] |
| 22:25 |
<jamesofur> |
Reset email address of User:Chwms identity verified in person at editathon |
[production] |
| 22:09 |
<bd808> |
restarted logstash on logstash1001 |
[production] |
| 21:10 |
<urandom> |
taking xenon down to be rebootstrapped |
[production] |
| 20:10 |
<bd808> |
Deleted 4 corrupt indices (logstash-2015.05.30 logstash-2015.05.31 logstash-2015.06.03 logstash-2015.06.06) on logstash1004 |
[production] |
| 19:58 |
<bd808> |
stopping elasticsearch on logstash1004 to cleanup corrupt shards |
[production] |
| 17:05 |
<mutante> |
zirconium - manual cleanup, removing planet |
[production] |
| 17:04 |
<godog> |
reverted cronolog puppetmaster patch, restarting apache |
[production] |
| 14:17 |
<Krenair> |
Deployed patch for T103391 |
[production] |
| 12:23 |
<krenair> |
Synchronized wmf-config/wikitech.php: https://gerrit.wikimedia.org/r/#/c/221105/ (duration: 00m 12s) |
[production] |
| 12:18 |
<_joe_> |
added conf1001 to the etcd cluster |
[production] |
| 07:57 |
<krinkle> |
Synchronized php-1.26wmf11/extensions/Popups: T103610 (duration: 00m 11s) |
[production] |
| 06:04 |
<LocalisationUpdate> |
ResourceLoader cache refresh completed at Fri Jun 26 06:04:14 UTC 2015 (duration 4m 13s) |
[production] |
| 05:22 |
<twentyafterfour> |
restarted apache on iridium to fix phabricator fatal |
[production] |
| 02:33 |
<LocalisationUpdate> |
completed (1.26wmf11) at 2015-06-26 02:33:33+00:00 |
[production] |
| 02:30 |
<l10nupdate> |
Synchronized php-1.26wmf11/cache/l10n: (no message) (duration: 05m 36s) |
[production] |
| 00:51 |
<gwicke> |
reverted restbase1001 canary to 90817c2a |
[production] |
| 00:36 |
<ori> |
Synchronized php-1.26wmf11/extensions/SyntaxHighlight_GeSHi: I0e5f2d3b2: Updated mediawiki/core Project: mediawiki/extensions/SyntaxHighlight_GeSHi (duration: 00m 11s) |
[production] |
| 00:16 |
<krinkle> |
Synchronized wmf-config/InitialiseSettings.php: T102852 (duration: 00m 12s) |
[production] |
| 00:15 |
<krinkle> |
Synchronized w/static/images/project-logos/zhwiki-2x.png: T102852 (duration: 00m 13s) |
[production] |
| 00:14 |
<krinkle> |
Synchronized w/static/images/project-logos/zhwiki-1.5x.png: T102852 (duration: 00m 12s) |
[production] |
| 00:05 |
<krinkle> |
Synchronized php-1.26wmf11/extensions/SyntaxHighlight_GeSHi/modules/pygments.wrapper.css: I5d1510dc80d6d4712ca8411 (duration: 00m 12s) |
[production] |
|
2015-06-25
§
|
| 23:53 |
<mutante> |
planet1001 (ganeti) - signing puppet cert, initial run |
[production] |
| 23:31 |
<mutante> |
apt-get upgrade on zirconium |
[production] |
| 23:28 |
<krenair> |
Synchronized wmf-config/wikitech.php: https://gerrit.wikimedia.org/r/#/c/220847/ (duration: 00m 12s) |
[production] |
| 23:27 |
<krenair> |
Synchronized wmf-config/CommonSettings.php: https://gerrit.wikimedia.org/r/#/c/220847/ (duration: 00m 11s) |
[production] |
| 23:24 |
<krenair> |
Synchronized php-1.26wmf11/extensions/SyntaxHighlight_GeSHi: https://gerrit.wikimedia.org/r/#/c/220997/ (duration: 00m 13s) |
[production] |
| 23:20 |
<gwicke> |
canary update of restbase on restbase1001 to 4b961f166 (deploy d1c4d9961) |
[production] |
| 23:16 |
<krenair> |
Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/218926/ (duration: 00m 12s) |
[production] |
| 23:11 |
<krenair> |
Synchronized wmf-config/logging.php: https://gerrit.wikimedia.org/r/#/c/220784/ (duration: 00m 13s) |
[production] |
| 23:03 |
<legoktm> |
fixed content models on lrcwiki for Module namespace |
[production] |
| 23:02 |
<krenair> |
Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/220485/ (duration: 00m 16s) |
[production] |
| 22:02 |
<hoo> |
Synchronized php-1.26wmf11/extensions/Wikidata/: Update Wikidata: Use SELECT FOR UPDATE in SqlIdGenerator (duration: 00m 20s) |
[production] |
| 21:29 |
<godog> |
rm /var/lib/git/operations/puppet/modules/cassandra from labcontrol1001 labcontrol1002 |
[production] |
| 21:10 |
<godog> |
rm /var/lib/git/operations/puppet/modules/cassandra from rhodium |
[production] |
| 21:07 |
<godog> |
rm /var/lib/git/operations/puppet/modules/cassandra from strontium and palladium |
[production] |
| 21:06 |
<godog> |
push puppet.git after module/cassandra removal T92560 |
[production] |
| 20:41 |
<mutante> |
deleted SVN monitor from watchmouse |
[production] |
| 20:18 |
<mutante> |
bye SVN - subversion URLs now redirect to phab or doc |
[production] |
| 20:08 |
<nikerabbit> |
Finished scap: T103888 CX aliases (duration: 22m 37s) |
[production] |
| 19:46 |
<nikerabbit> |
Started scap: T103888 CX aliases |
[production] |
| 18:09 |
<twentyafterfour> |
rebuilt wikiversions.cdb and synchronized wikiversions files: all wikis to 1.26wmf11 |
[production] |
| 17:46 |
<krenair> |
Synchronized wmf-config: (no message) (duration: 00m 31s) |
[production] |