3001-3050 of 4379 results (16ms)
2014-05-15 §
22:14 <bd808> Restarted logstash on deployment-logstash1 yet again; memory leak from invalid encoding bug [releng]
00:14 <bd808> Disabled puppet on deployment-logstash1 to test a local logstash config change [releng]
2014-05-14 §
23:33 <bd808> Added irc input to logstash via I409fec9 [releng]
2014-05-13 §
09:28 <bd808> Restarted logstash service on deployment-logstash1 [releng]
09:28 <bd808> Logstash events stop at 2014-05-11T18:36:35Z; Log file shows many "Failed parsing date from field" errors which probably triggered the known upstream memory leak bug [releng]
2014-05-10 §
18:02 <bd808> Restarted logstash on deployment-logstash1 [releng]
2014-05-09 §
12:06 <hashar> Creating en_rtlwiki wiki {{bug|50335}} [releng]
2014-05-06 §
17:54 <bd808> Restarted logstash on deployment-logstash1 [releng]
17:53 <bd808> Logstash in beta hasn't recorded any events since 2014-05-04T04:32:36. [releng]
15:33 <manybubbles> rolling restart of Elasticsearch servers in beta to pick up new highlighter plugin to fix bugs found when we fixed hebrew analysis. and to implement phrase highlighting. [releng]
2014-05-05 §
21:29 <mwalker> ran puppetstoredconfigclean and revoked puppet and salt keys for i-00000339.eqiad.wmflabs (was pdf01) [releng]
21:24 <mwalker> removing pdf01 instance -- labs just uses production mwlib which works just fine. I'll recreate this when I make the OCG test instance [releng]
20:57 <manybubbles> deploying new plugin to Elasticsearch (swift) [releng]
2014-05-03 §
18:10 <mwalker> Updated kernel on deployment-pdf01 (manually set console=ttyS0 to match older installed kernels) [releng]
17:58 <mwalker> Converted i-00000339.eqiad.wmflabs (deployment-pdf01) to use local puppet & salt masters [releng]
17:54 <mwalker> signed salt key for i-00000339.eqiad.wmflabs (deployment-pdf01) [releng]
17:43 <bd808> Added mwalker to under_NDA sudoers group [releng]
2014-05-02 §
17:01 <bd808> Switched scap to use scripts delivered by trebuchet [releng]
2014-05-01 §
15:46 <manybubbles> upgrading Elasticsearch highlighter via a rolling restart [releng]
00:56 <bd808> Fixed empty PrivateSettings.php configuration file (which I also broke earlier) [releng]
2014-04-28 §
16:12 <manybubbles> upgrading highlighter plugin in Elasticsearch [releng]
15:43 <bd808> Created empty /srv/scap-stage-dir/wmf-config/mwblocker.log file to stop missing file warnings in beta. [releng]
2014-04-25 §
11:31 <hashar> commonswiki-75388f96: 0.6183 19.5M SQL ERROR (ignored): Table 'commonswiki.revtag_type' doesn't exist (10.68.16.193) [releng]
11:30 <hashar> Authentication is broken on the beta cluster. Well at least from commons.wikimedia.beta.wmflabs.org [releng]
2014-04-23 §
19:34 <^demon|lunch> created zhwiki, ukwiki, ruwiki, kowiki, hiwiki, jawiki for testing [releng]
10:19 <hashar> stopping udp2log and starting udp2log-mw instead (known old bug that prevents logging) [releng]
2014-04-22 §
18:42 <bd808> Rebooting deployment-bastion in a wild attempt to get the jenkins slave there working again [releng]
18:42 <bd808> Rebooting deployment-bastion in a wild attempt to get the jenkins slave there working again [releng]
2014-04-18 §
19:24 <manybubbles> rebuilding Cirrus indexes to pick up auxiliary fields and smarter accent matching [releng]
2014-04-16 §
18:56 <hashar> Migrating memc04 and memc05 to self master/salt {{bug|64010}} [releng]
13:13 <manybubbles> done [releng]
13:10 <manybubbles> rolling restart of Elasticsearch nodes in beta to make super sure it picked up new plugins [releng]
09:33 <hashar> rebased puppetmaster [releng]
2014-04-15 §
20:02 <manybubbles> restarting elasticsearch in beta to pick up a plugin update - no downtime should occur [releng]
14:24 <hashar> rebased puppetmaster [releng]
2014-04-11 §
17:41 <bd808> Tried to enable role::protoproxy::ssl::beta on deployment-cache-text02 but it failed to apply because /etc/ssl/certs/star.wmflabs.org.pem and /etc/ssl/private/star.wmflabs.org.key don't match. [releng]
03:59 <bd808> sudo apt-get install mysql-client on deployment-bastion [releng]
03:54 <bd808> Added legoktm as a project member [releng]
00:02 <bd808> Enabled https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/ [releng]
2014-04-10 §
21:35 <bd808> Running scap on deployment-bastion for the first time in eqiad [releng]
21:13 <bd808> Disabled https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/ to work on scap setup [releng]
14:52 <hashar> Adding Tobias Gritschacher to the project so he can look at udp2log / apache logs whenever needed :-] [releng]
2014-04-09 §
23:04 <bd808> Re-enabled puppet on deployment-apache02 and forced a puppet run [releng]
21:39 <bd808> Cherry-picked I8f77e0c into puppet and forced puppet run on deployment-bastion [releng]
2014-04-08 §
17:53 <manybubbles> rebuilding simplewiki's search index optimized for the new highlighter to check the size difference [releng]
05:34 <Ryan_Lane> upgraded libssl on all nodes, restarted affected ssl servers [releng]
05:03 <Ryan_Lane> upgraded libssl on all salt accessible nodes [releng]
2014-04-05 §
11:19 <hashar> Attempting to reenable SSL support with {{gerrit|124057}} [releng]
2014-04-04 §
21:39 <bd808> Restarted logstash; it stopped processing events again at 2014-04-04T19:56:46Z [releng]
17:31 <bd808> Forced puppet run on deployment-cache-text02 [releng]