8701-8750 of 10000 results (31ms)
2014-05-20 §
23:11 <bd808> deployment-apache01 needs more work: "Could not set shell on user[mwdeploy]" [releng]
23:06 <bd808> Fixing puppet config for upstream rename of role::applicationserver -> role::mediawiki [releng]
21:14 <ori> Converted deployment-stream to use local puppet & salt masters [releng]
21:08 <RoanKattouw> chown'ed /data/project/parsoid/parsoid.log from mwalker (?!?) to parsoid so Parsoid runs again [releng]
15:53 <bd808> Deployed scap 7b6fc47 via trebuchet [releng]
2014-05-19 §
14:34 <bd808> Restarted logstash service on deployment-logstash1; it stopped logging new events at 10:37:13Z [releng]
2014-05-16 §
21:20 <manybubbles> restarting elasticsearch in beta to update some plugins [releng]
00:34 <bd808> Updated EventLogging to I89819bd [releng]
2014-05-15 §
22:14 <bd808> Restarted logstash on deployment-logstash1 yet again; memory leak from invalid encoding bug [releng]
00:14 <bd808> Disabled puppet on deployment-logstash1 to test a local logstash config change [releng]
2014-05-14 §
23:33 <bd808> Added irc input to logstash via I409fec9 [releng]
2014-05-13 §
09:28 <bd808> Restarted logstash service on deployment-logstash1 [releng]
09:28 <bd808> Logstash events stop at 2014-05-11T18:36:35Z; Log file shows many "Failed parsing date from field" errors which probably triggered the known upstream memory leak bug [releng]
2014-05-10 §
18:02 <bd808> Restarted logstash on deployment-logstash1 [releng]
2014-05-09 §
12:06 <hashar> Creating en_rtlwiki wiki {{bug|50335}} [releng]
2014-05-06 §
17:54 <bd808> Restarted logstash on deployment-logstash1 [releng]
17:53 <bd808> Logstash in beta hasn't recorded any events since 2014-05-04T04:32:36. [releng]
15:33 <manybubbles> rolling restart of Elasticsearch servers in beta to pick up new highlighter plugin to fix bugs found when we fixed hebrew analysis. and to implement phrase highlighting. [releng]
2014-05-05 §
21:29 <mwalker> ran puppetstoredconfigclean and revoked puppet and salt keys for i-00000339.eqiad.wmflabs (was pdf01) [releng]
21:24 <mwalker> removing pdf01 instance -- labs just uses production mwlib which works just fine. I'll recreate this when I make the OCG test instance [releng]
20:57 <manybubbles> deploying new plugin to Elasticsearch (swift) [releng]
2014-05-03 §
18:10 <mwalker> Updated kernel on deployment-pdf01 (manually set console=ttyS0 to match older installed kernels) [releng]
17:58 <mwalker> Converted i-00000339.eqiad.wmflabs (deployment-pdf01) to use local puppet & salt masters [releng]
17:54 <mwalker> signed salt key for i-00000339.eqiad.wmflabs (deployment-pdf01) [releng]
17:43 <bd808> Added mwalker to under_NDA sudoers group [releng]
2014-05-02 §
17:01 <bd808> Switched scap to use scripts delivered by trebuchet [releng]
2014-05-01 §
15:46 <manybubbles> upgrading Elasticsearch highlighter via a rolling restart [releng]
00:56 <bd808> Fixed empty PrivateSettings.php configuration file (which I also broke earlier) [releng]
2014-04-28 §
16:12 <manybubbles> upgrading highlighter plugin in Elasticsearch [releng]
15:43 <bd808> Created empty /srv/scap-stage-dir/wmf-config/mwblocker.log file to stop missing file warnings in beta. [releng]
2014-04-25 §
11:31 <hashar> commonswiki-75388f96: 0.6183 19.5M SQL ERROR (ignored): Table 'commonswiki.revtag_type' doesn't exist (10.68.16.193) [releng]
11:30 <hashar> Authentication is broken on the beta cluster. Well at least from commons.wikimedia.beta.wmflabs.org [releng]
2014-04-23 §
19:34 <^demon|lunch> created zhwiki, ukwiki, ruwiki, kowiki, hiwiki, jawiki for testing [releng]
10:19 <hashar> stopping udp2log and starting udp2log-mw instead (known old bug that prevents logging) [releng]
2014-04-22 §
18:42 <bd808> Rebooting deployment-bastion in a wild attempt to get the jenkins slave there working again [releng]
18:42 <bd808> Rebooting deployment-bastion in a wild attempt to get the jenkins slave there working again [releng]
2014-04-18 §
19:24 <manybubbles> rebuilding Cirrus indexes to pick up auxiliary fields and smarter accent matching [releng]
2014-04-16 §
18:56 <hashar> Migrating memc04 and memc05 to self master/salt {{bug|64010}} [releng]
13:13 <manybubbles> done [releng]
13:10 <manybubbles> rolling restart of Elasticsearch nodes in beta to make super sure it picked up new plugins [releng]
09:33 <hashar> rebased puppetmaster [releng]
2014-04-15 §
20:02 <manybubbles> restarting elasticsearch in beta to pick up a plugin update - no downtime should occur [releng]
14:24 <hashar> rebased puppetmaster [releng]
2014-04-11 §
17:41 <bd808> Tried to enable role::protoproxy::ssl::beta on deployment-cache-text02 but it failed to apply because /etc/ssl/certs/star.wmflabs.org.pem and /etc/ssl/private/star.wmflabs.org.key don't match. [releng]
03:59 <bd808> sudo apt-get install mysql-client on deployment-bastion [releng]
03:54 <bd808> Added legoktm as a project member [releng]
00:02 <bd808> Enabled https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/ [releng]
2014-04-10 §
21:35 <bd808> Running scap on deployment-bastion for the first time in eqiad [releng]
21:13 <bd808> Disabled https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/ to work on scap setup [releng]
14:52 <hashar> Adding Tobias Gritschacher to the project so he can look at udp2log / apache logs whenever needed :-] [releng]