1051-1100 of 2928 results (19ms)
2014-10-03 §
22:53 <bd808> Had to stop and start zuul due to NoConnectedServersError("No connected Gearman servers") in zuul.log on gallium [releng]
22:34 <bd808|deploy> Merged Ie731eaa7e10548a947d983c0539748fe5a3fe3a2 (Regenerate autoloader) to integration/phpunit for bug 71629 [releng]
19:51 <manybubbles> performing rolling restart of elasticsearch nodes to pick up preview of accelerated regex plugin for testing at larger-than-mylaptop-scale [releng]
14:02 <manybubbles> rebuilding beta's simplewiki cirrus *index* [releng]
14:02 <manybubbles> rebuilding beta's simplewiki cirrus inde [releng]
14:01 <manybubbles> rebuilding beta's simplewiki cirrus index [releng]
08:24 <hashar> deployment-bastion clearing up /var/log/account a bit {{bug|69604}}. Puppet patch pending :] [releng]
2014-10-02 §
19:42 <bd808> Updated scap to include eff0d01 Fix format specifier for error message [releng]
11:58 <hashar> Migrated all mediawiki-core-regression* jobs to Zuul cloner {{bug|71549}} [releng]
11:57 <hashar> Migrated all mediawiki-core-regression* jobs to Zuul cloner [releng]
2014-10-01 §
20:57 <bd808> hhvm servers broken because of I5f9b5c4e452e914b33313d0774fb648c1cdfe7ad [releng]
20:13 <cscott> updated OCG to version 48c495e3656f528abe636ce0cd7562270505534f [releng]
17:29 <bd808> Stopped service udp2log and started service udp2log-mw on deployment-bastion [releng]
16:40 <bd808> Added Gilles to under_NDA sudoers group [releng]
16:21 <bd808> Cherry-picked https://gerrit.wikimedia.org/r/#/c/163078/ into scap for beta. hhvm will be restarted on each scap. Keep your eyes open for weird problems like 503 responses that this may cause. [releng]
14:14 <hashar> rebased contint puppetmaster [releng]
2014-09-30 §
23:47 <bd808> jobrunner using outdated ip address for redis01. Testing patch to use hostname rather than hardcoded ip [releng]
22:00 <bd808> Cleaned deleted instances out of salt and trebuchet redis [releng]
21:45 <bd808> jobrunner not running. ebernhardson is debugging. [releng]
21:38 <bd808> /srv on rsync01 now has 3.2G of free space and should be fine fro quite a while again. [releng]
21:15 <bd808> local l10nupdate users on bastion, mediawiki01 and rsync01 [releng]
21:06 <bd808> Local mwdeploy user on deployment-bastion making things sad [releng]
20:36 <bd808> lots and lots of "file has vanished" errors from rsync. Not sure why [releng]
20:35 <bd808> Initial puppet run with role::beta::rsync_slave applied on rsync02 failed spectacularly in /Stage[main]/Mediawiki::Scap/Exec[fetch_mediawiki] stage [releng]
20:26 <bd808> Converted deployment-rsync02 to use local puppet & salt masters [releng]
20:02 <bd808> Started building deployment-rsync02 to replace deployment-rsync01 [releng]
19:59 <bd808|LUNCH> /srv partition on deployment-rsync01 full again. We need a new rsync server with more space [releng]
17:44 <bd808> Updated scap to 064425b (Remove restart-nutcracker and restart-twemproxy scripts) [releng]
16:08 <bd808> Occasional memecached-serious errors in beta for something trying to connect to the default memcached port (11211) rather than the nutcracker port (11212). [releng]
15:58 <bd808> scap happy again after fixing rogue group/user on rsync01 \\o/ Not sure why they were created but likely an ldap hiccup during a puppet run [releng]
15:56 <bd808> removed local group/user mwdeploy on deployment-rsync01 [releng]
15:54 <bd808> Local mwdeploy (gid=996) shadowing ldap group gid=603(mwdeploy) on deployment-rsync01 [releng]
15:49 <bd808> apt-get dist-upgrade fixed hhvm on deployment-mediawiki03 [releng]
15:45 <hashar> Updating our Jenkins job builder fork 686265a..ee80dbc (no job changed) [releng]
15:44 <bd808> scap failing in beta due to "Permission denied (publickey)" talking to deployment-rsync01.eqiad.wmflabs [releng]
15:39 <bd808> hhvm not starting after puppet run on deployment-mediawiki03. Investigating. [releng]
15:36 <bd808> enabling puppet and forcing run on deployment-mediawiki03 [releng]
15:36 <bd808> enabling puppet and forcing run on deployment-mediawiki03 [releng]
15:34 <bd808> enabling puppet and forcing run on deployment-mediawiki02 [releng]
15:34 <bd808> enabling puppet and forcing run on deployment-mediawiki02 [releng]
15:29 <bd808> puppet showed no changes on mediawiki01‽ [releng]
15:28 <bd808> enabling puppet and forcing run on deployment-mediawiki01 [releng]
15:27 <bd808> enabling puppet and forcing run on deployment-mediawiki01 [releng]
15:13 <bd808> Fixed logstash by installing http://packages.elasticsearch.org/logstash/1.4/debian/pool/main/l/logstash-contrib/logstash-contrib_1.4.2-1-efd53ef_all.deb [releng]
15:02 <bd808> Logstash doesn't bundle the prune filter by default any more -- http://logstash.net/docs/1.4.2/filters/prune [releng]
14:59 <bd808> Logstash rules need to be adjusted for latest upstream version: "Couldn't find any filter plugin named 'prune'" [releng]
12:37 <hashar> Fixed some file permissions under deployment-bastion:/srv/mediawiki-staging/php-master/vendor/.git some files belonged to root instead of mwdeploy [releng]
00:34 <bd808> Updated kibana to latest upstream head 8653aba [releng]
2014-09-29 §
22:45 <Reedy> re-enabled beta-scap-eqiad [releng]
21:34 <Reedy> disabled "beta-scap-eqiad" until things are fixed [releng]