651-700 of 4248 results (11ms)
2015-10-12 §
08:54 <hashar> zuul-merger process leaked file descriptors and ended up unable to open any more files. Fixed by restarting the service on gallium. https://phabricator.wikimedia.org/T115243 [releng]
08:44 <hashar> Zuul CI in trouble. zuul-merger can't not apply patches anymore https://phabricator.wikimedia.org/T115243 [releng]
02:43 <Krenair> fixed puppet on deployment-conf03 by running several manual apt-get commands [releng]
00:38 <bd808> fixed puppet on deploymnet-restbase01 by running several manual apt-get and dpkg commands; had to downgrade zsh from 5.1.1-1 (unstable) to 5.0.7-5 (stable) [releng]
00:27 <bd808> puppet failing on deployment-restbase01 due to corrupt apt config state [releng]
2015-10-11 §
14:57 <legoktm> deploying https://gerrit.wikimedia.org/r/244192 [releng]
2015-10-09 §
21:57 <greg-g> 21:51 < ori> !log deployment-prep Accidentally clobbered /etc/init.d/mysql on deployment-db1, causing deployment-prep failures. Restored now [releng]
21:55 <twentyafterfour> deployment-db1 has a running mysqld again, shinken reports recovery. [releng]
21:41 <twentyafterfour> ori broke mariadb on deployment-db1 :-P [releng]
20:28 <hashar> beta cluster parsoid now runs from /parsoid.git && npm install (was from /deploy.git previously). In case of troubles poke subbu and see revert instructions on https://phabricator.wikimedia.org/T92871 [releng]
20:16 <hashar> Parsoid on beta is broken. Busy installing npm dependencies [releng]
20:09 <hashar> switching Parsoid on beta to install dependencies with npm (instead of /deploy) https://phabricator.wikimedia.org/T92871 for subbu [releng]
14:54 <hashar> added Geodata as a dependency to the wikibase jobs ( https://gerrit.wikimedia.org/r/#/c/244489/ ) [releng]
2015-10-07 §
15:49 <bd808> Updated cherry-pick of https://gerrit.wikimedia.org/r/#/c/241984 on deployment-puppetmaster and forced puppet run on deployment-logstash2 [releng]
15:48 <bd808> Made [LOCAL HACK] commit on deployment-puppetmaster for l10nupdate cache location change [releng]
15:45 <bd808> Uncommited local change to /var/lib/git/operations/puppet/modules/scap/files/l10nupdate-1 on deployment-puppetmaster. Looks like something Krenair was working on. [releng]
13:57 <hashar> fixing up apt on deployment-cache-parsoid04 as well as salt install https://phabricator.wikimedia.org/T114755 [releng]
13:52 <hashar> Upgrading packages oon deployment-cache-{text04,mobile04,upload04} , downgrading salt-common and salt-minion in the process ( https://phabricator.wikimedia.org/T114755 ) [releng]
13:43 <hashar> Cleaning up <tt>http://debian.saltstack.com/debian/ jessie-saltstack/main</tt> from some beta-cluster instances | https://phabricator.wikimedia.org/T114755 [releng]
10:09 <hashar> deleted angry-caching-proxy.integration.eqiad.wmflabs | was an experiment no more use for it [releng]
00:16 <Krinkle> Restored normal mysql replication on deployment-beta [releng]
2015-10-06 §
23:39 <Krinkle> Messing with mysql slave replication on deployment-db2 to investigate CentralAuth bug with AaronSchulz [releng]
13:14 <hashar> mass apt-get upgrade on beta cluster ( salt '*' pkg.upgrade ) [releng]
13:09 <hashar> Upgrades are now done on a daily basis thanks to unattended upgrade ( https://gerrit.wikimedia.org/r/243925 ) [releng]
13:08 <hashar> Mass dist-upgrade of all jenkins slaves [releng]
04:04 <legoktm> deploying https://gerrit.wikimedia.org/r/243828 [releng]
2015-10-05 §
22:20 <Krenair> deployment-prep deleted deployment-bastion:/var/log/account files to free up some space on /var [releng]
22:10 <Krenair> deployment-prep Renamed deployment-bastion:/srv/l10nupdate/mediawiki/extensions/BlueSpiceExtensions to OldBlueSpiceExtensions, was not in a clean state for l10nupdate [releng]
22:00 <Krenair> deployment-prep Doing a manual run of l10nupdate [releng]
21:58 <Krenair> deployment-prep Fixed l10nupdate - I broke it with https://gerrit.wikimedia.org/r/#/c/228126/ - created https://wikitech.wikimedia.org/wiki/Hiera:Deployment-prep/host/deployment-bastion [releng]
20:25 <hashar> Image ci-jessie-wikimedia-1444076296 in wmflabs-eqiad is ready. It provides bundler/ruby [releng]
20:18 <hashar> nodepool image-update wmflabs-eqiad ci-jessie-wikimedia [releng]
15:28 <hashar> integration-slave-jessie-1001 ssh reacheable [releng]
15:28 <hashar> integration-slave-jessie-1001 pass puppet again. Caused by a conflict with the 'zip' package, solved by cherry picking https://gerrit.wikimedia.org/r/#/c/243674/ [releng]
15:21 <jzerebecki> reloading zuul for d944bbb..1272657 [releng]
14:48 <hashar> integration-slave-jessie-1001 fails ssh auth with: error: AuthorizedKeysCommand /usr/sbin/ssh-key-ldap-lookup returned status 1 [releng]
14:45 <hashar> rebooting integration-slave-jessie-1001.integration.eqiad.wmflabs , does not reply to ssh [releng]
14:34 <hashar> nodepool image-update wmflabs-eqiad ci-jessie-wikimedia [releng]
13:45 <hashar> lets funk it https://soundcloud.com/professorkliq/wire-flashing-lights?in=professorkliq/sets/wire-and-flashing-lights-ep [releng]
13:40 <hashar> stopping puppetmaster on integration. Out of memory [releng]
2015-10-04 §
21:39 <Krenair> Changed MW private DB settings in beta to set $wgDBadmin* properly so the `sql` command works again [releng]
21:39 <Krenair> Changed MW private DB settings in beta to [releng]
2015-10-03 §
18:29 <jzerebecki> reloading zuul for 4aa5d22..d609dad [releng]
01:05 <Krinkle> Clean up spurious remotes/origin/review/markahershberger/207722 branch in mediawiki/core [releng]
2015-10-02 §
08:45 <hashar> restarting Nodepool to take in account changes made to the logging configuration https://gerrit.wikimedia.org/r/#/c/240986/ [releng]
08:41 <hashar> integration-dev : rm -fR /etc/ferm/ (ferm firewall system is not installed [releng]
2015-10-01 §
16:30 <valhallasw`cloud> test again [releng]
16:30 <valhallasw`cloud> hello qa-morebots [releng]
14:50 <hashar> do I log [releng]
13:27 <hashar> deleted from Jenkins all remaining pyflakes/pep8 jobs but operations-puppet-pep8 [releng]