1701-1750 of 4515 results (15ms)
2015-04-27 §
20:15 <Krinkle> Relaunched Gearman connection [releng]
19:53 <Krinkle> Jenkins unable to re-create Gearman connection. (HTTP 503 error from /configure). Have to force restart Jenkins [releng]
17:32 <Krinkle> Relauch slave agent on deployment-bastion [releng]
17:31 <Krinkle> Jenkins slave deployment-bastion deadlock waiting for executors [releng]
08:01 <_joe_> installed hhvm 3.6 on deployment-mediawiki02 [releng]
2015-04-26 §
06:09 <thcipriani|afk> rm scap l10nfiles from /tmp on deployment-bastion root partition 100% again... [releng]
2015-04-25 §
16:00 <thcipriani|afk> manually ran logrotate on deployment-jobrunner01, root partition at 100% [releng]
15:16 <thcipriani|afk> clear /tmp/scap files on deployment-bastion, root partition at 100% [releng]
2015-04-24 §
18:10 <Krinkle> cvn Promited Rxy from member to projectadmin [releng]
18:01 <thcipriani> ran sudo chown -R mwdeploy:mwdeploy /srv/mediawiki on deployment-bastion to fix beta-scap-eqiad, hopefully [releng]
17:26 <thcipriani> remove deployment-prep from domain in /etc/puppet/puppet.conf on deployment-stream, puppet now OK [releng]
17:20 <thcipriani> rm stale lock on deployment-rsync01, puppet fine [releng]
17:10 <thcipriani> gzip /var/log/account/pacct.0 on deployment-bastion: ought to revisit logrotate on that instance. [releng]
17:00 <thcipriani> rm stale /var/lib/puppet/state/agent_catalog_run.lock on deployment-kafka02 [releng]
14:25 <_joe_> installing hhvm 3.6.1 on mediawiki-deployment01 [releng]
2015-04-23 §
17:19 <andrewbogott> rebooting deployment-parsoidcache02 because it seems troubled [releng]
06:11 <Krinkle> Running git-cache-update inside screen on integration-slave-trusty-1021 at /mnt/git [releng]
06:11 <Krinkle> integration-slave-trusty-1021 stays depooled (see T96629 and T96706) [releng]
04:35 <Krinkle> Reloading Zuul to deploy https://gerrit.wikimedia.org/r/206044 and https://gerrit.wikimedia.org/r/206072 [releng]
00:29 <bd808> cherry-picked and applied https://gerrit.wikimedia.org/r/#/c/205969/ (logstash: Convert $::realm switches to hiera) [releng]
00:17 <bd808> beta cluster fatal monitor full of "Bad file descriptor: AH00646: Error writing to /data/project/logs/apache-access.log" [releng]
00:03 <bd808> cleaned up redis leftovers on deployment-logstash1 [releng]
2015-04-22 §
23:57 <bd808> cherry-picked and applied https://gerrit.wikimedia.org/r/#/c/205968 (remove redis from logstash) [releng]
23:33 <bd808> reset deployment-salt:/var/lib/git/operations/puppet HEAD to production; forced update with upstream; re-cherry-picked I46e422825af2cf6f972b64e6d50040220ab08995 [releng]
23:29 <bd808> deployment-salt:/var/lib/git/operations/puppet in detached HEAD state; looks to be for cherry pick of I46e422825af2cf6f972b64e6d50040220ab08995 ? [releng]
21:40 <thcipriani> restarted mariadb on deployment-db{1,2} [releng]
20:20 <thcipriani> gzipped /var/log/pacct.0 on deployment-bastion [releng]
19:50 <hashar> zuul/jenkins are back up (blame Jenkins) [releng]
19:40 <hashar> reenabling Jenkins gearman client [releng]
19:30 <hashar> Gearman went back. Reenabling Jenkins as a Gearman client [releng]
19:27 <hashar> Zuul gearman is stalled. Disabling Jenkins gearman client to free up connections [releng]
17:58 <Krinkle> Creating integration-slave-trusty-1021 per T96629 (using ci1.medium type) [releng]
14:34 <hashar> beta: failures on instances are due to them being moved on different openstack compute nodes (virt***) [releng]
13:51 <jzerebecki> integration-slave-trusty-1015:~$ sudo -u jenkins-deploy rm -rf /mnt/jenkins-workspace/workspace/mwext-Wikibase-qunit/src/node_modules [releng]
12:48 <andrewbogott> migrating to new labvirt nodes [releng]
12:48 <hashar> beta: Andrew B. starting to migrate beta cluster instances on new virt servers [releng]
11:34 <hashar> integration: apt-get upgrade on integration-slave-trusty* instances [releng]
11:31 <hashar> integration: Zuul package has been uploaded for Trusty! Deleting the .deb from /home/hashar/ [releng]
2015-04-21 §
09:27 <hashar> Nodepool created it is first instance ever! :) [releng]
08:33 <_joe_> rollback installation of hhvm 3.6 [releng]
08:09 <_joe_> installing HHVM 3.6 and the corresponding extensions on deployment-mediawiki01 [releng]
01:51 <legoktm> deploying https://gerrit.wikimedia.org/r/205494 [releng]
2015-04-20 §
23:34 <legoktm> deploying https://gerrit.wikimedia.org/r/205465 [releng]
19:20 <legoktm> mediawiki-extensions-hhvm workspace on integration-slave-trusty-1011 had bad lock file, wiping [releng]
16:10 <hashar> deployment-salt kill -9 of puppetmaster processes [releng]
16:08 <hashar> deployment-salt killed git-sync-upstream netcat to labmon1001.eqiad.wmnet 8125 was eating all memory [releng]
16:04 <hashar> beta: manually rebasing operations/puppet on deployment-salt . Might have killed some live hack in the process :/ [releng]
13:58 <hashar> In Gerrit, hidden integration/jenkins-job-builder-config and integration/zuul-config historical repositories. Suggest by addshore on {{bug:T96522}} [releng]
03:39 <legoktm> deploying https://gerrit.wikimedia.org/r/205174 [releng]
2015-04-19 §
06:12 <legoktm> deploying https://gerrit.wikimedia.org/r/205076 [releng]