5101-5150 of 7896 results (13ms)
2015-04-23 §
00:29 <bd808> cherry-picked and applied https://gerrit.wikimedia.org/r/#/c/205969/ (logstash: Convert $::realm switches to hiera) [releng]
00:17 <bd808> beta cluster fatal monitor full of "Bad file descriptor: AH00646: Error writing to /data/project/logs/apache-access.log" [releng]
00:03 <bd808> cleaned up redis leftovers on deployment-logstash1 [releng]
2015-04-22 §
23:57 <bd808> cherry-picked and applied https://gerrit.wikimedia.org/r/#/c/205968 (remove redis from logstash) [releng]
23:33 <bd808> reset deployment-salt:/var/lib/git/operations/puppet HEAD to production; forced update with upstream; re-cherry-picked I46e422825af2cf6f972b64e6d50040220ab08995 [releng]
23:29 <bd808> deployment-salt:/var/lib/git/operations/puppet in detached HEAD state; looks to be for cherry pick of I46e422825af2cf6f972b64e6d50040220ab08995 ? [releng]
21:40 <thcipriani> restarted mariadb on deployment-db{1,2} [releng]
20:20 <thcipriani> gzipped /var/log/pacct.0 on deployment-bastion [releng]
19:50 <hashar> zuul/jenkins are back up (blame Jenkins) [releng]
19:40 <hashar> reenabling Jenkins gearman client [releng]
19:30 <hashar> Gearman went back. Reenabling Jenkins as a Gearman client [releng]
19:27 <hashar> Zuul gearman is stalled. Disabling Jenkins gearman client to free up connections [releng]
17:58 <Krinkle> Creating integration-slave-trusty-1021 per T96629 (using ci1.medium type) [releng]
14:34 <hashar> beta: failures on instances are due to them being moved on different openstack compute nodes (virt***) [releng]
13:51 <jzerebecki> integration-slave-trusty-1015:~$ sudo -u jenkins-deploy rm -rf /mnt/jenkins-workspace/workspace/mwext-Wikibase-qunit/src/node_modules [releng]
12:48 <andrewbogott> migrating to new labvirt nodes [releng]
12:48 <hashar> beta: Andrew B. starting to migrate beta cluster instances on new virt servers [releng]
11:34 <hashar> integration: apt-get upgrade on integration-slave-trusty* instances [releng]
11:31 <hashar> integration: Zuul package has been uploaded for Trusty! Deleting the .deb from /home/hashar/ [releng]
2015-04-21 §
09:27 <hashar> Nodepool created it is first instance ever! :) [releng]
08:33 <_joe_> rollback installation of hhvm 3.6 [releng]
08:09 <_joe_> installing HHVM 3.6 and the corresponding extensions on deployment-mediawiki01 [releng]
01:51 <legoktm> deploying https://gerrit.wikimedia.org/r/205494 [releng]
2015-04-20 §
23:34 <legoktm> deploying https://gerrit.wikimedia.org/r/205465 [releng]
19:20 <legoktm> mediawiki-extensions-hhvm workspace on integration-slave-trusty-1011 had bad lock file, wiping [releng]
16:10 <hashar> deployment-salt kill -9 of puppetmaster processes [releng]
16:08 <hashar> deployment-salt killed git-sync-upstream netcat to labmon1001.eqiad.wmnet 8125 was eating all memory [releng]
16:04 <hashar> beta: manually rebasing operations/puppet on deployment-salt . Might have killed some live hack in the process :/ [releng]
13:58 <hashar> In Gerrit, hidden integration/jenkins-job-builder-config and integration/zuul-config historical repositories. Suggest by addshore on {{bug:T96522}} [releng]
03:39 <legoktm> deploying https://gerrit.wikimedia.org/r/205174 [releng]
2015-04-19 §
06:12 <legoktm> deploying https://gerrit.wikimedia.org/r/205076 [releng]
2015-04-18 §
05:18 <legoktm> deploying https://gerrit.wikimedia.org/r/204995 [releng]
03:09 <Krinkle> Finished set up of integration-slave-trusty-1017. Pooled. [releng]
2015-04-17 §
17:52 <Krinkle> Reloading Zuul to deploy https://gerrit.wikimedia.org/r/204812 [releng]
17:45 <Krinkle> Creating integration-slave-trusty-1017 [releng]
16:29 <Krinkle> Reloading Zuul to deploy https://gerrit.wikimedia.org/r/204791 [releng]
16:00 <Krinkle> Reloading Zuul to deploy https://gerrit.wikimedia.org/r/204783 [releng]
12:42 <hashar> restarting Jenkins [releng]
12:38 <hashar> Switching zuul on lanthanum.eqiad.wmnet to the Debian package version [releng]
12:14 <hashar> Switching Zuul scheduler on gallium.wikimedia.org to the Debian package version [releng]
12:12 <hashar> Jenkins: enabled plugin "ZMQ Event Publisher" and publishing all jobs result on TCP port 8888 [releng]
05:37 <legoktm> deploying https://gerrit.wikimedia.org/r/204706 [releng]
01:11 <Krinkle> Repool integration-slave-precise-1013 and integration-slave-trusty-1015 (live hack with libeatmydata enabled for mysql; T96308) [releng]
2015-04-16 §
22:08 <Krinkle> Rebooting integration-slave-precise-1013 (depooled; experimenting with libeatmydata) [releng]
22:07 <Krinkle> Rebooted integration-slave-trusty-1015 (experimenting with libeatmydata) [releng]
18:31 <Krinkle> Rebooting integration-slave-precise-1012 and integration-slave-trusty-1012 [releng]
17:57 <Krinkle> Repooled instances. Converstion of mysql.datadir to tmpfs worked, but puppet run has errors. Coren and Krinkle working on it. https://gerrit.wikimedia.org/r/#/c/204528/ (T96230) [releng]
17:22 <Krinkle> Gracefully depool integration slaves to deploy https://gerrit.wikimedia.org/r/#/c/204528/ (T96230) [releng]
14:35 <thcipriani> running dpkg --configure -a on deployment-bastion to correct puppet failures [releng]
2015-04-15 §
23:21 <Krinkle> beta-update-databases-eqiad stuck waiting for executors on a node that has plenty executors available [releng]