751-800 of 4453 results (13ms)
2015-11-04 §
04:00 <bd808> sudo rm /var/log/apache2/*.??.gz on deployment-bastion [releng]
03:57 <bd808> sudo rm /var/log/atop.log.? on deployment-bastion [releng]
03:52 <bd808> sudo rm /var/log/account/pacct.?* on deployment-bastion for the usual reason [releng]
2015-11-03 §
22:48 <thcipriani> Reloading Zuul to deploy https://gerrit.wikimedia.org/r/250847 [releng]
22:37 <ostriches> deployment-bastion: scap now pointing to Phab repo instead of Gerrit. [releng]
22:05 <bd808> applied ::beta::deployaccess on deployment-bastion via Special:NovaInstance [releng]
21:58 <bd808> cherry-picked https://gerrit.wikimedia.org/r/#/c/250837/ and forced puppet run on deployment-bastion [releng]
13:20 <hashar> restarting Jenkins to apply updated plugins [releng]
13:09 <hashar> Jenkins upgrading a few more plugins [releng]
13:07 <hashar> Upgrading Jenkins plugin "Green Ball" from 1.14 to 1.15. Seems to fix a potential deadlock on jenkins start ( https://issues.jenkins-ci.org/browse/JENKINS-28422 ) [releng]
2015-11-02 §
20:48 <hashar> Upgraded Zuul on Trusty slaves to /root/zuul_2.1.0-60-g1cc37f7-wmf1trusty1_amd64.deb [releng]
20:00 <legoktm> deploying https://gerrit.wikimedia.org/r/250487 [releng]
16:27 <hashar> beta: restart salt-minion on a bunch of instances [releng]
16:15 <hashar> integration-slave-trusty-1014 upgrading Zuul to /root/zuul_2.1.0-60-g1cc37f7-wmf1trusty1_amd64.deb . In case of trouble unpool it from https://integration.wikimedia.org/ci/computer/integration-slave-trusty-1014/ [releng]
16:15 <hashar> integration-slave-trusty-1014 upgrading Zuul to /root/zuul_2.1.0-60-g1cc37f7-wmf1trusty1_amd64.deb [releng]
13:32 <hashar> Refreshing Nodepool snapshot to be based on new image image-jessie-20151030T221648Z.qcow2 : git -C /etc/nodepool/wikimedia/ pull && nodepool image-update wmflabs-eqiad ci-jessie-wikimedia [releng]
13:31 <hashar> openstack image create --file image-jessie-20151030T221648Z.qcow2 ci-jessie-wikimedia --disk-format qcow2 --property show=true [releng]
13:31 <hashar> openstack image set --name ci-jessie-wikimedia_old_20151102 ci-jessie-wikimedia [releng]
13:30 <hashar> updating Nodepool base image on wmflabs to get https://gerrit.wikimedia.org/r/#/c/250148/ (set hostname on debian hosts) [releng]
12:27 <hashar> Upgraded zuul-cloner on Precise slaves: 2.0.0-327-g3ebedde-wmf3precise1 -> /root/zuul_2.1.0-60-g1cc37f7-wmf1precise1_amd64.deb [releng]
12:24 <hashar> unpooling integration-slave-precise1013 and upgrading zuul-cloner 2.0.0-327-g3ebedde-wmf3precise1 -> /root/zuul_2.1.0-60-g1cc37f7-wmf1precise1_amd64.deb [releng]
10:59 <hashar> Bump integration/zuul upstream branch from 3ebedde to 1cc37f7 [releng]
10:52 <hashar> Restarting Jenkins to upgade Gearman plugin from 0.1.2 to 0.1.3 "Send node labels back on build completion" [releng]
2015-11-01 §
22:18 <legoktm> deploying https://gerrit.wikimedia.org/r/250362 [releng]
2015-10-31 §
21:31 <bd808> Ran `sudo rm /var/log/account/pacct.?` on deployment-bastion; freed ~425M [releng]
2015-10-30 §
18:19 <marxarelli> deployment-db2 replication recovered after slave stop/reset/set master position/start [releng]
18:17 <marxarelli> stopping/resetting slave on deployment-db2 to fix replicate after relay log corruption [releng]
11:35 <hashar> have varnish stats collector to emit to labmon1001.eqiad.wmnet instead of production statsd ( cherry picked https://gerrit.wikimedia.org/r/#/c/249490/ ) [releng]
2015-10-29 §
17:33 <legoktm> deploying https://gerrit.wikimedia.org/r/249223 [releng]
16:50 <legoktm> deploying https://gerrit.wikimedia.org/r/249766 [releng]
15:27 <bd808> removed shadow mwdeploy account from /etc/passwd on mira.deployment-prep.eqiad.wmflabs [releng]
10:21 <hashar> restarting Jenkins (java upgrade) [releng]
03:18 <thcipriani|afk> broken again. looks like /srv/mediawiki-staging on mira should be owned by mwdeploy [releng]
02:50 <thcipriani|afk> hooray, fixed! [releng]
02:40 <thcipriani|afk> beta-scap-eqiad failing due to rsync-created mira:/srv/mediawiki-staging/.~tmp~ directory being owned by mwdeploy but with a uid of 993 instead of 603 (local mwdeploy) [releng]
00:12 <MaxSem> Manually fixed permissions on mw-config/portals, reinitialized submodule and synced [releng]
2015-10-28 §
19:06 <legoktm> deploying https://gerrit.wikimedia.org/r/249476 [releng]
16:00 <hashar> for integration/zuul.git , created branch labs-tox-deployment to be used to deploy Zuul with pip on labs instances [releng]
15:23 <hashar> beta: deleting old deployment-parsoidcache02 (trusty) replaced by deployment-cache-parsoid05 (Jessie) [releng]
15:22 <hashar> beta: moved web proxy parsoid-beta.wmflabs.org to use http://deployment-cache-parsoid05.eqiad.wmflabs:80 [releng]
15:13 <hashar> zuul-merger will now use ZUUL_URL=git://gallium.wikimedia.org instead of ZUUL_URL=git://zuul.eqiad.wmnet ( https://gerrit.wikimedia.org/r/#/c/249389/ ) [releng]
14:47 <hashar> no matter, NFS is under maintenance [releng]
14:46 <hashar> rebooting deployment-parsoid05 . seems NFS is flappy [releng]
10:01 <hashar> applying role::cache::parsoid to deployment-cache-parsoid05 [releng]
09:58 <hashar> Deleting deployment-parsoidcache02 (Trusty) 10.68.16.145 to be replaced with deployment-cache-parsoid05 10.68.20.102 (Jessie) [releng]
09:54 <hashar> beta: deleting deployment-cache-parsoid04 not enough disk space for /srv/ ( https://phabricator.wikimedia.org/T103660 ) [releng]
05:26 <legoktm> deploying https://gerrit.wikimedia.org/r/249349 [releng]
03:43 <Krinkle> Reloading Zuul to deploy https://gerrit.wikimedia.org/r/249341 ( [releng]
2015-10-27 §
20:42 <hashar> Nuking Nodepool instances using the previous snapshot ( ci-jessie-wikimedia-1445955240 ) [releng]
20:40 <hashar> Nodepool snapshot ci-jessie-wikimedia-1445977928 generated. Includes /usr/bin/rake ( puppet: https://gerrit.wikimedia.org/r/#/c/249219/ ) [releng]