2101-2150 of 7173 results (14ms)
2016-09-07 §
10:37 <hashar> beta: cleaning up salt-keys on deployment-salt02 . Bunch of instances got deleted [releng]
09:41 <hashar> Moving rake jobs back to Nodepool ( T143938 ) with https://gerrit.wikimedia.org/r/#/c/306723/ and https://gerrit.wikimedia.org/r/#/c/306724/ [releng]
05:57 <legoktm> deploying https://gerrit.wikimedia.org/r/308932 https://gerrit.wikimedia.org/r/299697 [releng]
05:25 <legoktm> cherry-picked https://gerrit.wikimedia.org/r/#/c/308918/ onto integration-puppetmaster with a hack that has it only apply to integration-slave-jessie-1005 [releng]
04:59 <legoktm> added Krenair to integration project to help debug puppet stuff [releng]
04:35 <legoktm> depooled integration-slave-jessie-1005 in jenkins so I can test puppet stuff on it [releng]
2016-09-06 §
13:58 <hashar> Qunit jobs should be all fine again now. T144802 [releng]
13:46 <hashar> nodepool.SnapshotImageUpdater: Image ci-jessie-wikimedia-1473169259 in wmflabs-eqiad is ready T144802 [releng]
13:20 <hashar> Rebuilding Nodepool Jessie image to hopefully include libapache-mod-php5 and restore qunit jobs behavior T144802 [releng]
10:37 <hashar> gerrit: mark apps/android/commons hidden since it is now community maintained on GitHub. Will avoid confusion. T127678 [releng]
09:11 <hashar> nodepool.SnapshotImageUpdater: Image ci-trusty-wikimedia-1473152801 in wmflabs-eqiad is ready [releng]
09:06 <hashar> nodepool.SnapshotImageUpdater: Image ci-jessie-wikimedia-1473152393 in wmflabs-eqiad is ready [releng]
09:00 <hashar> Trying to refresh Nodepool Jessie image . Image properties have been dropped, should fix it [releng]
2016-09-05 §
14:08 <hashar> Refreshing Nodepool base images for Trusty and Jessie. Managed to build new ones after T143769 [releng]
2016-09-02 §
20:36 <legoktm> deploying https://gerrit.wikimedia.org/r/308227 [releng]
15:17 <hashar> Bringing tox jobs to Nodepool with https://gerrit.wikimedia.org/r/#/c/306725/ [releng]
2016-09-01 §
19:00 <urandom> T130861: Restarting Cassandra on deployment-restbase0[1-2] [releng]
18:58 <urandom> T130861: De-cherry-picking https://gerrit.wikimedia.org/r/#/c/282466/ [releng]
18:34 <urandom> T130861: Restarting Cassandra on deployment-restbase0[1-2] [releng]
18:32 <urandom> T130861: Cherry picking https://gerrit.wikimedia.org/r/#/c/282466/ to deployment-puppetmaster [releng]
16:38 <legoktm> deploying https://gerrit.wikimedia.org/r/307794 [releng]
12:22 <hashar> migrating deployment-tin keyholder to use base::service_unit for moritm https://gerrit.wikimedia.org/r/#/c/307510/ + reboot + keyholder arm [releng]
03:09 <Krinkle> Reloading Zuul to deploy https://gerrit.wikimedia.org/r/307909 [releng]
2016-08-31 §
23:40 <bd808> forced puppet run on deployment-salt02. Had not run automatically for 8 hours [releng]
23:36 <bd808> Deleted /data/scratch on integration-slave-trusty-1016 to fix puppet [releng]
23:32 <bd808> Deleted /data/scratch on integration-slave-trusty-1013 to fix puppet [releng]
23:22 <bd808> Deleted /data/scratch on integration-slave-trusty-1012 to fix puppet [releng]
23:19 <bd808> Deleted /data/scratch on integration-slave-trusty-1011 to fix puppet [releng]
23:15 <bd808> Deleted /data/scratch on integration-slave-precise-1012 to fix puppet [releng]
23:11 <bd808> Deleted /data on integration-slave-precise-1011 to fix puppet [releng]
23:08 <bd808> Deleted /data on integration-slave-jessie-1001 to fix puppet [releng]
23:04 <bd808> Deleted empty /data, /data/project, and /data/scratch on integration-puppetmaster to fix puppet [releng]
22:59 <bd808> Deleted empty /data, /data/project, and /data/scratch on integration-publisher to fix puppet [releng]
01:44 <Krinkle> Reloading Zuul to deploy https://gerrit.wikimedia.org/r/307670 [releng]
2016-08-30 §
23:31 <yuvipanda> cherry-picking https://gerrit.wikimedia.org/r/#/c/307656/ fixed puppet on the elasticsearch machines! [releng]
23:20 <Krenair> removed 'project_id' key from deployment-restbase02's metadata to fix compatibility with the new labsprojectfrommetadata code [releng]
22:29 <yuvipanda> in lieu of blood sacrifice, restart puppetmaster on deployment-pupetmaster [releng]
21:43 <yuvipanda> use clush to fix puppet.conf of all clients, realize also accidentally set a client's puppet.conf for the server, recover server's old conf file from a cat in shell history, restore, breathe sigh of relief [releng]
21:37 <yuvipanda> sudo takes like 15s each time, is there no god? [releng]
21:36 <yuvipanda> managed to get vim into a state where I can not quit it, probably recording a macro. I hate computers [releng]
21:16 <yuvipanda> deployment-pdf01 fixed manually [releng]
21:15 <yuvipanda> deployment-pdf02 has proper ssl certs mysteriously without me doing anything [releng]
21:06 <yuvipanda> moved deployment-db[12], deployment-stream to not use role::puppet::self, attempting to semi-automate rest [releng]
20:52 <yuvipanda> cherry-picked appropriate patch on deployment-puppetmaster for T120159, did https://wikitech.wikimedia.org/w/index.php?title=Hiera:Deployment-prep/host/deployment-puppetmaster&oldid=818847 to make sure the puppetmaster allows connections from elsewhere [releng]
19:48 <legoktm> deploying https://gerrit.wikimedia.org/r/306710 [releng]
19:13 <bd808> Fixed puppet runs on deployment-sca0[12] with cherry-pick of https://gerrit.wikimedia.org/r/#/c/307561 [releng]
18:57 <bd808> Duplicate declaration: File[/srv/deployment] is already declared in file /etc/puppet/modules/contint/manifests/deployment_dir.pp:14; cannot redeclare at /etc/puppet/modules/service/manifests/deploy/common.pp:12 on node deployment-sca01.deployment-prep.eqiad.wmflabs [releng]
18:40 <bd808> Puppet busted on deployment-aqs01 -- Could not find data item analytics_hadoop_hosts in any Hiera data file and no default supplied at /etc/puppet/manifests/role/aqs.pp:46 [releng]
18:09 <yuvipanda> reboot deployment-kafka03 seems to be stuck [releng]
12:59 <hashar> beta: revert master branch to origin. Ran scap and enabled again beta-code-update-eqiad job. [releng]