2151-2200 of 4803 results (13ms)
2015-04-07 §
11:08 <hashar> dishing out puppet SSL configuration on all integratio nodes. Can't figure out so lets restart from scratch [releng]
10:52 <hashar> made puppetmaster certname = integration-puppetmaster.eqiad.wmflabs instead of the ec2 id :( [releng]
10:49 <hashar> manually hacking integration-puppetmaster /etc/puppet/puppet.conf config file which is missing the [master] section [releng]
01:25 <Krinkle> Reloading Zuul to deploy https://gerrit.wikimedia.org/r/202300 [releng]
2015-04-06 §
23:19 <bd808> Updated scap to f9b9a82 (emove exotic unicode from ascii logo) [releng]
22:34 <legoktm> deployed https://gerrit.wikimedia.org/r/202229 [releng]
20:55 <legoktm> deploying https://gerrit.wikimedia.org/r/202233 [releng]
20:46 <legoktm> deploying https://gerrit.wikimedia.org/r/202225 [releng]
17:37 <legoktm> deploying https://gerrit.wikimedia.org/r/201032 [releng]
12:38 <Krinkle> Reloading Zuul to deploy https://gerrit.wikimedia.org/r/201984 https://gerrit.wikimedia.org/r/202020 https://gerrit.wikimedia.org/r/202026 [releng]
04:20 <legoktm> deploying https://gerrit.wikimedia.org/r/201669 [releng]
2015-04-05 §
11:13 <Krinkle> New integratin-slave-trusty-1001-1005 must remain unpooled. Provisioning failed. details at https://phabricator.wikimedia.org/T94916#1180522 [releng]
10:48 <Krinkle> Puppet on integration-puppetmaster has been failing for the past 2 days: "Failed when searching for node i-0000063a.eqiad.wmflabs: You must set the 'external_nodes' parameter to use the external node terminus" (=integraton-dev.eqiad.wmflabs) [releng]
10:22 <Krinkle> Creating integration-slave-trusty-1001-1005 per T94916. [releng]
2015-04-03 §
23:47 <greg-g> for Krinkle 23:31 "Finished npm upgrade on trusty slaves." [releng]
23:08 <Krinkle> Finished npm upgrade on precise slaves. Rolling on trusty slaves now. [releng]
22:55 <bd808> Updated scap to a1a5235 (Add a logo banner to scap) [releng]
21:31 <Krinkle> Upgrading npm from v2.4.1 to v2.7.5 (rolling, slave by slave graceful) [releng]
21:11 <^d> puppet re-enabled on staging-palladium, running fine again [releng]
21:05 <Krinkle> Delete unfinished/unpoooled instances integration-slave-precise-1011-1014. (T94916) [releng]
14:49 <hashar> integration-slave-jessie-1001 : manually installed jenkins-debian-glue Debian packages. It is pending upload by ops to apt.wikimedia.org {{bug|T95006}} [releng]
12:56 <hashar> installed zuul_2.0.0-304-g685ca22-wmf1precise1_amd64.deb on integration-slave-precise-101* instances [releng]
12:56 <hashar> installed zuul_2.0.0-304-g685ca22-wmf1precise1_amd64.deb on integration-slave-precise-1011.eqiad.wmflabs [releng]
12:35 <hashar> Switching Jessie slave from role::ci::slave::labs::common to role::ci::slave::labs which will bring a whole lot of packages and break [releng]
12:28 <hashar> integration-slave-jessie-1001 applying role::ci::slave::labs::common to pool it as a very basic Jenkins slave [releng]
12:19 <hashar> enabled puppetmaster::autosigner on integration-puppetmaster [releng]
11:58 <hashar> Applied role::ci::slave::labs on integration-slave-precise-101[1-4] that Timo created earlier [releng]
11:58 <hashar> Cherry picked a couple patches to fix puppet Package[] definitions issues [releng]
11:49 <hashar> made integration-puppetmaster to self update its puppet clone [releng]
11:42 <hashar> recreating integration-slave-precise-1011 stalled with a puppet oddity related to Package['gdb'] defined twice {{bug|T94917}} [releng]
11:30 <hashar> integration-puppetmaster migrated down to Precise [releng]
11:23 <hashar> rebooting integration-publisher : cant ssh to it [releng]
10:37 <hashar> disabled some hiera configuration related to puppetmaster. [releng]
10:22 <hashar> Created instance i-00000a4a with image "ubuntu-12.04-precise" and hostname i-00000a4a.eqiad.wmflabs. [releng]
10:21 <hashar> downgrading integration-puppetmaster from Trusty to Precise https://phabricator.wikimedia.org/T94927 [releng]
05:42 <legoktm> deploying https://gerrit.wikimedia.org/r/200744 [releng]
03:58 <Krinkle> Jobs were throwing NOT_RECOGNISED. Relaunched Gearman. Jobs are now happy again. [releng]
03:51 <Krinkle> Jenkins is unable to re-establish Gearman connection. Have to force restart Jenkins master. [releng]
03:44 <greg-g> *unable [releng]
03:44 <Krinkle> References to past hour of builds have been restored. But Jenkins is still enable to make new references properly. New builds are 404'ing the same way. [releng]
03:42 <Krinkle> Reloading Jenking config repaired the broken references. Build urls are now resolving again. [releng]
03:26 <Krinkle> Reloading Jenkins configuration from disk to mitigate [releng]
03:18 <Krinkle> The failure started at 03:03 exactly. The newer build metadata exists at /var/lib/jenkins/jobs/:jobname/builds/:nr, but the jobs/*/last*Build symlinks are no longer updated. [releng]
02:47 <Krinkle> Reloading Zuul to deploy https://gerrit.wikimedia.org/r/201644 [releng]
00:31 <greg-g> rm 'd .gitignore in /srv/mediawiki-staging/php-master/skins due to https://gerrit.wikimedia.org/r/#/c/200307/ clashing with a local untracked version [releng]
2015-04-02 §
22:56 <Krinkle> New integration-slave-precise-101x are unfinished and must remain depooled. See T94916. [releng]
22:53 <Krinkle> Most puppet failures blocking T94916 may be caused by the fact that intergration-puppetmaster was inadvertently changed to Trusty; puppetmaster version of Trusty is not yet supported by ops [releng]
21:41 <Krinkle> It seems integration-slave-jessie-1001 has role::ci::slave::labs::common instead of role::ci::slave::labs. Intentional? [releng]
21:25 <Krinkle> Re-creating integration-dev-slave-precise in preparation of re-creating precise slaves [releng]
14:51 <hashar> applying role::ci::slave::labs::common on integration-slave-jessie-1001 [releng]