6351-6400 of 10000 results (14ms)
2016-05-27 §
19:29 <hasharAway> Refreshed Nodepool images [releng]
18:13 <thcipriani> restarting zuul for deadlock [releng]
18:00 <thcipriani> Reloading Zuul to deploy I0c3aeacf92d430ad1272f5f00e7fb7182b8a05bf [releng]
02:55 <bd808> Deleted deployment-fluorine:/srv/mw-log/archive/*-20160[34]* logs; freed 26G [releng]
2016-05-26 §
22:23 <hashar> salt -v '*trusty*' cmd.run 'puppet agent --disable "Chromium needs to be v49. See T136188"' [releng]
21:47 <hashar> integration-slave-trusty-1015 still on Chromium 50 .. T136188 [releng]
21:42 <hashar> downgrading chromium-browser on integration-slave-1015 T136188 [releng]
09:24 <jzerebecki> reloading zuul for d38ad0a..6798539 [releng]
07:48 <gehel> deployment-prep upgrading elasticsearch to 2.3.3 and restarting (T133124) [releng]
07:36 <dcausse> deployment-prep elastic: updating cirrussearch warmers (T133124) [releng]
07:31 <gehel> deployment-prep deploying new elasticsearch plugins (T133124) [releng]
2016-05-25 §
22:38 <Amir1> running puppet agent manually on sca01 [releng]
16:26 <hashar> 2016-05-25 16:24:35,491 INFO nodepool.image.build.wmflabs-eqiad.ci-trusty-wikimedia: Notice: /Stage[main]/Main/Package[ruby-jsduck]/ensure: ensure changed 'purged' to 'present' T109005 [releng]
15:07 <hashar> g++ added to Jessie and Trusty Nodepool instances | T119143 [releng]
14:12 <hashar> Regenerating Nodepool snapshot to include g++ which is required by some NodeJS native modules T119143 [releng]
10:58 <hashar> Updating Nodepool ci-jessie-wikimedia snapshot image to get netpbm package installed into it. T126992 https://gerrit.wikimedia.org/r/290651 [releng]
09:30 <hashar> Clearing git-sync-upstream script on integration-slave-trusty1013 and integration-slave-trusty-1017. That is only supposed to be on the puppetmaster [releng]
09:15 <hashar> Fixed resolv.conf on integration-slave-trusty-1013 and force running puppet to catch up with change since May 16 19:52 [releng]
09:11 <hashar> restarting puppetmaster on integration-puppetmaster ( memory leak / can not fork) [releng]
2016-05-24 §
07:03 <mobrovac> rebooting deployment-tin, can't log in [releng]
2016-05-23 §
19:35 <hashar> killed all mysqld process on Trusty CI slaves [releng]
15:49 <thcipriani> beta code update not running, disconnect-reconnect dance resulted in: [05/23/16 15:48:39] [SSH] Authentication failed. [releng]
14:32 <jzerebecki> offlined integration-slave-trusty-1004 because it can't connect to mysql T135997 [releng]
13:32 <hashar> Upgrading Jenkins git plugins and restarting Jenkins [releng]
11:01 <hashar> Upgrading hhvm on Trusty slaves. Bring him hhvm compiled against libicu52 instead of libicu48 [releng]
09:12 <_joe_> deployment-prep: all hhvm hosts in beta upgraded to run on the newer libicu; now running updateCollation.php (T86096) [releng]
09:11 <hashar> Image ci-jessie-wikimedia-1463994307 in wmflabs-eqiad is ready [releng]
09:01 <hashar> Image ci-trusty-wikimedia-1463993508 in wmflabs-eqiad is ready [releng]
08:56 <_joe_> deployment-prep: starting upgrade of HHVM to a version linked to libicu52, T86096 [releng]
08:54 <hashar> Regenerating Nodepool image manually. Broke over the week-end due to a hhvm/libicu transition. Should get pip 8.1.x now [releng]
2016-05-20 §
20:30 <bd808> Killing https://integration.wikimedia.org/ci/job/mediawiki-extensions-qunit/43608/ which has been running for 5 hours [releng]
2016-05-19 §
16:47 <thcipriani> deployment-tin jenkins worker seems to be back online after [https://www.mediawiki.org/wiki/Continuous_integration/Jenkins#Hung_beta_code.2Fdb_update some prodding] [releng]
16:41 <thcipriani> beta-code-update eqiad hung for past few hours [releng]
15:16 <hashar> Restarted zuul-merger daemons on both gallium and scandium : file descriptors leaked [releng]
11:59 <hashar> CI: salt -v '*' cmd.run 'pip install --upgrade pip==8.1.2' [releng]
11:54 <hashar> Upgrading pip on CI slaves from 7.0.1 to 8.1.2 https://gerrit.wikimedia.org/r/#/c/289639/ [releng]
10:15 <hashar> puppet broken on deployment-tin : ?[1;31mError: Could not retrieve catalog from remote server: Error 400 on SERVER: Invalid parameter trusted_group on node deployment-tin.deployment-prep.eqiad.wmflabs?[0m [releng]
2016-05-18 §
13:16 <Amir1> deploying a05e830 to ores nodes (sca01 and ores-web) [releng]
12:46 <urandom> (re)cherry-picking c/284078 to deployment-prep [releng]
11:36 <hashar> Restarted qa-morebots [releng]
11:36 <hashar> Marked mediawiki/core/vendor repository has hidden in Gerrit. It got moved to mediawiki/vendor including the whole history Settings page: https://gerrit.wikimedia.org/r/#/admin/projects/mediawiki/core/vendor [releng]
11:29 <hashar> Marked mediawiki/core/vendor repository has hidden in Gerrit. It got moved to mediawiki/vendor including the whole history Settings page: https://gerrit.wikimedia.org/r/#/admin/projects/mediawiki/core/vendor [releng]
2016-05-17 §
16:01 <twentyafterfour> branching wmf/1.28.0-wmf.2 [releng]
15:01 <hashar> beta: salt -v '*' cmd.run 'groupdel mwdeploy' [releng]
01:01 <thcipriani> nodepool CI was down, slowly recovering [releng]
2016-05-13 §
14:39 <thcipriani> remove shadow l10nupdate user from deployment-tin and mira in beta [releng]
10:20 <hashar> Put integration-slave-trusty-1004 offline. Ssh/passwd is borked T135217 [releng]
09:59 <hashar> Deleting non nodepool mediawiki PHPUnit jobs for T135001 (mediawiki-phpunit-hhvm mediawiki-phpunit-parsertests-hhvm mediawiki-phpunit-parsertests-php55 mediawiki-phpunit-php55) [releng]
04:06 <thcipriani|afk> changed ownership of mwdeploy public keys post shadow mwdeploy user removal is important [releng]
03:47 <thcipriani|afk> ldap failure has created a shadow mwdeploy user on beta, deleted using vipw [releng]