651-700 of 2663 results (11ms)
2014-11-25 §
21:05 <bd808> Running `sudo find . -type d ! -perm -o=w -exec chmod 0777 {} +` to fix upload permissions [releng]
18:01 <legoktm> cleared out renameuser_status table (old broken global merges) [releng]
18:00 <legoktm> 4086 rows deleted from localnames, 3929 from localuser [releng]
17:59 <legoktm> clearing out localnames/localuser where wikis don't exist on beta [releng]
17:10 <legoktm> ran migratePass0.php on all wikis [releng]
17:09 <legoktm> ran checkLocalUser.php --delete on all wikis [releng]
17:08 <legoktm> PHP Notice: Undefined index: wmgExtraLanguageNames in /mnt/srv/mediawiki/php-master/includes/SiteConfiguration.php on line 307 [releng]
17:07 <legoktm> ran checkLocalNames.php --delete on all wikis [releng]
04:37 <jgage> restarted jenkins at 20:31 [releng]
2014-11-24 §
17:24 <greg-g> stupid https [releng]
16:40 <bd808|deploy> My problem with en.wikipedia.beta.wmflabs.org was caused by a forceHTTPS cookie being set in my browser and redirecting to the broken https endpoint [releng]
16:33 <bd808|deploy> scap fixed by reverting bad config patch; still looking into failures from en.wikipedia.beta.wmflabs.org [releng]
16:27 <bd808> Looking at scap crash [releng]
15:18 <YuviPanda> restored local hacks + fixed 'em to account for 47dcefb74dd4faf8afb6880ec554c7e087aa947b on deployment-salt puppet repo, puppet failures recovering now [releng]
15:16 <YuviPanda> modified local hack to account for 47dcefb74dd4faf8afb6880ec554c7e087aa947b [releng]
14:58 <YuviPanda> cherry-picked 3e45c538978710113e6e28e9d533bf8d18c159a6 and 9d4614a8a352c78505212fd6e9d2a7be6d2e4927 to deployment-salt puppetmaster, restoring local hacks [releng]
2014-11-21 §
17:06 <bd808> deleted salt keys for deleted instances: i-00000289, i-0000028a, i-0000028b, i-0000028e, i-000002b7, i-000006ad [releng]
15:57 <hashar> fixed puppet cert on deployment-restbase01 [releng]
15:50 <hashar> deployment-sca01 regenerating puppet CA for deployment-sca01 [releng]
15:34 <hashar> Renerated puppet master certificate on deployment-salt. It needs to be named deployment-salt.eqiad.wmflabs not i-0000015c.eqiad.wmflabs. Puppet agent works on deployment-salt now. [releng]
15:19 <hashar> I have revoked the deployment-salt certificates. All puppet agent are thus broken! [releng]
15:01 <hashar> deployment-salt cleaning certs with puppet cert clean [releng]
14:52 <hashar> manually switching restbase01 puppet master from virt1000 to deployment-salt.eqiad.wmflabs [releng]
14:50 <hashar> deployment-restbase01 has some puppet error: Error 400 on SERVER: Must provide non empty value. on node i-00000727.eqiad.wmflabs . That is due to puppet pickle() function being given an empty variable [releng]
2014-11-20 §
15:25 <hashar> 15:01 Restarted Jenkins AND Zuul. Beta cluster jobs are still deadlocked. [releng]
13:21 <hashar> for integration, set puppet master report retention to 360 minutes ( https://wikitech.wikimedia.org/wiki/Hiera:Integration , see https://bugzilla.wikimedia.org/show_bug.cgi?id=73472#c14 ) [releng]
13:20 <hashar> rebased puppet master on integration project [releng]
13:20 <hashar> rebased puppet master [releng]
2014-11-19 §
21:27 <bd808> Ran `GIT_SSH=/var/lib/git/ssh git pull --rebase` in deployment-salt:/srv/var-lib/git/labs/private [releng]
21:19 <anomie> Cherry-picked https://gerrit.wikimedia.org/r/#/c/173336/3 to Beta [releng]
2014-11-18 §
15:32 <hashar> Deleting job https://integration.wikimedia.org/ci/job/mediawiki-vendor-integration/ replaced by mediawiki-phpunit. Clearing out workspaces {{bug|73515}} [releng]
2014-11-17 §
20:37 <YuviPanda> cleaned out logs on deployment-bastion [releng]
16:48 <YuviPanda> delete deployment-analytics01, a tortoise from an ancient time. [releng]
09:24 <YuviPanda> moved *old* /var/log/eventlogging into /home/yuvipanda so puppet can run without bitching [releng]
05:17 <YuviPanda> force apt-get install -f to unstuck puppet [releng]
04:57 <YuviPanda> cleaned up coredump on mediawiki02 on deployment-prep [releng]
04:49 <YuviPanda> clean up coredump on deployment-prep [releng]
2014-11-16 §
00:38 <YuviPanda> uncherrypick https://gerrit.wikimedia.org/r/#/c/173634/ because OMG CODE [releng]
00:14 <YuviPanda> cherry-pick https://gerrit.wikimedia.org/r/#/c/173634/ on deployment-salt [releng]
00:01 <YuviPanda> cherry-pick https://gerrit.wikimedia.org/r/#/c/173510/ on deployment-prep to make memc03 run puppet [releng]
2014-11-14 §
21:03 <marxarelli> loaded and re-saved jenkins configuration to get it back to english [releng]
20:02 <anomie> Cherry-picking https://gerrit.wikimedia.org/r/#/c/173336/ for testing in logstash [releng]
17:27 <bd808> /var full on deployment-mediawiki02. Adjusted ~bd808/cleanup-hhvm-cores for core found in /var/tmp/core rather than the expected /var/tmp/hhvm [releng]
11:14 <hashar> Recreated a labs Gerrit setup on integration-zuul-server . Available from http://integration.wmflabs.org/gerrit/ using OpenID for authentication. [releng]
2014-11-13 §
11:13 <hashar> apt-get upgrade / maintenance on all slaves [releng]
11:02 <hashar> bringing back integration-slave1008 to the pool. The label had a typo. https://integration.wikimedia.org/ci/computer/integration-slave1008/ [releng]
10:11 <YuviPanda> cherry pick https://gerrit.wikimedia.org/r/#/c/172967/1 to test https://bugzilla.wikimedia.org/show_bug.cgi?id=73263 [releng]
2014-11-12 §
21:03 <hashar> Restarted Jenkins due to a deadlock with deployment-bastion slave [releng]
18:16 <YuviPanda> cherry picking https://gerrit.wikimedia.org/r/#/c/172776/ on labs puppetmaster to see if it fixes issues in the cache machines [releng]
2014-11-11 §
17:13 <cscott> removed old ocg cronjobs on deployment-pdf0x; see https://bugzilla.wikimedia.org/show_bug.cgi?id=73166 [releng]