651-700 of 2928 results (12ms)
2015-02-18 §
16:41 <bd808> beta-scap-eqiad job fixed after manually rebuilding git clones of scap/scap on rsync01 and videoscaler01 [releng]
16:39 <bd808> rebuilt corrupt deployment-videoscaler01:/srv/deployment/scap/scap [releng]
16:36 <bd808> rebuilt corrupt deployment-rsync01:/srv/deployment/scap/scap [releng]
16:26 <bd808> scap failures only from deployment-videoscaler01 and deployment-rsync01 [releng]
16:25 <bd808> scap failing with "ImportError: cannot import name cli" after latest update; investigating [releng]
16:23 <bd808> redis-cli srem 'deploy:scap/scap:minions' i-0000059b.eqiad.wmflabs i-000007f8.eqiad.wmflabs i-0000022e.eqiad.wmflabs i-0000044e.eqiad.wmflabs i-000004ba.eqiad.wmflabs [releng]
16:16 <bd808> 5 deleted instances in trebuchet redis cache for salt/salt repo [releng]
16:16 <bd808> updated scap to 7c64584 (Add universal argument to ignore ssh_auth_sock) [releng]
16:14 <bd808> scap clone on deployment-mediawiki02 corrupt; git fsck did not fix; will delete and refetch [releng]
13:04 <_joe_> installed new version of the hhvm extensions packages [releng]
01:41 <bd808> fixed git rebase conflict on deployment-salt caused by outdated cherry-pick; cherry-picks are merged now so reset to tracking origin/production [releng]
2015-02-17 §
23:18 <Krenair> Started mysql on deployment-db1; beta now appears much less broken than before [releng]
17:47 <hashar> beta cluster is mostly down because the instance supporting the main database (deployment-db1) is down. The root cause is an outage on the labs infra [releng]
03:43 <Krinkle> Depooled integration-slave1009 (Debugging T89180) [releng]
03:38 <Krinkle> Depooled integration-slave1009 [releng]
2015-02-14 §
00:55 <marxarelli> gzip'd /var/log/account/pacct.0 on deployment-bastion [releng]
00:02 <bd808> Stopped udp2log ans started udp2log-mw on deployment-bastion [releng]
2015-02-13 §
23:25 <bd808> cherry-picked https://gerrit.wikimedia.org/r/#/c/190231/ to deployment-salt for testing [releng]
14:03 <Krinkle> Jenkins UI stuck in Spanish. Resetting configuration. [releng]
13:05 <Krinkle> Reloading Zuul to deploy I0eaf2085576165b [releng]
2015-02-12 §
11:11 <hashar> changed passwords of selenium users. [releng]
10:41 <hashar> Removing MEDIAWIKI_PASSWORD* global env variables from Jenkins configuration {{bug|T89226}} [releng]
2015-02-11 §
19:39 <Krinkle> Jenkins UI is stuck in French. Resetting.. [releng]
17:56 <greg-g> hashar saved Jenkins global configuration at https://integration.wikimedia.org/ci/configure to hopefully reset the web interface default locale [releng]
09:57 <hashar> restarting Jenkins to upgrade the Credentials plugin [releng]
09:25 <hashar> bunch of puppet failure since 8:00am UTC. Seems to be DNS timeouts. [releng]
2015-02-10 §
09:18 <hashar> reenabling puppet-agent on deployment-salt . Was disabled with no reason nor sal entry. [releng]
06:32 <Krinkle> Fix lanthanum:/srv/ssd/jenkins-slave/workspace/mediawiki-extensions-zend@3/src/extensions/Flow/.git/config.lock [releng]
00:50 <bd808> Updated integration/slave-scripts to "Load extensions using wfLoadExtensions() if possible" (b532a9a) [releng]
2015-02-09 §
22:40 <Krinkle> Various mediawiki-extensions-zend builds are jammed half-way through phpunit execution (filed T89050) [releng]
21:31 <hashar> Deputized legoktm to the Gerrit 'integration' group. Brings +2 on integration/* repos. [releng]
20:38 <hashar> reconnected jenkins slave agents 1006 1007 and 1008 [releng]
20:37 <hashar> deleted /tmp on integration slaves 1006 1007 and 1008. Filled with npm temp directories [releng]
15:51 <hashar> integration : allowed ssh from gallium 208.80.154.135/32 to the instances [releng]
09:20 <hashar> starting puppet agent on integration-puppetmaster [releng]
2015-02-07 §
16:23 <hashar> puppet is broken on integration project for some reason. No clue what is going on :-( [releng]
16:19 <hashar> restarted puppetmaster on integration-puppetmaster.eqiad.wmflabs [releng]
00:42 <Krinkle> Jenkins is alerting for integration-slave1006, integration-slave1007 and integration-slave1008 having low /tmp space free (< 0.8GB) [releng]
2015-02-06 §
22:40 <Krinkle> Installed dsh on integration-dev [releng]
20:07 <^d> scratch that, I rebuilt it as precise. why did I do that? [releng]
20:03 <^d> rebuilt deployment-elastic05 with new partition scheme [releng]
05:46 <Krinkle> Reloading Zuul to deploy I096749565 and I405bea9d3e [releng]
01:35 <Krinkle> Upgraded all integration slaves to npm v2.4.1 [releng]
2015-02-05 §
13:11 <hasharAway> restarted Zuul server to clear out stalled jobs [releng]
12:48 <YuviPanda> cherry-picking https://gerrit.wikimedia.org/r/188798 on scap on deployment-prep [releng]
12:28 <YuviPanda> killed chown on deployment-bastion, running direclty on NFS server [releng]
12:25 <hashar> Upgrading puppet-lint from 0.3.2 to 1.1.0 on all repositories. All jobs are non voting beside mediawiki-vagrant-puppetlint-lenient which pass just fine with 1.1.0 [releng]
12:13 <YuviPanda> running time sudo chown -R www-data:www-data upload7/ on /data/project [releng]
12:10 <YuviPanda> stopped jobrunner on jobrunner01 [releng]
11:53 <YuviPanda> running git-sync-upstream on deployment-salt to pick up latest ops/puppet changes [releng]