6751-6800 of 10000 results (35ms)
2016-02-16 §
23:22 <yuvipanda> new instances on deployment-prep no longer get NFS because of https://wikitech.wikimedia.org/w/index.php?title=Hiera%3ADeployment-prep&type=revision&diff=311783&oldid=311781 [releng]
23:18 <hashar> jenkins@gallium find /var/lib/jenkins/config-history/nodes -maxdepth 1 -type d -name 'ci-jessie*' -exec rm -vfR {} \; [releng]
23:17 <hashar> Jenkins accepting slave creations again. Root cause is /var/lib/jenkins/config-history/nodes/ has reached the 32k inode limit. [releng]
23:14 <hashar> Jenkins: Could not create rootDir /var/lib/jenkins/config-history/nodes/ci-jessie-wikimedia-34969/2016-02-16_22-40-23 [releng]
23:02 <hashar> Nodepool can not authenticate with Jenkins anymore. Thus it can not add slaves it spawned. [releng]
22:56 <hashar> contint: Nodepool instances pool exhausted [releng]
21:14 <andrewbogott> deployment-logstash2 migration finished [releng]
20:49 <jzerebecki> reloading zuul for 3bf7584..67fec7b [releng]
19:58 <andrewbogott> migrating deployment-logstash2 to labvirt1010 [releng]
19:00 <hashar> tin: checking out mw 1.27.0-wmf.14 [releng]
15:23 <hashar> integration-make-wmfbranch : /mnt/make-wmf-branch mount now has gid=wikidev and group setuid (i.e. mode 2775) [releng]
15:20 <hashar> integration-make-wmfbranch : change tmpfs to /mnt/make-wmf-branch (from /var/make-wmf-branch ) [releng]
11:30 <jzerebecki> T117710 integration-saltmaster:~# salt -v '*slave-trusty*' cmd.run 'rm -rf /mnt/jenkins-workspace/workspace/mwext-testextension-hhvm-composer/src/skins/BlueSky' [releng]
09:52 <hashar> will cut the wmf branches this afternoon starting around 14:00 CET [releng]
2016-02-15 §
16:28 <jzerebecki> reloading zuul for 2d16ad3..3bb0afa [releng]
16:10 <hashar> Image ci-jessie-wikimedia-1455552377 in wmflabs-eqiad is ready [releng]
15:25 <jzerebecki> reloading zuul for e174335..2d16ad3 [releng]
15:23 <hashar> Image ci-jessie-wikimedia-1455549539 in wmflabs-eqiad is ready [releng]
15:19 <hashar> Regenerating Nodepool snapshot. Slave scripts have 0 bytes... [releng]
15:04 <hashar> Slave scripts added to Nodepool instances! Image ci-jessie-wikimedia-1455548346 in wmflabs-eqiad is ready [releng]
11:05 <hashar> Image ci-jessie-wikimedia-1455534001 in wmflabs-eqiad is ready [releng]
10:57 <hashar> bumped Nodepool disk image to fix apt configuration / include jre and package-config. Refreshing snapshot image. Poke T126246 T126230 T119143 [releng]
07:52 <legoktm> deploying https://gerrit.wikimedia.org/r/270686 [releng]
06:52 <legoktm> legoktm@gallium:/srv/org/wikimedia/doc$ sudo -u jenkins-slave rm -rf EventLogging/ GuidedTour/ MultimediaViewer/ TemplateData/ [releng]
06:22 <legoktm> deploying https://gerrit.wikimedia.org/r/270677 [releng]
06:12 <legoktm> deploying https://gerrit.wikimedia.org/r/270675 [releng]
06:02 <legoktm> deploying https://gerrit.wikimedia.org/r/270674 [releng]
05:56 <legoktm> deploying https://gerrit.wikimedia.org/r/270673 [releng]
05:32 <legoktm> deploying https://gerrit.wikimedia.org/r/270670 [releng]
04:05 <legoktm> deploying https://gerrit.wikimedia.org/r/270667 [releng]
03:26 <legoktm> deploying https://gerrit.wikimedia.org/r/270665 [releng]
02:56 <legoktm> deploying https://gerrit.wikimedia.org/r/270657 [releng]
2016-02-14 §
23:53 <legoktm> deploying https://gerrit.wikimedia.org/r/270656 [releng]
23:25 <legoktm> deploying https://gerrit.wikimedia.org/r/270654 [releng]
23:13 <legoktm> also deploying https://gerrit.wikimedia.org/r/#/c/265098/ [releng]
23:11 <legoktm> deploying https://gerrit.wikimedia.org/r/270651 [releng]
05:18 <bd808> tools.stashbot Testing after restart (T126419) [releng]
2016-02-13 §
06:42 <bd808> restarted nutcracker on deployment-mediawiki01 [releng]
06:32 <bd808> jobrunner on deployment-jobrunner01 enabled after reverting changes from T87928 that caused T126830 [releng]
05:51 <bd808> disabled jobrunner process on jobrunner01; queue full of jobs broken by T126830 [releng]
05:31 <bd808> trebuchet clone of /srv/jobrunner/jobrunner broken on jobrunner01; failing puppet runs [releng]
05:25 <bd808> jobrunner process on deployment-jobrunner01 badly broken; investigating [releng]
05:20 <bd808> Ran https://phabricator.wikimedia.org/P2273 on deployment-jobrunner01.deployment-prep.eqiad.wmflabs; freed ~500M; disk utilization still at 94% [releng]
2016-02-12 §
23:54 <hashar> beta cluster broken since 20:30 UTC https://logstash-beta.wmflabs.org/#/dashboard/elasticsearch/fatalmonitor havent looked [releng]
17:36 <hashar> salt -v '*slave-trusty*' cmd.run 'apt-get -y install texlive-generic-extra' # T126422 [releng]
17:32 <hashar> adding texlive-generic-extra on CI slaves by cherry picking https://gerrit.wikimedia.org/r/#/c/270322/ - T126422 [releng]
17:19 <hashar> get rid of integration-dev it is broken somehow [releng]
17:10 <hashar> Nodepool back at spawning instances. contintcloud has been migrated in wmflabs [releng]
16:51 <thcipriani> running sudo salt '*' -b '10%' deploy.fixurl to fix deployment-prep trebuchet urls [releng]
16:31 <hashar> bd808 added support for saltbot to update tasks automagically!!!! T108720 [releng]