3001-3050 of 3402 results (11ms)
2012-05-30 §
19:09 <hashar> jobrunner05 CPU usage is due to some job infinite loop. Working on it. [releng]
18:35 <hashar> Sara made ganglia available on Ubuntu Precise and hence jobrunner05 show up http://ganglia.wmflabs.org/latest/?c=deployment-prep&h=deployment-jobrunner05&m=cpu_report&r=hour&s=by%20name&hc=4&mc=2 [releng]
14:54 <hashar> Updating mediawiki/core to 9780085 (aka just https://gerrit.wikimedia.org/r/#/c/9397/ which fix a wrong class name in job system) [releng]
14:39 <hashar> Migrating apaches from imagescaler class to imagescaler::labs [releng]
14:30 <beta-logmsgbot> hashar: migrating apache boxes from applicationserver::homeless to the new applicationserver::labs [releng]
09:17 <hashar> Restarted update.php in a screen session [releng]
09:15 <beta-logmsgbot> hashar: foreachwiki update.php --quiet --quick [releng]
08:54 <beta-logmsgbot> hashar: updating extensions [releng]
08:53 <beta-logmsgbot> hashar: HEAD is now at 8c65834 Add new message 'brackets' and use it to kill some hardcoded []s. [releng]
08:49 <beta-logmsgbot> hashar: updating core to 8c65834 [releng]
08:43 <hashar> {{bug|37199}} going to upgrade core / extensions to latest master [releng]
2012-05-29 §
21:17 <hashar> Fixed Amazon Elastic Cloud ban. Properly fixing {{bug|37173}} hopefully [releng]
20:41 <hashar> rebooting jobrunner05 following some package installs made earlier by puppet [releng]
20:39 <hashar> manually running puppet on jobrunner-05 [releng]
2012-05-26 §
18:14 <beta-logmsgbot> hashar: killed webtranscode job on commons [releng]
05:59 <beta-logmsgbot> hashar: Edited squid.conf to limit memory to 1G and restarted squid [releng]
05:42 <beta-logmsgbot> hashar: squid was killed by linux OOM! [releng]
2012-05-25 §
15:18 <beta-logmsgbot> hashar: deleted jobrunner06 (precise), we just need one precise instance which will be jobrunner05 for now [releng]
14:45 <beta-logmsgbot> hashar: installing applicationserver::homeless and applicationserver::jobrunner on jobrunner06 [releng]
14:42 <beta-logmsgbot> hashar: installing applicationserver::homeless and applicationserver::jobrunner on jobrunner05 [releng]
14:27 <beta-logmsgbot> hashar: installed jobrunner05 and 06 using Ubuntu precise. Should let get a 0.27 ffmpeg installation for {{bug|37043}} [releng]
08:38 <beta-logmsgbot> root: on dbdump, deleted /etc/logrotate.d/mw-udp2log . Most probably in conflict with the one from deployment-feed which host the udp2log process [releng]
08:35 <beta-logmsgbot> root: gzipped /home/wikipedia/logs/archive/*20120525 see {{bug|37012}} :-( [releng]
08:23 <beta-logmsgbot> hashar: killed stuck jobs on jobrunner 02 and 03. Restarted loop. [releng]
2012-05-24 §
11:52 <beta-logmsgbot> hashar: Rewrote log command to use dologmsg and the new beta-logmsgbot [releng]
11:51 <beta-logmsgbot> hashar: yeah I do log [releng]
11:47 <hashar> Moving /bin/log to /usr/local/bin/log [releng]
11:45 <labs-logs-bottie> hashar: installing php5-dev and running `pecl install parsekit` on deployment-dbdump [releng]
09:43 <labs-logs-bottie> hashar: installing php5-dev and running `pecl install parsekit` on deployment-dbdump [releng]
09:42 <labs-logs-bottie> hashar: installing php5-dev and running `pecl install parsekit` [releng]
07:05 <hashar> killed some stalled jobs on jobrunner02 [releng]
02:56 <labs-logs-bottie> jeremyb: foo [releng]
2012-05-23 §
19:54 <hashar> rebooting apache20 following installation of imagescaler puppet class [releng]
19:49 <hashar> rebooting apache23 following installation of imagescaler puppet class [releng]
19:46 <hashar> rebooting apache22 following installation of imagescaler puppet class [releng]
19:15 <hashar> rebooting apache21 following installation of imagescaler puppet class [releng]
18:48 <hashar> Adding puppet class 'imagescaler' on all deployment-apacheXX instances in an attempt to fix thumbnails [releng]
18:36 <labs-logs-bottie> hashar: relocalisation cache done 367/367 languages rebuilt [releng]
18:28 <labs-logs-bottie> hashar: running `mwscript rebuildLocalisationCache.php --wiki=aawiki` for {{bug|36806}} [releng]
16:22 <labs-logs-bottie> hashar: delete all 3 webVideoTranscode jobs from enwiki database [releng]
16:10 <hashar> rebooted jobrunner03 to check everything works fine there [releng]
15:41 <hashar> deleting jobrunner01, it is crashed beyond repair. Will create a new one named jobrunner03 [releng]
15:27 <hashar> rebooting jobrunner01 to see how it goes [releng]
14:56 <hashar> stopped job runner on jobrunner01, amounted /mnt/upload6 and /mnt/ [releng]
14:37 <hashar> running puppet on job runner to check change 8584 & 8585 worked [releng]
2012-05-22 §
13:49 <hashar> Deleting jobrunner03 and 04, not going to need them afterall [releng]
13:24 <hashar> deleting refreshLinks2 jobs from enwiki database [releng]
12:52 <hashar> deleting deployment-jobrunner{3,4} installation failed I got permission denied. Will recreate them using same hostname [releng]
11:55 <hashar> create two more job runner instances [releng]
10:09 <hashar> Remove deployment-webs instance which was meant to emulate the HTTPS access. Hacky and low priority for now, we will need to setup a nginx proxy one day to properly replicate the production infrastructure. [releng]