551-600 of 1035 results (6ms)
2012-07-11 §
08:01 <hashar> Despooling apaches 30 and 31, spooling apaches 32 and 33 [releng]
2012-07-10 §
19:22 <hashar> rebooting apache32 and apache33 (puppet run finished) [releng]
19:02 <hashar> running puppets -tv on apache32 and apache33. Should make them able to serve Apache traffic after reboot. [releng]
17:32 <hashar> creating apache32 and apache33 to replace the corrupted apache30 and apache31 instances [releng]
2012-07-05 §
12:15 <hashar> Did some documentation work on [[Deployment/Overview]] [releng]
11:20 <hashar> added a bunch of spamers in /home/wikipedia/common/wmf-config/mwblocker.log which would block them [releng]
2012-07-03 §
19:43 <hashar> {{bug|38118}} fixed http://deployment.wikimedia.beta.wmflabs.org/ (was missing the docroot, submitted to gerrit https://gerrit.wikimedia.org/r/14099 [releng]
19:15 <hashar> touched wmf-config/mwblocker.log [releng]
19:05 <hashar> no machine send their syslog anywhere, some change got lost during the merge. See https://gerrit.wikimedia.org/r/14090 [releng]
18:44 <hashar> Successfully deleted instance deployment-deb, but failed to remove deployment-deb DNS entry. ohno [releng]
09:56 <hashar> Asked reboot for deployment-transcoding through labsconsole [releng]
2012-07-02 §
20:50 <hashar> restarting squid to purge whole cache (yeah I know that is lame) [releng]
20:47 <hashar> Removed Hydriz from deployment-prep. Messed up the whole dblist files :-D Contact me! ;) [releng]
20:46 <hashar> set back robots.txt to disallow / [releng]
20:28 <hashar> deployed a hack in mw config using https://gerrit.wikimedia.org/r/#/c/13932/ . That is a simply git fetch, pending review. [releng]
19:47 <hashar> hacking to get files on bits.beta [releng]
10:19 <hashar> Easy fix for the leap second bug: /etc/init.d/ntp stop; date `date +"%m%d%H%M%C%y.%S"`; /etc/init.d/ntp start [releng]
10:06 <Hydriz> ukwiki was giving errors regarding flaggedrevs's flaggedpages table not existing. Fixed it by running mwscript update.php ukwiki. [releng]
07:50 <hashar> Gave access to the cluster to Hydriz [releng]
2012-07-01 §
17:43 <hashar> manually rebooted most servers [releng]
10:00 <hashar> rebooted apache31 due to leap second bug. Stopped mysql on apache30 which was using 100%CPU [releng]
06:59 <hashar> rebooting all boxes [releng]
2012-06-29 §
15:07 <hashar> Removing thumbnails that not have been access for the last 15 days : sudo find . -atime +15 -wholename '*/thumb/*' -exec rm {} \\; [releng]
15:02 <hashar> deleted .nfs** files in /mnt/export/upload6/ [releng]
08:58 <hashar> restarted jobrunner service (had a wrong path pointing to common-backup) [releng]
2012-06-28 §
16:07 <hashar> apache conf uses site.conf :-(((( need to puppetize that one day [releng]
15:47 <hashar> updating mediawiki-config to latest master [releng]
14:10 <hashar> running puppet on apache{30,31}. The /etc/sudoers conflict has been merged in :) [releng]
11:03 <hashar> migrated all wiki from php-trunk to php-master by editing wikiversions.dat. Refreshed wikiversions.cdb and renamed ExtensionMessages-trunk.php to ExtensionMessages-master.php [releng]
10:59 <hashar> set group write on deployment-nfs-memc:/mnt/export/apache/common-local would let us rewrite the wikiversions.cdb file [releng]
2012-06-27 §
10:40 <hashar> made deployment-mc to use 'memcached' puppet class. Now uses 2000MB apparently [releng]
10:25 <hashar> removed memcached from deployment-nfs-memc , it is running on deployment-mc nowadays. [releng]
10:21 <hashar> rebooting deployment-mc for kernel upgrade [releng]
10:07 <hashar> updating packages on deployment-cache-bits [releng]
09:42 <hashar> deleted deployment-thumbproxy instance. We are not going to replicate the production thumbnailing architecture [releng]
09:16 <hashar> -transcoding : dpkg --purge linux-image-2.6.32-37-virtual linux-image-2.6.32-318-ec2 linux-image-2.6.32-34-virtua [releng]
09:14 <hashar> upgrading deployment-transcoding [releng]
2012-06-26 §
20:16 <hashar> deleted deployment-syslog instance. It is of no use till we have a way to setup syslog server on labs {{bug|36748}} (syslog-ng conflict with rsyslog from base::??? puppet class) [releng]
20:13 <hashar> Removed misc::mediawiki-logger from deployment-feed. Was replaced by some new udp2log system I can't understand. So for now, -feed is locally hacked and does not rely on puppet anymore. [releng]
19:50 <hashar> deployment-feed removed wireshark then ran 'apt-get auto remove' , various X11 packages got removed. Now up to 262MB free. [releng]
19:46 <hashar> deployment-feed removed some old kernels apt-get remove --purge linux-image-2.6.32-318-ec2 linux-image-2.6.32-342-ec2 linux-image-2.6.32-38-virtual linux-image-2.6.32-34-virtual [releng]
19:39 <hashar> deployment-feed is now out of disk space :-( [releng]
19:17 <hashar> Removed role::cache::bits from deployment-cache-bits. Only work in production. [releng]
18:32 <hashar> Uninstalled the pecl PHP parsekit extension, manually installed php5-parsekit package instead {{bug|37076}} [releng]
11:06 <hashar> Files migrated. A copy of the old common is in /usr/local/apache/common-back [releng]
10:12 <hashar> migrating beta to use operations/mediawiki-config [releng]
08:29 <hashar> restarted several time the job runner on jobrunner05. It eventually started working again :-( [releng]
07:50 <hashar> restarted udp2log [releng]
07:48 <hashar> killing python demux on deployment-feed [releng]
2012-06-25 §
15:14 <hashar> Deleted InitialiseSettingsDeploy.php (no longer used). Replaced by InitialiseSettings-wmflabs.php [releng]