2451-2500 of 2928 results (13ms)
2012-07-03 §
19:15 <hashar> touched wmf-config/mwblocker.log [releng]
19:05 <hashar> no machine send their syslog anywhere, some change got lost during the merge. See https://gerrit.wikimedia.org/r/14090 [releng]
18:44 <hashar> Successfully deleted instance deployment-deb, but failed to remove deployment-deb DNS entry. ohno [releng]
09:56 <hashar> Asked reboot for deployment-transcoding through labsconsole [releng]
2012-07-02 §
20:50 <hashar> restarting squid to purge whole cache (yeah I know that is lame) [releng]
20:47 <hashar> Removed Hydriz from deployment-prep. Messed up the whole dblist files :-D Contact me! ;) [releng]
20:46 <hashar> set back robots.txt to disallow / [releng]
20:28 <hashar> deployed a hack in mw config using https://gerrit.wikimedia.org/r/#/c/13932/ . That is a simply git fetch, pending review. [releng]
19:47 <hashar> hacking to get files on bits.beta [releng]
10:19 <hashar> Easy fix for the leap second bug: /etc/init.d/ntp stop; date `date +"%m%d%H%M%C%y.%S"`; /etc/init.d/ntp start [releng]
10:06 <Hydriz> ukwiki was giving errors regarding flaggedrevs's flaggedpages table not existing. Fixed it by running mwscript update.php ukwiki. [releng]
07:50 <hashar> Gave access to the cluster to Hydriz [releng]
2012-07-01 §
17:43 <hashar> manually rebooted most servers [releng]
10:00 <hashar> rebooted apache31 due to leap second bug. Stopped mysql on apache30 which was using 100%CPU [releng]
06:59 <hashar> rebooting all boxes [releng]
2012-06-29 §
15:07 <hashar> Removing thumbnails that not have been access for the last 15 days : sudo find . -atime +15 -wholename '*/thumb/*' -exec rm {} \\; [releng]
15:02 <hashar> deleted .nfs** files in /mnt/export/upload6/ [releng]
08:58 <hashar> restarted jobrunner service (had a wrong path pointing to common-backup) [releng]
2012-06-28 §
16:07 <hashar> apache conf uses site.conf :-(((( need to puppetize that one day [releng]
15:47 <hashar> updating mediawiki-config to latest master [releng]
14:10 <hashar> running puppet on apache{30,31}. The /etc/sudoers conflict has been merged in :) [releng]
11:03 <hashar> migrated all wiki from php-trunk to php-master by editing wikiversions.dat. Refreshed wikiversions.cdb and renamed ExtensionMessages-trunk.php to ExtensionMessages-master.php [releng]
10:59 <hashar> set group write on deployment-nfs-memc:/mnt/export/apache/common-local would let us rewrite the wikiversions.cdb file [releng]
2012-06-27 §
10:40 <hashar> made deployment-mc to use 'memcached' puppet class. Now uses 2000MB apparently [releng]
10:25 <hashar> removed memcached from deployment-nfs-memc , it is running on deployment-mc nowadays. [releng]
10:21 <hashar> rebooting deployment-mc for kernel upgrade [releng]
10:07 <hashar> updating packages on deployment-cache-bits [releng]
09:42 <hashar> deleted deployment-thumbproxy instance. We are not going to replicate the production thumbnailing architecture [releng]
09:16 <hashar> -transcoding : dpkg --purge linux-image-2.6.32-37-virtual linux-image-2.6.32-318-ec2 linux-image-2.6.32-34-virtua [releng]
09:14 <hashar> upgrading deployment-transcoding [releng]
2012-06-26 §
20:16 <hashar> deleted deployment-syslog instance. It is of no use till we have a way to setup syslog server on labs {{bug|36748}} (syslog-ng conflict with rsyslog from base::??? puppet class) [releng]
20:13 <hashar> Removed misc::mediawiki-logger from deployment-feed. Was replaced by some new udp2log system I can't understand. So for now, -feed is locally hacked and does not rely on puppet anymore. [releng]
19:50 <hashar> deployment-feed removed wireshark then ran 'apt-get auto remove' , various X11 packages got removed. Now up to 262MB free. [releng]
19:46 <hashar> deployment-feed removed some old kernels apt-get remove --purge linux-image-2.6.32-318-ec2 linux-image-2.6.32-342-ec2 linux-image-2.6.32-38-virtual linux-image-2.6.32-34-virtual [releng]
19:39 <hashar> deployment-feed is now out of disk space :-( [releng]
19:17 <hashar> Removed role::cache::bits from deployment-cache-bits. Only work in production. [releng]
18:32 <hashar> Uninstalled the pecl PHP parsekit extension, manually installed php5-parsekit package instead {{bug|37076}} [releng]
11:06 <hashar> Files migrated. A copy of the old common is in /usr/local/apache/common-back [releng]
10:12 <hashar> migrating beta to use operations/mediawiki-config [releng]
08:29 <hashar> restarted several time the job runner on jobrunner05. It eventually started working again :-( [releng]
07:50 <hashar> restarted udp2log [releng]
07:48 <hashar> killing python demux on deployment-feed [releng]
2012-06-25 §
15:14 <hashar> Deleted InitialiseSettingsDeploy.php (no longer used). Replaced by InitialiseSettings-wmflabs.php [releng]
15:00 <hashar> updating Ubuntu on deployment-transcoding [releng]
2012-06-23 §
13:02 <labs-logs-bottie> petrb: deploying 37852 [releng]
2012-06-22 §
13:18 <labs-logs-bottie> petrb: updated /usr/local/apache/common/wmf-config/InitialiseSettingsDeploy.php to match the feed I just made :) [releng]
11:17 <hashar> Created /etc/wikimedia-realm file containing 'labs' on -dbdump, -apache30, -apache31 and -jobrunner05. Related puppet change is https://gerrit.wikimedia.org/r/#/c/12377/ [releng]
10:07 <hashar> {{bug|37116}} removed deployment-nfs-memc cronjob /var/fs which did some nasty recursing file changes. Has been disabled since May 25th anyway. [releng]
09:08 <hashar> Deleting hostname mobile.beta.wmflabs.org and releasing 208.80.153.244 [releng]
2012-06-21 §
15:36 <hashar> Closed {{bug|37217}} - thumbnail extraction for videos needs newer ffmpeg [releng]