|
2012-07-26
§
|
| 16:15 |
<hashar> |
applying nfs::apache::labs on -dbdump to get /usr/local/apache from /data/project |
[releng] |
| 16:12 |
<hashar> |
-dbdump umounted deployment-nfs-memc:/mnt/export/apache on /usr/local/apache |
[releng] |
| 13:56 |
<hashar> |
archiving -nfs-memc:/mnt/export : root@deployment-nfs-memc:/mnt# mv export /data/project/deployment-nfs-memc_mnt-export_backup |
[releng] |
| 13:46 |
<hashar> |
seems to work fine with /data/project now. |
[releng] |
| 13:46 |
<hashar> |
rsync finished for both apache and upload6. Remounting and restarting apaches |
[releng] |
| 13:35 |
<hashar> |
rsync from nfs-memc:/mnt/export/upload6 to /data/project/upload6 completed. YEAHHH |
[releng] |
| 13:32 |
<hashar> |
on -dbdump, unmounted /mnt/upload (from nfs-memc). Please use the /mnt/upload6 -> /data/project/upload6 |
[releng] |
| 13:29 |
<hashar> |
root@deployment-nfs-memc:/mnt/export# rsync -a --progress --delete --inplace /mnt/export/apache /data/project |
[releng] |
| 13:22 |
<hashar> |
applying nfs::upload::labs to -dbdump so it uses /data/project/upload6 at /mnt/upload6 |
[releng] |
| 13:15 |
<hashar> |
manually umount /mnt/upload6 on apaches |
[releng] |
| 13:14 |
<hashar> |
stopping apache backends |
[releng] |
| 13:10 |
<hashar> |
Manually running puppet for {{gerrit|15545}} which should fix {{bug|38084}} uses /data/project instead of NFS instance |
[releng] |
| 09:35 |
<hashar> |
Regenerating captcha with the new shared key fixed {{bug|38699}} |
[releng] |
| 09:26 |
<hashar> |
Deleted all captchas in /mnt/upload6/private/captcha and regenerate them using 1000 and dirs=3 |
[releng] |
| 09:22 |
<hashar> |
Set $wmgCaptchaSecret in the local file common/wmf-config/PrivateSettings.php and used that value in captcha.py |
[releng] |
|
2012-07-25
§
|
| 17:00 |
<labs-logs-bottie> |
j: clear messages after updating localization(cache/l10n) to get new messages in TMH: php MWScript.php ../php/extensions/WikimediaMaintenance/clearMessageBlobs.php --wiki=aawiki |
[releng] |
| 14:43 |
<hashar> |
rebooting bits02 |
[releng] |
| 14:39 |
<hashar> |
dist-upgrade on cache-bits02, will reboot after that (bits.beta.wmflabs.org will be disabled while it reboot) |
[releng] |
| 14:24 |
<hashar> |
fixed puppet on cache-bits02 : ln -s /var/lib/git/operations/puppet/modules /etc/puppet/modules . That was an empty directory, thus prevented puppet to find the modules and made it breaking when trying to install ntp::client |
[releng] |
| 14:19 |
<hashar> |
root@deployment-cache-bits02:/var/lib/git/operations/puppet(git:13304/10)# git fetch anonymous refs/changes/04/13304/12 && git checkout -b 13304/12 FETCH_HEAD |
[releng] |
| 13:48 |
<hashar> |
rebooting apache33 so it can fsck /dev/vdb |
[releng] |
| 00:02 |
<labs-logs-bottie> |
j: run mwscript rebuildLocalisationCache.php --wiki=commonswiki --threads=2 |
[releng] |
|
2012-07-24
§
|
| 21:58 |
<labs-logs-bottie> |
j: run mwscript rebuildLocalisationCache.php --wiki=aawiki --threads=2 |
[releng] |
| 18:25 |
<hashar> |
Instances send their syslog again! To deployment-dbdump for now {{gerrit|14090}} |
[releng] |
| 15:42 |
<hashar> |
on deployment-integration, applied {{gerrit|15545}} patchset 7 to test out the symlinks from /data/project/upload6 to /mnt/upload6 . |
[releng] |
| 15:41 |
<hashar> |
on deployment-integration, applied {{gerrit|15545}} patchset 7 to te |
[releng] |
| 15:32 |
<hashar> |
rerunning rsync with --delete : root@deployment-nfs-memc:/mnt/export# rsync -a --progress --delete --inplace /mnt/export/upload6 /data/project |
[releng] |
| 15:26 |
<hashar> |
root@deployment-nfs-memc:/mnt/export# rsync -a --progress --inplace /mnt/export/upload6 /data/project |
[releng] |
| 15:00 |
<hashar> |
banned another /22 at squid level. |
[releng] |
| 14:45 |
<hashar> |
banned, at squid level, a crawler hosted on OVH. Just added the IP to squid.conf blacklist :) |
[releng] |
| 13:42 |
<hashar> |
Ran dist-upgrade on deployment-dbdump and rebooting. Will break udp2log loggers. |
[releng] |
| 13:40 |
<hashar> |
Rebooting all apaches |
[releng] |
| 13:35 |
<hashar> |
Running "apt-get dist-upgrade" on apache{32,33} to fix PHP5 using ubuntu packages instead of wmf packages. Upgrade kernel. |
[releng] |
|
2012-07-23
§
|
| 16:03 |
<hashar> |
hopefully half fixed the udp2log on deployment-dbdump . Need several changes in the puppet files though cause the udp2log-mw init script seems to conflict with the udp2log one :/ |
[releng] |
| 13:41 |
<hashar> |
rebooting -dbdump to make sure everything works fine :D |
[releng] |
| 13:40 |
<hashar> |
udp2log restored on beta!!! Still in /home/wikipedia/logs/ and logged by deployment-dbdump |
[releng] |
| 13:11 |
<hashar> |
applying role::logging::mediawiki to -dbdump (will bring log2udp) |
[releng] |
| 09:13 |
<hashar> |
updating MediaWiki extensions |
[releng] |
| 09:11 |
<hashar> |
updated mediawiki/core: Updating ef3132f..f8de6a7 |
[releng] |
| 09:10 |
<hashar> |
updating core + extensions to their lastest master versions |
[releng] |
| 09:09 |
<hashar> |
Updated mediawiki-config Updating 96ba09e..66ca8b0 |
[releng] |
|
2012-07-18
§
|
| 14:38 |
<hashar> |
New / rebooted instances are no more accessible : {{bug|38473}} - instances can not boot / reboot anymore |
[releng] |
| 13:46 |
<hashar> |
deleting upload01 (screwed somehow) |
[releng] |
| 13:46 |
<hashar> |
creating deployment-cache-upload03 to replace upload01 |
[releng] |
| 13:44 |
<hashar> |
deployment-cache-upload01 seems screwed : waiting for metadata service at http://169.254.169.254/2009-04-04/meta-data/instance-id . Failed DHCP acquisition ? => rebooting |
[releng] |
| 13:08 |
<hashar> |
deployment-cache-upload01 : running apt-get upgrade / dist-upgrade and rebooting |
[releng] |
| 10:22 |
<hashar> |
copying apache dir to /data/project . Run as root@deployment-nfs-memc in a screen session |
[releng] |
| 09:02 |
<hashar> |
adding nfs::apache::labs and nfs::upload::labs to deployment-integration |
[releng] |
| 08:59 |
<hashar> |
Applying {{gerrit|15545}} to deployment-integration |
[releng] |
| 08:26 |
<hashar> |
Created deployment-integration to be used as a puppetmaster::self host |
[releng] |