|
2011-10-16
§
|
| 20:59 |
<notpeter> |
something seems srsly messed up with nagios. restarting it again... |
[production] |
| 20:55 |
<notpeter> |
chmoded /etc/nagios/puppet_checks.d/ and restarted nagios |
[production] |
| 20:49 |
<mark> |
Made varnishhtcpd not run as root on cp104[34] |
[production] |
| 20:47 |
<notpeter> |
Restarted lsearchd on search7 |
[production] |
| 20:38 |
<mark> |
Accidently broke knsq6, will fix |
[production] |
| 19:41 |
<RoanKattouw> |
Removing all broken symlinks in common/docroot |
[production] |
| 19:22 |
<catrope> |
synchronized wmf-config/CommonSettings.php 'Remove action=parse hack' |
[production] |
| 18:42 |
<mutante> |
changed loglevel to ERROR in /usr/sbin/ganglia_parser |
[production] |
| 18:34 |
<mutante> |
killed ganglia_parser.log to save spence from running out of disk space |
[production] |
| 18:29 |
<mutante> |
knsq10,knsq11,knsq15,knsq16 - dist-upgrade/kernel,reboot |
[production] |
| 18:27 |
<RobH> |
nikerabbit now has shell deploy access via rt 1475 |
[production] |
| 17:29 |
<RobH> |
reviewed exim panic log on lily, williams, and mchenry for non zero size notifications. all errors were quite old (week or more) so they have been cleared out to stop the log spamming emails |
[production] |
| 16:12 |
<binasher> |
wally wally wally wally wally wally wally wally world |
[production] |
| 16:04 |
<tstarling> |
synchronized php-1.18/extensions/ExtensionDistributor/svn-invoker.conf |
[production] |
| 16:03 |
<Tim> |
fixed ExtensionDistributor |
[production] |
| 13:47 |
<mark> |
Restarted lsearchd on search7 |
[production] |
| 13:47 |
<mark> |
Restarted pdns on ns2 |
[production] |
| 02:19 |
<LocalisationUpdate> |
completed (1.18) at Sun Oct 16 02:22:10 UTC 2011 |
[production] |
|
2011-10-15
§
|
| 23:24 |
<mutante> |
knsq1,knsq2,knsq4 - dist-upgrade/kernel,reboot |
[production] |
| 23:20 |
<reedy> |
synchronized php-1.18/includes/specials/SpecialBrokenRedirects.php |
[production] |
| 22:41 |
<mutante> |
all amssq* servers upgraded now |
[production] |
| 21:58 |
<LeslieCarr> |
reloading apache2 on spence |
[production] |
| 21:54 |
<mutante> |
amssq50-amssq61 - dist-upgrade/kernel,reboot |
[production] |
| 21:50 |
<mutante> |
amssq62 - power up,dist-upgrade/kernel,squid clean,reboot.. |
[production] |
| 20:51 |
<mark> |
Stopped puppet on cp1043 and 1044 |
[production] |
| 20:48 |
<RobH> |
updating dns again, forgot to change the mgmt entries |
[production] |
| 20:42 |
<RobH> |
updating dns for cp3001/3002 per rt#1734 |
[production] |
| 20:37 |
<Tim> |
running refreshImageMetadata.php on all wikis, in screen on hume |
[production] |
| 19:35 |
<tstarling> |
synchronizing Wikimedia installation... : |
[production] |
| 19:00 |
<mutante> |
amssq42-amssq50 - dist-upgrade/kernel,reboot (still one at a time) |
[production] |
| 18:33 |
<reedy> |
synchronized wmf-config/CommonSettings.php 'Reverted live hack as tim fixed symlinks' |
[production] |
| 18:33 |
<tstarling> |
synchronizing Wikimedia installation... : |
[production] |
| 18:15 |
<tstarling> |
synchronizing Wikimedia installation... : |
[production] |
| 18:08 |
<reedy> |
synchronized wmf-config/CommonSettings.php 'Fix CategoryTree' |
[production] |
| 17:55 |
<reedy> |
synchronized php-1.18/extensions/CategoryTree/CategoryTree.css 'pushpush' |
[production] |
| 16:46 |
<Ryan_Lane> |
adding wmflabs domain in DNS |
[production] |
| 16:28 |
<mutante> |
amssq41,amssq42 - dist-upgrade/kernel,reboot |
[production] |
| 03:18 |
<catrope> |
synchronized wmf-config/InitialiseSettings.php 'Sitename for bdwikimedia' |
[production] |
| 02:54 |
<binasher> |
replaced the puppet manifests and vcl templates for mobile. now with more shiny! |
[production] |
| 02:39 |
<RobH> |
updated dns for magnesium.w.o |
[production] |
| 02:23 |
<reedy> |
ran sync-common-all 'Rest of bdwikimedia' |
[production] |
| 02:23 |
<LocalisationUpdate> |
completed (1.18) at Sat Oct 15 02:25:53 UTC 2011 |
[production] |
| 01:54 |
<reedy> |
ran sync-common-all |
[production] |
| 01:46 |
<RobH> |
updated dns for copper.w.o |
[production] |
| 01:40 |
<mutante> |
amssq35-amssq40 - dist-upgrade/kernel, reboot |
[production] |
| 01:39 |
<RobH> |
updating dns for some eqiad hosts |
[production] |
| 00:29 |
<mutante> |
amssq31-amssa35 - dist-upgraded/kernel, reboot |
[production] |
| 00:27 |
<catrope> |
synchronized wmf-config/CommonSettings.php 'Finish account creation throttle exemption for Asaf and uncomment it' |
[production] |
| 00:15 |
<catrope> |
synchronized wmf-config/CommonSettings.php 'Put in a commented-out account creation throttle exemption for a Botswana event' |
[production] |