|
2011-10-17
§
|
| 19:35 |
<jgreen> |
synchronized wmf-config/InitialiseSettings.php 'added settings for donatewiki' |
[production] |
| 19:33 |
<jgreen> |
synchronized wmf-config/InitialiseSettings.php |
[production] |
| 18:38 |
<apergos> |
tried increasing ulimit for open files from 8192 to 12288 for lsearch on search7, see /etc/init.d/lsearchd. (lots of "too many open files" in the logs) ... if this kills it please lower it again |
[production] |
| 18:08 |
<preilly> |
done pushing critical MF fixes |
[production] |
| 18:07 |
<preilly> |
synchronized php-1.18/extensions/MobileFrontend/views/layout/application.html.php 'critical update to mobile frontend' |
[production] |
| 18:01 |
<preilly> |
synchronized php-1.18/extensions/MobileFrontend/MobileFrontend.php 'critical update to mobile frontend' |
[production] |
| 17:51 |
<preilly> |
synchronized php-1.18/extensions/MobileFrontend/MobileFrontend.php 'critical update to mobile frontend' |
[production] |
| 17:49 |
<apergos> |
restarted lsearchd on search7 again |
[production] |
| 17:49 |
<preilly> |
push critical fix for MF |
[production] |
| 17:49 |
<preilly> |
synchronized php-1.18/extensions/MobileFrontend/views/layout/_search_webkit.html.php 'critical update to mobile frontend' |
[production] |
| 17:48 |
<preilly> |
synchronized php-1.18/extensions/MobileFrontend/MobileFrontend.php 'critical update to mobile frontend' |
[production] |
| 15:41 |
<mark> |
restarted lsearchd on search7 |
[production] |
| 05:32 |
<Tim> |
restarted lsearchd on search7 |
[production] |
| 02:22 |
<LocalisationUpdate> |
completed (1.18) at Mon Oct 17 02:25:29 UTC 2011 |
[production] |
|
2011-10-16
§
|
| 23:28 |
<mutante> |
knsq[17-28] - dist-upgraded/kernel,rebooted |
[production] |
| 22:58 |
<reedy> |
synchronizing Wikimedia installation... : Push all Chads merges |
[production] |
| 22:54 |
<mutante> |
restarted lsearchd (lucene) on search3 and 7 |
[production] |
| 22:32 |
<mark> |
Pooled cp3001 into the bits.esams pool |
[production] |
| 21:33 |
<RobH> |
pybal upload config changed to remove sq47 per rt1597 |
[production] |
| 20:59 |
<notpeter> |
something seems srsly messed up with nagios. restarting it again... |
[production] |
| 20:55 |
<notpeter> |
chmoded /etc/nagios/puppet_checks.d/ and restarted nagios |
[production] |
| 20:49 |
<mark> |
Made varnishhtcpd not run as root on cp104[34] |
[production] |
| 20:47 |
<notpeter> |
Restarted lsearchd on search7 |
[production] |
| 20:38 |
<mark> |
Accidently broke knsq6, will fix |
[production] |
| 19:41 |
<RoanKattouw> |
Removing all broken symlinks in common/docroot |
[production] |
| 19:22 |
<catrope> |
synchronized wmf-config/CommonSettings.php 'Remove action=parse hack' |
[production] |
| 18:42 |
<mutante> |
changed loglevel to ERROR in /usr/sbin/ganglia_parser |
[production] |
| 18:34 |
<mutante> |
killed ganglia_parser.log to save spence from running out of disk space |
[production] |
| 18:29 |
<mutante> |
knsq10,knsq11,knsq15,knsq16 - dist-upgrade/kernel,reboot |
[production] |
| 18:27 |
<RobH> |
nikerabbit now has shell deploy access via rt 1475 |
[production] |
| 17:29 |
<RobH> |
reviewed exim panic log on lily, williams, and mchenry for non zero size notifications. all errors were quite old (week or more) so they have been cleared out to stop the log spamming emails |
[production] |
| 16:12 |
<binasher> |
wally wally wally wally wally wally wally wally world |
[production] |
| 16:04 |
<tstarling> |
synchronized php-1.18/extensions/ExtensionDistributor/svn-invoker.conf |
[production] |
| 16:03 |
<Tim> |
fixed ExtensionDistributor |
[production] |
| 13:47 |
<mark> |
Restarted lsearchd on search7 |
[production] |
| 13:47 |
<mark> |
Restarted pdns on ns2 |
[production] |
| 02:19 |
<LocalisationUpdate> |
completed (1.18) at Sun Oct 16 02:22:10 UTC 2011 |
[production] |
|
2011-10-15
§
|
| 23:24 |
<mutante> |
knsq1,knsq2,knsq4 - dist-upgrade/kernel,reboot |
[production] |
| 23:20 |
<reedy> |
synchronized php-1.18/includes/specials/SpecialBrokenRedirects.php |
[production] |
| 22:41 |
<mutante> |
all amssq* servers upgraded now |
[production] |
| 21:58 |
<LeslieCarr> |
reloading apache2 on spence |
[production] |
| 21:54 |
<mutante> |
amssq50-amssq61 - dist-upgrade/kernel,reboot |
[production] |
| 21:50 |
<mutante> |
amssq62 - power up,dist-upgrade/kernel,squid clean,reboot.. |
[production] |
| 20:51 |
<mark> |
Stopped puppet on cp1043 and 1044 |
[production] |
| 20:48 |
<RobH> |
updating dns again, forgot to change the mgmt entries |
[production] |
| 20:42 |
<RobH> |
updating dns for cp3001/3002 per rt#1734 |
[production] |
| 20:37 |
<Tim> |
running refreshImageMetadata.php on all wikis, in screen on hume |
[production] |
| 19:35 |
<tstarling> |
synchronizing Wikimedia installation... : |
[production] |
| 19:00 |
<mutante> |
amssq42-amssq50 - dist-upgrade/kernel,reboot (still one at a time) |
[production] |
| 18:33 |
<reedy> |
synchronized wmf-config/CommonSettings.php 'Reverted live hack as tim fixed symlinks' |
[production] |