|
2011-08-06
§
|
| 15:25 |
<mutante> |
amssq41 - power back up after it went down, clean squid cache |
[production] |
| 13:07 |
<RobH> |
puppet run on spence is via screen on root user |
[production] |
| 13:05 |
<RobH> |
spence is running puppet to update with new nagios info that won't contain the facilities fasle reports. if it fails to work, ~/rob_puppet_services.cfg is on spence |
[production] |
| 13:03 |
<RobH> |
nagios is being regenerated, i hope this works! |
[production] |
| 12:23 |
<RobH> |
srv169 depooled, needs work and to be restored to service |
[production] |
| 12:10 |
<root> |
synchronized wmf-config/mc.php 'replacing srv169 in active mc role due to its constant flapping' |
[production] |
| 06:46 |
<RobH> |
emptied the /var/log/exim4/paniclog on project2, formey, lily, mchenry, sockpuppet, williams, srv196. All errors were quite old due to various network blips over time. |
[production] |
| 02:19 |
<LocalisationUpdate> |
completed at Sat Aug 6 02:21:34 UTC 2011 |
[production] |
| 01:49 |
<Reedy> |
srv169 seems to be flapping |
[production] |
| 01:48 |
<Reedy> |
Ganglia seems brokened "There was an error collecting ganglia data (127.0.0.1:8654): fsockopen error: Connection refused" |
[production] |
|
2011-08-05
§
|
| 23:50 |
<tfinc> |
removed knsq30 from LVS esams rotation |
[production] |
| 23:36 |
<Reedy> |
Even though Asher pulled knsq30 from rotation, it seems to be still serving users |
[production] |
| 21:39 |
<reedy> |
synchronized wmf-config/InitialiseSettings.php 'more whitespace' |
[production] |
| 21:33 |
<reedy> |
synchronized wmf-config/CommonSettings.php 'whitespace' |
[production] |
| 21:32 |
<^demon> |
fixed permissions on new hook scripts so they're executable |
[production] |
| 21:28 |
<^demon> |
deployed new svn pre-commit hook framework |
[production] |
| 21:01 |
<binasher> |
pulled knsq30 from all frontend squids |
[production] |
| 20:44 |
<root> |
synchronized wmf-config/db.php 'returning db18 to s7' |
[production] |
| 19:02 |
<apergos> |
power cycled dataset2, it was unresponsive to pings and form mgmt console |
[production] |
| 18:24 |
<binasher> |
squid frontend deploy - no mobile redirect for android 3 (tablets) |
[production] |
| 18:15 |
<Reedy> |
running namespaceDupes on plwikibooks |
[production] |
| 18:14 |
<reedy> |
synchronized wmf-config/InitialiseSettings.php '[[bugzilla:30164|bug 30164]] Change namespaces configuration - pl.wikibooks' |
[production] |
| 18:00 |
<reedy> |
synchronized wmf-config/abusefilter.php 'Tidy up some redundant userrights definitions' |
[production] |
| 17:56 |
<Reedy> |
That sync was also [[bugzilla:30207|bug 30207]] Enable AbuseFilter on Russian Wikinews |
[production] |
| 17:56 |
<reedy> |
synchronized wmf-config/InitialiseSettings.php |
[production] |
| 17:55 |
<reedy> |
synchronized wmf-config/abusefilter.php '[[bugzilla:30207|bug 30207]] Enable AbuseFilter on Russian Wikinews' |
[production] |
| 17:51 |
<reedy> |
synchronized wmf-config/abusefilter.php 'Remove old abusefilter-private rights entries' |
[production] |
| 17:48 |
<binasher> |
deploying squid frontend.conf (commented out nokia mobile acl until a jquery netfront browser compatibility issue is fixed) |
[production] |
| 17:02 |
<maplebed> |
dns templates in svn and changes to authdns-update tested successfully |
[production] |
| 15:34 |
<mark> |
Uncommented srv301 from mediawiki_installation node list; killed apache; reran puppet |
[production] |
| 15:21 |
<reedy> |
synchronized wmf-config/InitialiseSettings.php '[[bugzilla:30221|bug 30221]] Enable NewUserMessage on ladwiki' |
[production] |
| 15:19 |
<reedy> |
synchronized wmf-config/InitialiseSettings.php 'whitespace' |
[production] |
| 15:18 |
<reedy> |
synchronized wmf-config/CommonSettings.php 'whitespace' |
[production] |
| 15:10 |
<reedy> |
synchronized wmf-config/wgConf.php 'Remove initialise noop call' |
[production] |
| 15:04 |
<reedy> |
synchronized php-1.17/includes/SquidUpdate.php '[[rev:93971|r93971]] [[rev:93972|r93972]]' |
[production] |
| 14:24 |
<Reedy> |
Running svn up to get [[rev:93971|r93971]]/[[rev:93972|r93972]] on test |
[production] |
| 13:48 |
<reedy> |
synchronized wmf-config/InitialiseSettings.php 'Bug 30247 - Enable Botadmin user group on Hindi Wikipedia' |
[production] |
| 13:29 |
<Ryan_Lane> |
added timo alias in exim for krinkle |
[production] |
| 13:28 |
<Ryan_Lane> |
added timo alias in exim for krinkle |
[production] |
| 12:21 |
<preilly> |
updated the MobileFrontend extension on production |
[production] |
| 12:13 |
<preilly> |
synchronizing Wikimedia installation... Revision: 93960: |
[production] |
| 11:39 |
<laner> |
synchronized wmf-config/CommonSettings.php 'Setting HTTPS mode when using XFP' |
[production] |
| 10:06 |
<mark> |
Fixed memcached check on spence |
[production] |
| 09:47 |
<mark> |
srv301 didn't have the right (API) service IPs bound; manually ran dpkg-reconfigure wikimedia-lvs-realserver to fix this |
[production] |
| 04:10 |
<maplebed> |
wikimedia-task-dns-auth package upgraded on ns0 to put zone files in revision control. |
[production] |
| 02:38 |
<aaron> |
synchronized php/maintenance/addwiki.php 'deployed [[rev:93593|r93593]]' |
[production] |
| 02:31 |
<aaron> |
synchronized wmf-config/CommonSettings.php 'renamed versionNumber variables to have wmf prefix' |
[production] |
| 02:25 |
<LocalisationUpdate> |
completed at Fri Aug 5 02:27:52 UTC 2011 |
[production] |
| 00:59 |
<notpeter> |
knsq30 is seems to have some kind of hardware failure. stopping squid and squid frontend proc |
[production] |
| 00:48 |
<AaronSchulz> |
/home/wikipedia/bin version with a working repo again |
[production] |