|
2011-06-28
§
|
| 17:36 |
<RobH> |
new install host carbon os installed, running puppet updates |
[production] |
| 17:11 |
<RobH> |
copied db41 sudoers file to db40 since it was overwritten by old raid utils package. now maybe the log spam will stop |
[production] |
| 15:20 |
<RoanKattouw> |
NTP has synced clock in prototype, it's got the correct time now |
[production] |
| 15:18 |
<RoanKattouw> |
Installed ntp on prototype, its clock was 10 minutes behind. It seems to be slowly catching up now |
[production] |
| 14:58 |
<midom> |
synchronized php-1.17/wmf-config/InitialiseSettings.php 'disabling while my eyes are on other stuff' |
[production] |
| 14:52 |
<RobH> |
stat1 racked and remote accessible. has public vlan setup, needs IP allocated and os installed. (also needs to be added to racktables) |
[production] |
| 13:59 |
<mark> |
Partly implemented European routing policy on AS14907 as well, and tuned a bit for routing southern routes via Tampa |
[production] |
| 13:27 |
<midom> |
synchronized php-1.17/wmf-config/InitialiseSettings.php |
[production] |
| 13:20 |
<midom> |
synchronized php-1.17/wmf-config/InitialiseSettings.php 'one more db40 testing round' |
[production] |
| 13:19 |
<midom> |
synchronized php-1.17/wmf-config/InitialiseSettings.php 'one more db40 testing round' |
[production] |
| 13:13 |
<midom> |
synchronized php-1.17/wmf-config/InitialiseSettings.php 'one more db40 testing round ended' |
[production] |
| 13:12 |
<midom> |
synchronized php-1.17/wmf-config/InitialiseSettings.php 'one more db40 testing round' |
[production] |
| 11:36 |
<kudu> |
testing |
[production] |
| 11:35 |
<Nemo_bis> |
!Wikipedia and other !Wikimedia sites problems at 6:15 and 9:30 UTC due to database overload fixed in 30 min, config now tweaked. |
[production] |
| 10:41 |
<mark> |
Set 'send-community' on the iBGP peer groups on csw1-sdtpa and csw5-pmtpa |
[production] |
| 10:41 |
<midom> |
synchronized php-1.17/wmf-config/InitialiseSettings.php |
[production] |
| 10:39 |
<domas> |
reenabled full mysql pcache, watching with half of my right eye |
[production] |
| 10:39 |
<midom> |
synchronized php-1.17/wmf-config/InitialiseSettings.php |
[production] |
| 10:38 |
<domas> |
reduced max_connections on db40 to 1000, enabled "connection recycling" (disconnects longest idling connections when max_connections gets reached), set wait_timeout=2 |
[production] |
| 10:30 |
<midom> |
synchronized php-1.17/wmf-config/InitialiseSettings.php 'adding enwiki to the mix' |
[production] |
| 10:23 |
<midom> |
synchronized php-1.17/wmf-config/InitialiseSettings.php 'enabling db-pcache on eswiki for transaction analysis' |
[production] |
| 09:52 |
<mark> |
synchronized php-1.17/wmf-config/InitialiseSettings.php 'Disable MySQL parser cache' |
[production] |
| 09:22 |
<mark> |
Activated BGP sessions to TiNet / AS3257 |
[production] |
| 06:49 |
<tstarling> |
synchronized php-1.17/wmf-config/InitialiseSettings.php 'enabled SubPageList3 on wikiversity' |
[production] |
| 06:45 |
<tstarling> |
synchronized php-1.17/extensions/SubPageList3/SubPageList3.php 'r90659, fix fatal error' |
[production] |
| 06:31 |
<tstarling> |
synchronized php-1.17/includes/objectcache/SqlBagOStuff.php 'r90942, proper fix' |
[production] |
| 06:21 |
<tstarling> |
synchronized php-1.17/wmf-config/InitialiseSettings.php 're-enabling MySQL parser cache' |
[production] |
| 06:20 |
<tstarling> |
synchronized php-1.17/includes/objectcache/SqlBagOStuff.php |
[production] |
| 06:16 |
<Tim> |
temporarily disabled db40 parser cache due to connection errors |
[production] |
| 06:16 |
<tstarling> |
synchronized php-1.17/wmf-config/InitialiseSettings.php |
[production] |
| 00:31 |
<tstarling> |
synchronized php-1.17/wmf-config/InitialiseSettings.php 'enabling MySQL parser cache on all wikis' |
[production] |
| 00:09 |
<tstarling> |
synchronized php-1.17/wmf-config/InitialiseSettings.php 'enabling MySQL parser cache on enwiki' |
[production] |
|
2011-06-27
§
|
| 23:22 |
<tstarling> |
synchronized php-1.17/wmf-config/CommonSettings.php 'no automatic purging' |
[production] |
| 23:15 |
<tstarling> |
synchronized php-1.17/wmf-config/InitialiseSettings.php 'enabling MySQL parser cache on en.wikiquote' |
[production] |
| 21:54 |
<Ryan_Lane> |
repooling sq69 |
[production] |
| 21:09 |
<RobH> |
grosley back online |
[production] |
| 21:00 |
<RobH> |
grosley reboot in process, disk checking. |
[production] |
| 20:57 |
<RobH> |
powercycling grosley |
[production] |
| 20:57 |
<RobH> |
grossley entirely unresponsive from serial console |
[production] |
| 20:51 |
<pdhanda> |
synchronized php-1.17/wmf-config/InitialiseSettings.php 'Bug 29603 - enabled abusefilter for iawiki. Bug 29279 - turned off Devanagari digits for hiwiki' |
[production] |
| 20:36 |
<pdhanda> |
ran sync-common-all 'Enabled abusefilter for iawiki. Bug 29603' |
[production] |
| 20:18 |
<RobH> |
allocated 11/41 on csw1-sdtpa to vlan101 for use by stat1 |
[production] |
| 19:32 |
<RobH> |
raised power warnign threshhold on phases on ps1-d1-sdtpa from 12 to 16 |
[production] |
| 18:13 |
<RobH> |
rebooting carbon for installation in eqiad. |
[production] |
| 18:06 |
<RobH> |
updating dns to have carbon mgmt dns info |
[production] |
| 17:42 |
<andrewS> |
47 r410 servers now await placement @ sdtpa |
[production] |
| 17:13 |
<andrewS> |
36 new dell servers sit outside sdtpa cage and await placement |
[production] |
| 16:40 |
<Ryan_Lane> |
depooling sq69 for continued work on XFF for geoiplookup |
[production] |
| 15:30 |
<JeLuF> |
increased puppet's timeout for "apt-get update" from 2 to 4 minutes. Regular apt-get update on storage1 takes more than 2 minutes |
[production] |
| 11:50 |
<mark> |
Changed ganglia / gmond configuration in puppet to use a different, associative hash structure |
[production] |