|
2012-01-25
§
|
| 21:22 |
<binasher> |
bits caches: running varnish param.set thread_pool_min, thread_pool_max, where min = 15000 / cores / 4 and max = 15000 / cores |
[production] |
| 20:57 |
<binasher> |
running "varnishadm param.set thread_pool_max 1875" on mobile varnish servers |
[production] |
| 20:05 |
<Tim> |
on srv197: temporarily disabled puppet and enabled core dumps in apache2.conf for segfault flood investigation |
[production] |
| 19:57 |
<Jeff_Green> |
running dist-upgrade on payments* and silicon |
[production] |
| 19:44 |
<Tim> |
updating TrustedXFF host list using fenari |
[production] |
| 19:29 |
<RobH> |
dns update go! |
[production] |
| 18:50 |
<LeslieCarr> |
restarted varnish on niobium |
[production] |
| 18:49 |
<RoanKattouw> |
Restarted morebots |
[production] |
| 13:33 |
<demon> |
synchronized wmf-config/CommonSettings.php 'Change IP address for bnwiki account creation throttle per [[bugzilla:33900|bug 33900]]' |
[production] |
| 11:43 |
<apergos> |
formey oom (I guess), unresponsive from mgmt console, powercycling. |
[production] |
| 06:07 |
<pgehres> |
disabled queue consumption of payments in jenkins until stuck message can be removed from queue |
[production] |
| 05:49 |
<pgehres> |
Disabling the processing of recurring payments in CiviCRM until we can add the appropriate payment_method to the queue msgs |
[production] |
| 02:06 |
<LocalisationUpdate> |
completed (1.18) at Wed Jan 25 02:06:17 UTC 2012 |
[production] |
| 00:57 |
<binasher> |
streaming hotbackup of db53 to db32 |
[production] |
| 00:52 |
<binasher> |
shutting down mysql on db32, going to reconfigure with lvm and reslave |
[production] |
| 00:45 |
<asher> |
synchronized wmf-config/db.php 'pulling db32 - this will be the new enwiki pmtpa snapshot host' |
[production] |
| 00:30 |
<binasher> |
streaming hotbackup of db37 to db26, preparing to reprovision db26 in s7 |
[production] |
|
2012-01-24
§
|
| 23:30 |
<pgehres> |
testing |
[production] |
| 23:28 |
<awjr> |
Syncing prod CiviCRM on aluminium to [[rev:1209|r1209]] |
[production] |
| 22:39 |
<mark> |
Disabled quota support on sanger's IMAP server to make Dovecot work again |
[production] |
| 22:23 |
<mark> |
Sanger is upgraded to lucid |
[production] |
| 21:49 |
<RobH> |
ms-be1 is online! MAN WE ARE AWESOME |
[production] |
| 21:20 |
<mark> |
Starting dist-upgrade of sanger |
[production] |
| 20:50 |
<binasher> |
pulled db26, rebooting and re-imaging with lucid |
[production] |
| 20:48 |
<asher> |
synchronized wmf-config/db.php 'pulling db26 from s1 to reimage' |
[production] |
| 20:31 |
<cmjohnson1> |
restarting ms4 for memory testing |
[production] |
| 20:19 |
<notpeter> |
spinning up db54-58 for asher |
[production] |
| 20:09 |
<asher> |
synchronized wmf-config/db.php 're-weighting s6 dbs' |
[production] |
| 20:06 |
<asher> |
synchronized wmf-config/db.php 'adding db43 back to s6 at a low weight' |
[production] |
| 20:01 |
<asher> |
synchronized wmf-config/db.php 'raising db53 weight to 400' |
[production] |
| 19:37 |
<asher> |
synchronized wmf-config/db.php 'raising db53 weight to 200' |
[production] |
| 19:33 |
<asher> |
synchronized wmf-config/db.php 'adding db53 as an enwiki slave at 1/4 normal weight' |
[production] |
| 19:18 |
<tstarling> |
synchronized wmf-config/InitialiseSettings.php 'switched to Preprocessor_Hash on ocwiki only' |
[production] |
| 18:52 |
<LeslieCarr> |
moved cp1001-1040 to private vlan |
[production] |
| 18:52 |
<LeslieCarr> |
restarted morebots |
[production] |
| 02:05 |
<LocalisationUpdate> |
completed (1.18) at Tue Jan 24 02:05:48 UTC 2012 |
[production] |
| 01:55 |
<Ryan_Lane> |
fixed reverse dns for labs instances |
[production] |
| 01:32 |
<catrope> |
synchronized wmf-config/CommonSettings.php 'Add account creation throttle increase for [[bugzilla:33900|bug 33900]]' |
[production] |
| 01:07 |
<LeslieCarr> |
restarting dhcp3-server on brewster |
[production] |
| 00:54 |
<tstarling> |
synchronized wmf-config/InitialiseSettings.php 'new rsvg command line option' |
[production] |
| 00:54 |
<tstarling> |
synchronized wmf-config/CommonSettings.php |
[production] |
| 00:50 |
<Tim> |
upgraded rsvg on all mediawiki-installation servers, for some reason it is installed on all of them |
[production] |
| 00:23 |
<binasher> |
streaming a hotbackup of db1006 to db43 |
[production] |
| 00:19 |
<Tim> |
running apt-get upgrade on image scalers |
[production] |
| 00:18 |
<Tim> |
uploaded new rsvg to apt.wikimedia.org, deploying to image scalers |
[production] |