|
2009-11-06
§
|
| 23:19 |
<mark> |
Replaced the Webrick puppetmaster setup on sockpuppet by an Apache/Mongrel setup with 4 children to deal with scalability problems |
[production] |
| 21:29 |
<mark> |
Increased active record DB connection pool size from 5 to 50... by just editing the ruby library file |
[production] |
| 18:54 |
<mark> |
db10 replication caught up with db9 |
[production] |
| 18:08 |
<mark> |
Set up puppet to run "apt-get update" on every run (for now, may make that somewhat less aggressive if needed) |
[production] |
| 17:10 |
<andrew> |
synchronized php-1.5/wmf-config/ExtensionMessages.php |
[production] |
| 17:08 |
<mark> |
Setup puppet to exchange all hostkeys between all servers |
[production] |
| 17:07 |
<andrew> |
synchronized php-1.5/includes/LinksUpdate.php |
[production] |
| 17:05 |
<Andrew> |
Scapping |
[production] |
| 17:05 |
<Andrew> |
Set up GlobalUsage on test.wikipedia.org |
[production] |
| 16:55 |
<mark> |
Set up puppet to upgrade itself everywhere |
[production] |
| 16:40 |
<mark> |
Fixed permission problem in the MySQL data dir, restarted replication on db10 |
[production] |
| 16:37 |
<mark> |
Fixed LVM problem on db10 |
[production] |
| 16:02 |
<mark> |
Rebooting db10: OOM errors |
[production] |
| 15:59 |
<mark> |
Replication db9->db10 broken again |
[production] |
| 15:56 |
<mark> |
Set up MySQL database 'puppet' on db9/db10 |
[production] |
|
2009-11-05
§
|
| 19:59 |
<tfinc> |
synchronized php-1.5/extensions/DonationInterface/donate_interface/donate_interface.i18n.php |
[production] |
| 19:51 |
<tfinc> |
synchronized php-1.5/extensions/DonationInterface/donate_interface/donate_interface.php |
[production] |
| 18:48 |
<mark> |
Setup puppet Stored Configurations with Stomp queuing; made a custom /usr/local/sbin/puppetqd since it was missing in the puppetmaster package. |
[production] |
| 17:58 |
<Rob> |
transcode1-3 drac setup, servers racked, not in racktables yet, no os yet. |
[production] |
| 17:42 |
<mark> |
Upgraded distribution of sockpuppet to 9.10 (Karmic) |
[production] |
| 17:35 |
<Rob> |
pushing dns changes for mgmt on transcode1-3 |
[production] |
| 16:54 |
<mark> |
Upgraded puppetmaster on sockpuppet to version 0.25.1 |
[production] |
| 15:35 |
<mark> |
Killed all Nagios processes on bart |
[production] |
| 15:28 |
<mark> |
synchronized php-1.5/wmf-config/InitialiseSettings.php 'Disabled InitialiseSettings.php again on all wikis, except testwiki. Pending HTTP proxy setup and security review.' |
[production] |
| 15:19 |
<mark> |
Moved secure.wikimedia.org service IP from bart to singer |
[production] |
| 15:13 |
<brion> |
synchronized php-1.5/wmf-config/InitialiseSettings.php 'enabling upload by URL for sysops on all wikis' |
[production] |
| 15:09 |
<mark> |
Moved NameVirtualHost entries to /etc/apache2/conf.d/namevirtualhost on singer, to stop Apache from complaining |
[production] |
| 15:06 |
<mark> |
Set up secure.wikimedia.org vhost on singer, SSL proxying to the apaches |
[production] |
| 14:49 |
<mark> |
synchronized php-1.5/wmf-config/CommonSettings.php 'Add singer to the SquidServers list' |
[production] |
|
2009-11-04
§
|
| 23:03 |
<tfinc> |
synchronized php-1.5/extensions/ContributionTracking/ContributionTracking_body.php |
[production] |
| 21:09 |
<mark> |
Stopped most services on khaldun, to prepare for decommissioning |
[production] |
| 21:06 |
<mark> |
Setup csw5-pmtpa to use brewster as dhcp ip helper |
[production] |
| 21:05 |
<mark> |
Stopped and deinstalled dhcp3-server on khaldun |
[production] |
| 21:04 |
<mark> |
Setup new dhcpd on brewster using puppet. Host entries are now factored out to files /etc/dhcp3/linux-host-entries* |
[production] |
| 18:48 |
<tfinc> |
synchronized php-1.5/wmf-config/CommonSettings.php 'Disabling paypal portion until contrib tracking works correctly' |
[production] |
| 18:46 |
<tfinc> |
synchronized php-1.5/extensions/DonationInterface/payflowpro_gateway/payflowpro_gateway.body.php |
[production] |
| 17:21 |
<RoanKattouw> |
Running cleanupTitles on frwikisource |
[production] |
| 14:50 |
<tfinc> |
synchronized php-1.5/extensions/DonationInterface/donate_interface/donate_interface.php |
[production] |
| 14:31 |
<tfinc> |
synchronized php-1.5/extensions/DonationInterface/payflowpro_gateway/payflowpro_gateway.php |
[production] |
| 13:54 |
<tfinc> |
synchronized php-1.5/extensions/DonationInterface/payflowpro_gateway/payflowpro_gateway.php |
[production] |
| 13:54 |
<RoanKattouw> |
Updating Special:BrokenRedirects, Special:DoubleRedirects and Special:OrphanedPages on frwikisource; community request related to mass cleanup |
[production] |
| 13:47 |
<tfinc> |
synchronized php-1.5/extensions/DonationInterface/paypal_gateway/paypal_gateway.php 'trying again as cluster didn't pickup change' |
[production] |
| 13:38 |
<tfinc> |
synchronized php-1.5/extensions/DonationInterface/paypal_gateway/paypal_gateway.php |
[production] |
| 13:38 |
<tfinc> |
synchronized php-1.5/extensions/DonationInterface/payflowpro_gateway/payflowpro_gateway.body.php |
[production] |
| 13:24 |
<RoanKattouw> |
tomaszf scapped |
[production] |