|
2011-08-31
§
|
| 19:48 |
<notpeter> |
restarting apache on srv155. |
[production] |
| 19:45 |
<Ryan_Lane> |
changing all cnames in wikimediafoundation.org to point to foundation-lb and changing the A record as well |
[production] |
| 19:38 |
<Ryan_Lane> |
changing cname of wikimediafoundation.org to point to foundation-lb address |
[production] |
| 19:26 |
<catrope> |
synchronizing Wikimedia installation... : Deploy HTTPS fixes |
[production] |
| 19:09 |
<catrope> |
synchronized wmf-config/InitialiseSettings.php 'Define wgCanonicalServer for all wikis, needed for upcoming deployment' |
[production] |
| 18:33 |
<LocalisationUpdate> |
failed |
[production] |
| 18:33 |
<RoanKattouw> |
Running LocalisationUpdate to hopefully fix Arabic message issue in UploadWizard |
[production] |
| 18:28 |
<catrope> |
synchronizing Wikimedia installation... : Deploy MoodBar update |
[production] |
| 18:25 |
<Ryan_Lane> |
adding new log collector on locke, running on port 8421, for aft clicktracking |
[production] |
| 18:24 |
<catrope> |
synchronized php/extensions/UploadWizard/UploadWizard.i18n.php 'touch' |
[production] |
| 17:58 |
<catrope> |
synchronized php/extensions/UploadWizard/UploadWizard.i18n.php '[[rev:95893|r95893]]' |
[production] |
| 17:48 |
<catrope> |
synchronizing Wikimedia installation... : Deploy WikimediaIncubator fixes |
[production] |
| 17:46 |
<binasher> |
started replicating db46 + db47 from db29 (s6 master) |
[production] |
| 17:31 |
<catrope> |
synchronizing Wikimedia installation... : Deploying UploadWizard bug fixes |
[production] |
| 17:18 |
<binasher> |
started replication on db44 + db45 from db23 (s5 master) |
[production] |
| 15:03 |
<mutante> |
db1025 apt-get --reinstall libmysql-common libmysqlclient16 - fixed the broken dpkg status |
[production] |
| 14:18 |
<mutante> |
db1025 - dist-upgrade/kernel, kill mysql,reboot.. |
[production] |
| 13:50 |
<mutante> |
sq35 - dist-upgrade/kernel,squid clean,showed I/O errors,but squid-backend runs now,RAID recovering |
[production] |
| 12:38 |
<mutante> |
sq64 - powercycle,dist-upgrade/kernel,squid clean,reboot |
[production] |
| 12:20 |
<mutante> |
sq35 - start squid backend but exits again soon after (Exiting due to repeated, frequent failures-> RT 1404 |
[production] |
| 12:10 |
<mutante> |
srv217 - restart apache ([apache2] <defunct>) |
[production] |
| 12:07 |
<reedy> |
synchronized wmf-config/InitialiseSettings.php '[[bugzilla:30491|bug 30491]]' |
[production] |
| 12:04 |
<mutante> |
srv266 - power cycle |
[production] |
| 02:19 |
<LocalisationUpdate> |
completed (1.17) at Wed Aug 31 02:21:24 UTC 2011 |
[production] |
|
2011-08-30
§
|
| 22:26 |
<Ryan_Lane> |
scratch that. instances in labs will need LDAP access as well |
[production] |
| 22:25 |
<Ryan_Lane> |
remove ldap from virt1, push new schema to svn ldap. point labs at svn ldap. |
[production] |
| 22:20 |
<binasher> |
imaged db44-db47 |
[production] |
| 22:12 |
<Ryan_Lane> |
imported svn ldap to labs ldap |
[production] |
| 21:09 |
<aaron> |
synchronized wmf-config/CommonSettings.php |
[production] |
| 21:06 |
<aaron> |
synchronized wmf-config/CommonSettings.php '[[bugzilla:30638|bug 30638]], set upload wizard policy page' |
[production] |
| 19:56 |
<hashar:> |
previous sync was for [[rev:2238|r2238]]: removing old commented out parts |
[production] |
| 19:55 |
<hashar> |
synchronized wmf-config/InitialiseSettings.php |
[production] |
| 19:18 |
<hashar> |
synchronized wmf-config/InitialiseSettings.php '30523 - Portal namespace for id.wikisource' |
[production] |
| 19:10 |
<hashar> |
synchronized wmf-config/InitialiseSettings.php '30594 - Change namespaces configuration - pl.wikipedia' |
[production] |
| 19:09 |
<hashar> |
synchronized wmf-config/InitialiseSettings.php '30594 - Change namespaces configuration - pl.wikipedia' |
[production] |
| 18:38 |
<Ryan_Lane> |
wiping the LDAP database on virt1, re-creating using same domain as svn LDAP. |
[production] |
| 18:26 |
<aaron> |
synchronizing Wikimedia installation... : |
[production] |
| 17:37 |
<aaron> |
synchronizing Wikimedia installation... : |
[production] |
| 17:34 |
<aaron> |
synchronizing Wikimedia installation... : |
[production] |
| 17:30 |
<aaron> |
synchronizing Wikimedia installation... : |
[production] |
| 17:21 |
<Ryan_Lane> |
removed duplicate ip in badbadip list in squid |
[production] |
| 16:31 |
<mutante> |
srv266 - power cycle |
[production] |
| 16:22 |
<mutante> |
amssq38 - power up,dist-upgrade/kernel,squid clean,reboot |
[production] |
| 12:31 |
<Tim> |
on db9 and db10, raised max_connect_errors from 10 to 1 billion so that it will stop blocking kaulen. These servers are not publically accessible, nobody can SYN flood them |
[production] |
| 12:25 |
<Tim> |
ran "flush hosts" on db9 to temporarily fix bugzilla connection error |
[production] |
| 09:22 |
<RoanKattouw> |
Reverted yesterday's changes on srv162 (disabled core dumps and suid_dumpable) |
[production] |
| 02:22 |
<LocalisationUpdate> |
completed (1.17) at Tue Aug 30 02:25:02 UTC 2011 |
[production] |
| 01:16 |
<binasher> |
upgrading varnish on mobile caching servers to 3.0.0-1wmf5 |
[production] |
| 00:19 |
<binasher> |
added new udplog-1.7 pkg to lucid-wikimedia repo, will be upgraded everywhere via puppet on next run |
[production] |