|
2010-09-02
§
|
| 22:56 |
<Ryan_Lane> |
commented out skip_slave_start in the my.cnf on db10 |
[production] |
| 22:54 |
<Ryan_Lane> |
restarted db10 (specifically the mysql database) |
[production] |
| 22:54 |
<Ryan_Lane> |
restarted db10 |
[production] |
| 19:38 |
<tfinc> |
synchronized php-1.5/wmf-config/CommonSettings.php 'adding new thursday test banner to whitelist' |
[production] |
| 16:53 |
<RobH> |
reinstalling storage2 |
[production] |
| 16:09 |
<catrope> |
synchronized php-1.5/extensions/UsabilityInitiative/PrefSwitch/SpecialPrefSwitch.php 'Attempt to fix DB error' |
[production] |
| 16:06 |
<RobH> |
db16 is running VTS, DO NOT TOUCH THIS SERVER |
[production] |
| 15:51 |
<RobH> |
db34 unracked, going back for repair with Oracle Field Engineer. |
[production] |
| 15:02 |
<RobH> |
ignore errrors from db16, db28, db34. Today is sun server troubleshooting day. |
[production] |
| 14:58 |
<RobH> |
db28 is not in rotation, taking it down to continue hardware testing/repair |
[production] |
| 14:25 |
<RobH> |
srv206 back online and in cluster. |
[production] |
| 14:25 |
<robh> |
synchronized php-1.5/wmf-config/mc.php 'moved srv206 from down to spare' |
[production] |
| 13:49 |
<RobH> |
srv206 offline, looking into it. |
[production] |
|
2010-09-01
§
|
| 22:42 |
<mark> |
Shutdown zwinger |
[production] |
| 22:10 |
<catrope> |
synchronized php-1.5/extensions/UsabilityInitiative/PrefSwitch/SpecialPrefSwitch.php 'Fix fatal' |
[production] |
| 21:58 |
<Ryan_Lane> |
created article assessment wiki on prototype |
[production] |
| 21:31 |
<catrope> |
synchronized php-1.5/extensions/UsabilityInitiative/PrefSwitch/SpecialPrefSwitch.php 'Attempted fix for skin overwriting problem' |
[production] |
| 21:19 |
<catrope> |
synchronized php-1.5/extensions/UsabilityInitiative/PrefSwitch/SpecialPrefSwitch.php 'Attempted fix for DB issue' |
[production] |
| 20:56 |
<Ryan_Lane> |
removed unneeded files from /var/tmp on prototype to free up space |
[production] |
| 20:43 |
<Ryan_Lane> |
svn upped bugzilla/skins/custom/buglist.css and bugzilla/skins/custom/show_bug.css |
[production] |
| 20:42 |
<Ryan_Lane> |
added an older version of PatchReader to kaulen for bugzilla |
[production] |
| 20:37 |
<tfinc> |
synchronized php-1.5/extensions/CentralNotice/SpecialNoticeText.php 'Picking up changes from r72135' |
[production] |
| 20:37 |
<tfinc> |
synchronized php-1.5/extensions/CentralNotice/SpecialNoticeLocal.php 'Picking up changes from r72135' |
[production] |
| 20:36 |
<tfinc> |
synchronized php-1.5/extensions/CentralNotice/SpecialCentralNotice.php 'Picking up changes from r72135' |
[production] |
| 20:36 |
<tfinc> |
synchronized php-1.5/extensions/CentralNotice/rebuildLocalTemplates.php 'Picking up changes from r72135' |
[production] |
| 20:36 |
<tfinc> |
synchronized php-1.5/extensions/CentralNotice/rebuildTemplates.php 'Picking up changes from r72135' |
[production] |
| 20:35 |
<tfinc> |
synchronized php-1.5/extensions/CentralNotice/NoticePage.php 'Picking up changes from r72135' |
[production] |
| 19:07 |
<catrope> |
synchronized php-1.5/extensions/UsabilityInitiative/PrefSwitch/SpecialPrefSwitch.php 'Fix fatal in global opt-out' |
[production] |
| 18:56 |
<RoanKattouw> |
Switchover is all done, everyone 's free to touch stuff again as far as I'm concerned |
[production] |
| 18:55 |
<catrope> |
synchronized php-1.5/wmf-config/InitialiseSettings.php 'Vector switchover, thumb size change. enable global opt-out' |
[production] |
| 18:54 |
<catrope> |
synchronized php-1.5/wmf-config/CommonSettings.php 'Vector switchover, thumb size change. enable global opt-out' |
[production] |
| 18:54 |
<RoanKattouw> |
Deploying config for Vector switchover now |
[production] |
| 18:49 |
<RobH> |
all new api servers mgmt accessible, still need OS installation. |
[production] |
| 18:48 |
<RobH> |
pushing dns change, there was a typo in the zonefile for srv290 mgmt |
[production] |
| 18:37 |
<RoanKattouw> |
Put config update for Vector switch in wmf-config/ and synced do test. DO NOT SYNC THIS until I confirm it's working |
[production] |
| 18:24 |
<catrope> |
synchronized php-1.5/includes/UserRightsProxy.php 'r72132' |
[production] |
| 18:22 |
<catrope> |
synchronized php-1.5/extensions/UsabilityInitiative/PrefSwitch/SpecialPrefSwitch.php 'r72127' |
[production] |
| 18:21 |
<catrope> |
synchronized php-1.5/extensions/UsabilityInitiative/PrefSwitch/PrefSwitch.i18n.php 'r72127' |
[production] |
| 18:21 |
<catrope> |
synchronized php-1.5/extensions/UsabilityInitiative/PrefSwitch/PrefSwitch.php 'r72127' |
[production] |
| 18:20 |
<catrope> |
synchronized php-1.5/skins/Vector.php 'r72127' |
[production] |
| 18:20 |
<RoanKattouw> |
Deploying r72127 and r72132 with individual syncs |
[production] |
| 18:03 |
<RoanKattouw> |
Setting default skin to Vector on testwiki |
[production] |
| 17:53 |
<RoanKattouw> |
Testing r72127 on testwiki |
[production] |
| 17:46 |
<RobH> |
srv280-srv289 back online. all power balancing in b5-sdtpa complete. |
[production] |
| 17:22 |
<RobH> |
srv270-srv279 back online, srv280-srv289 is next (and the last batch) |
[production] |
| 17:06 |
<RobH> |
also taking down srv279 in last batch |
[production] |
| 17:03 |
<RobH> |
srv264-srv269 back online, now bringing down srv270-srv278 |
[production] |
| 16:50 |
<RobH> |
morebots needs better parsing to read my mind. |
[production] |
| 16:49 |
<RobH> |
srv258-srv263 back online. Now bringing down srv264-srv269 |
[production] |
| 16:31 |
<RobH> |
srv258-srv263 are being shutdown to have their power rebalanced within the rack. They will be back online shortly. |
[production] |