2010-10-06
§
|
20:46 |
<Ryan_Lane> |
killing convert, apache2, and ulimit4.sh on srv219-224; restarting apache on them |
[production] |
20:26 |
<Ryan_Lane> |
applying memcached::disabled class to srv154, srv155, srv157, srv158, and srv170 |
[production] |
20:26 |
<Ryan_Lane> |
added new memcached::disabled class to puppet |
[production] |
20:04 |
<Ryan_Lane> |
restarted varnish on all bits servers to reset memory |
[production] |
18:12 |
<Ryan_Lane> |
rebuilding alsted for openstack |
[production] |
18:03 |
<Ryan_Lane> |
rebuilding ersch, trying openstack again |
[production] |
16:43 |
<mark> |
Moved irc.wikimedia.org CNAME from browne to ekrem |
[production] |
16:09 |
<mark> |
Setup modified ratbox ircd on server ekrem, and linked it to the ircd on browne |
[production] |
15:06 |
<Ryan_Lane> |
relabeled slot1 for Wikimedia-Daily tapes on tridge to fix backup errors |
[production] |
10:27 |
<midom> |
synchronized php-1.5/wmf-config/db.php |
[production] |
00:35 |
<midom> |
synchronized php-1.5/wmf-config/db.php |
[production] |
2010-10-05
§
|
23:19 |
<RobH> |
lvs1 moved to b1-sdtpa, no network only mgmt |
[production] |
23:15 |
<RobH> |
db16 isnt in cluster, no mysql start, db20 mysql isnt started |
[production] |
23:12 |
<RobH> |
mysql restarted db17 |
[production] |
23:12 |
<RobH> |
db16, db17, db20 in new rack locations. |
[production] |
21:44 |
<tfinc> |
synchronized php-1.5/extensions/CentralNotice/SpecialNoticeTemplate.php 'Picking up fixes for geo' |
[production] |
21:43 |
<tfinc> |
synchronized php-1.5/extensions/CentralNotice/CentralNotice.php 'Picking up fixes for geo' |
[production] |
21:42 |
<tfinc> |
synchronized php-1.5/extensions/CentralNotice/SpecialBannerListLoader.php 'Picking up fixes for geo' |
[production] |
21:41 |
<tfinc> |
synchronized php-1.5/extensions/CentralNotice/centralnotice.js 'Picking up fixes for geo' |
[production] |
21:40 |
<tfinc> |
synchronized php-1.5/extensions/CentralNotice/CentralNotice.db.php 'Picking up fixes for geo' |
[production] |
21:38 |
<RobH> |
db20 wants to go with db16/17, its shutting down too |
[production] |
21:34 |
<robh> |
synchronized php-1.5/wmf-config/db.php 'commenting out db17' |
[production] |
21:31 |
<RobH> |
db16 and db17 going offline to move |
[production] |
21:27 |
<tfinc> |
synchronized php-1.5/extensions/CentralNotice/CentralNotice.i18n.php 'Picking up fixes for geo' |
[production] |
21:08 |
<midom> |
synchronized php-1.5/wmf-config/db.php |
[production] |
21:01 |
<RobH> |
db11 was already moved, opps, rebooting. |
[production] |
20:50 |
<tfinc> |
synchronized php-1.5/skins/common/images/closewindow.png 'Picking up new close button image' |
[production] |
20:41 |
<RobH> |
db11 and db14 also moving |
[production] |
20:41 |
<robh> |
synchronized php-1.5/wmf-config/db.php 'once more with my actual changes' |
[production] |
20:39 |
<robh> |
synchronized php-1.5/wmf-config/db.php 'if this doesnt work its not my fault' |
[production] |
20:34 |
<RobH> |
moving db13 & db14, they are shutting down for a short duration |
[production] |
18:17 |
<RobH> |
db11 shutting down |
[production] |
18:05 |
<RobH> |
storage1 back online |
[production] |
17:35 |
<mark> |
Setup ports 3/35 to 3/44 for db11 to db20 respectively |
[production] |
17:31 |
<domas> |
s3 switched to db27-bin.001:79 |
[production] |
17:31 |
<midom> |
synchronized php-1.5/wmf-config/db.php |
[production] |
17:31 |
<midom> |
synchronized php-1.5/wmf-config/db.php |
[production] |
17:28 |
<RobH> |
moved dataset1 network connection, all good |
[production] |
16:32 |
<RobH> |
dataset on the brain, storage1/2 |
[production] |
16:32 |
<RobH> |
dataset1 shutting down for relocation into b1-sdtpa, dataset2 already offline, moving as well |
[production] |
16:15 |
<catrope> |
synchronized php-1.5/wmf-config/checkers.php 'Remove no-UA exemption for yongle' |
[production] |
16:14 |
<mark> |
Setup csw1-sdtpa:11/2 for amaranth |
[production] |
16:12 |
<mark> |
Setup csw1-sdtpa:11/1 for dataset1 |
[production] |