2011-01-03
§
|
23:00 |
<Ryan_Lane> |
adding rfaulk to storage3 |
[production] |
22:58 |
<Ryan_Lane> |
renaming samreed to reedy in admins.pp |
[production] |
22:51 |
<Ryan_Lane> |
adding demon to kaulen |
[production] |
22:51 |
<Ryan_Lane> |
giving robla access to modify-ldap-user, add-ldap-user, and delete-ldap-user on formey |
[production] |
18:19 |
<midom> |
synchronized php-1.5/wmf-config/db.php 'db15 going live' |
[production] |
17:44 |
<apergos> |
reboot snapshot1 for install of lucid |
[production] |
16:18 |
<robh> |
synchronized php-1.5/wmf-config/mc.php 'replacing srv266 since its down' |
[production] |
16:16 |
<RobH> |
rebooting srv266 |
[production] |
14:34 |
<mark> |
Site should be stable again |
[production] |
14:08 |
<mark> |
Depooled text squids again |
[production] |
13:59 |
<mark> |
Adding text.esams squids into the bits.esams LVS pool |
[production] |
13:43 |
<mark> |
Killed pybal on amslvs1 |
[production] |
13:34 |
<mark> |
Depooled knsq1 for installing debug symbols for oprofiling |
[production] |
10:55 |
<midom> |
synchronized php-1.5/wmf-config/mc.php |
[production] |
2010-12-30
§
|
23:36 |
<tomaszf> |
pushed r79304 to payments cluster .. updating tshirt images |
[production] |
22:40 |
<tomaszf> |
pushed r79297 to payments cluster .. adding wordmarks |
[production] |
20:36 |
<Ryan_Lane> |
powercycling mobile2 - it's dead |
[production] |
19:44 |
<apergos> |
add xml data fs to nfs in puppet, include that in snapshot hosts stanzas |
[production] |
19:43 |
<apergos> |
remove andrew from snapshot stanzas in puppet, he should already be convered by home-no-service |
[production] |
19:33 |
<awjr> |
pushed r79287 to payments cluster, replacing bad payflowpro_gateway.i18n.php with the good |
[production] |
19:05 |
<awjr> |
pushed r79282 of DonationInterface to payments cluster, updating credit card validation on cc form, picking up i18n changes and new css for premiums |
[production] |
18:49 |
<catrope> |
synchronized docroot/mediawiki/xml/export-0.4.xsd 'Update XSD file for XML dumps' |
[production] |
15:59 |
<RobH> |
all blogs updated successfully, all plugins updated and reactivated |
[production] |
15:48 |
<RobH> |
created backups of both blogs, pushing updates to new versions for security reasons |
[production] |
11:27 |
<catrope> |
synchronized php-1.5/wmf-config/CommonSettings.php 'Bump style version appendix' |
[production] |
11:25 |
<catrope> |
synchronized php-1.5/skins/common/shared.css 'r79244' |
[production] |
06:40 |
<Tim> |
fixed my VOIP account |
[production] |
2010-12-28
§
|
21:54 |
<Ryan_Lane> |
destroying 1TB logical volume on storage3 |
[production] |
21:54 |
<Ryan_Lane> |
umounting 1TB logical volume from /archive on storage3 and mounting 4TB xfs volume (data was moved prior to this) |
[production] |
19:09 |
<Ryan_Lane> |
moving archive data from /archive to /archive1 on storage3, will replace mount afterwards |
[production] |
19:08 |
<Ryan_Lane> |
creating new 4TB logical volume "archive1" on storage3, and putting an xfs filesystem on it |
[production] |
16:34 |
<mark> |
Defined special disk space check (with SMS notification) for mysql core databases |
[production] |
15:52 |
<midom> |
synchronized php-1.5/wmf-config/db.php 'adding db11, db18 and db39' |
[production] |
14:30 |
<midom> |
synchronized php-1.5/wmf-config/db.php 'enabling db37' |
[production] |
13:16 |
<domas> |
resumed replication on db11, db18, db37 and db39 |
[production] |
00:19 |
<Ryan_Lane> |
restarting apache on srv217 - puppet updated its apache2.conf file, but didn't restart it |
[production] |
00:12 |
<Ryan_Lane> |
powercycling amssq53 - it's dead |
[production] |
00:09 |
<Ryan_Lane> |
powercycling sq76 - it's dead |
[production] |
00:08 |
<Ryan_Lane> |
knsq14 isn't coming back up - may be broken |
[production] |
00:08 |
<Ryan_Lane> |
powercycling knsq24 - it's dead |
[production] |
00:02 |
<Ryan_Lane> |
powercycling knsq14 - it's dead |
[production] |