|
2012-03-14
§
|
| 08:24 |
<mutante> |
running "apt-get -f install" on snapshot3 to fix dpkg, which installed mysql-client- and client-core-5.1 |
[production] |
| 08:02 |
<mutante> |
stop/start memcached on srv254,srv255,srv257 |
[production] |
| 07:51 |
<mutante> |
restarting mecached on marmontel |
[production] |
| 07:51 |
<mutante> |
fixing owa[1-3] Swift HTTP commands manually |
[production] |
| 03:44 |
<mutante> |
ekrem - user agent "AppleDictionaryService" requests cause temp. WAP outage ..it seems |
[production] |
| 03:38 |
<mutante> |
free some disk space on spence - deleted user.log.1 on spence, compressing messages.1, apt-get clean,... |
[production] |
| 02:52 |
<RobH> |
cp1032-cp1035 reinstall issue wiped mbr causing issues, will reinstall in my AM |
[production] |
| 02:49 |
<RobH> |
revoked, cp1032 is some reason in grub error, and its too late at night for me to work on it, will troubleshoot tomorrow |
[production] |
| 02:48 |
<RobH> |
realized i forgot to log hours ago that cp1029-cp1036 are installed with puppet run, ready for varnish deployment tomorrow |
[production] |
| 02:17 |
<LocalisationUpdate> |
completed (1.19) at Wed Mar 14 02:17:13 UTC 2012 |
[production] |
|
2012-03-13
§
|
| 23:51 |
<mutante> |
upgrading bugzilla to 4.0.5 |
[production] |
| 23:42 |
<reedy> |
synchronized php-1.19/resources/jquery/jquery.textSelection.js '[[rev:113786|r113786]]' |
[production] |
| 23:14 |
<preilly> |
synchronized php-1.19/extensions/ZeroRatedMobileAccess/ZeroRatedMobileAccess.body.php 'changes for zero needed for carrier testing' |
[production] |
| 22:47 |
<awjrichards> |
synchronized php/extensions/MobileFrontend/templates/ApplicationTemplate.php '[[rev:113779|r113779]]' |
[production] |
| 22:44 |
<awjrichards> |
synchronized php/extensions/MobileFrontend/stylesheets/beta_common.css '[[rev:113774|r113774]]' |
[production] |
| 22:44 |
<awjrichards> |
synchronized php/extensions/MobileFrontend/stylesheets/common.css '[[rev:113774|r113774]]' |
[production] |
| 22:43 |
<awjrichards> |
synchronized php/extensions/MobileFrontend/templates/ApplicationTemplate.php '[[rev:113771|r113771]]' |
[production] |
| 22:42 |
<awjrichards> |
synchronized php/extensions/MobileFrontend/api/ApiQueryExcerpts.php '[[rev:113774|r113774]]' |
[production] |
| 22:27 |
<awjrichards> |
synchronized wmf-config/InitialiseSettings.php 'Removing moile URL template for tewtwiki' |
[production] |
| 21:44 |
<preilly> |
synchronized php-1.19/extensions/ZeroRatedMobileAccess/ZeroRatedMobileAccess.body.php 'changes for zero' |
[production] |
| 21:44 |
<preilly> |
synchronized php-1.19/extensions/ZeroRatedMobileAccess/ZeroRatedMobileAccess.i18n.php 'changes for zero' |
[production] |
| 21:31 |
<asher> |
synchronized wmf-config/db.php 'replacing db18 with new s7 slave db56' |
[production] |
| 21:19 |
<binasher> |
started slaving db56 from db37 |
[production] |
| 20:30 |
<preilly> |
synchronized php-1.19/extensions/ZeroRatedMobileAccess/ZeroRatedMobileAccess.i18n.php 'changes for zero' |
[production] |
| 19:27 |
<preilly> |
synchronized php-1.19/extensions/ZeroRatedMobileAccess/ZeroRatedMobileAccess.body.php 'changes for zero needed for carrier testing' |
[production] |
| 19:17 |
<RobH> |
iron updated to use ipmi_mgmt script |
[production] |
| 19:08 |
<preilly> |
pushing changes for zero to mswiki |
[production] |
| 19:08 |
<preilly> |
synchronized php-1.19/extensions/ZeroRatedMobileAccess/ZeroRatedMobileAccess.i18n.php 'changes for zero' |
[production] |
| 19:08 |
<preilly> |
synchronized php-1.19/extensions/ZeroRatedMobileAccess/ZeroRatedMobileAccess.body.php 'changes for zero' |
[production] |
| 19:05 |
<binasher> |
streaming hotbackup of db1041 to db56 (new s7 slave replacing db18) |
[production] |
| 18:10 |
<maplebed> |
failover successful, restarted pybal on lvs4, failback successful. |
[production] |
| 18:10 |
<binasher> |
power cycling db1020, which also froze this morning |
[production] |
| 18:08 |
<maplebed> |
stopping pybal on lvs4 - should fail over to lvs3 |
[production] |
| 17:47 |
<maplebed> |
pybal restarted on lvs3 |
[production] |
| 17:47 |
<binasher> |
power cycling db1040, crashed again |
[production] |
| 17:30 |
<reedy> |
synchronized wmf-config/CommonSettings.php 'Bug 35183 - p include extensions/Renameuser/Renameuser.php instead of extensions/Renameuser/SpecialRenameuser.php' |
[production] |
| 17:12 |
<mark> |
Sending all normally-pmtpa upload traffic to upload-lb.eqiad |
[production] |
| 17:05 |
<preilly> |
synchronized php-1.19/extensions/ZeroRatedMobileAccess/ZeroRatedMobileAccess.body.php 'changes for zero' |
[production] |
| 16:59 |
<preilly> |
add disable images support to mswiki under zero domain |
[production] |
| 16:59 |
<preilly> |
synchronized wmf-config/CommonSettings.php 'add disable images option for mswiki on zero domain' |
[production] |
| 16:59 |
<preilly> |
synchronized wmf-config/InitialiseSettings.php 'add disable images option for mswiki on zero domain' |
[production] |
| 16:46 |
<preilly> |
synchronized wmf-config/InitialiseSettings.php 'add ZeroRatedMobileAccess extension to mswiki remove from mywiki' |
[production] |
| 16:44 |
<mark> |
Sending traffic from Japan, India, Mexico to upload-lb.eqiad |
[production] |
| 16:37 |
<LeslieCarr> |
reinstalling neon |
[production] |
| 16:23 |
<apergos> |
stole some free space from the phys volume on ms1002 to give us more time for the rsync to keep going til after the move to swift etc |
[production] |
| 15:28 |
<mark> |
Sending traffic from the USA to upload-lb.eqiad |
[production] |
| 15:27 |
<mark> |
Rebooting lvs1005 with upgraded kernel/packages |
[production] |
| 15:12 |
<LeslieCarr> |
manually deleted cp1025 info from nagios config file - nagios restored for now |
[production] |
| 14:51 |
<mark> |
Sending traffic from Canada to upload-lb.eqiad |
[production] |
| 14:33 |
<mark> |
Sending traffic from Brazil to upload-lb.eqiad |
[production] |