|
2012-08-16
§
|
| 23:39 |
<Tim> |
on fluorine: chown'd log files and restarted udp2log to get new uid |
[production] |
| 23:39 |
<binasher> |
reslaved es1002 after conversion to innodb |
[production] |
| 23:31 |
<olivneh> |
synchronized php-1.20wmf9/extensions/E3Experiments/Experiments.hooks.php |
[production] |
| 23:26 |
<mutante> |
fix date/NTP on sq36 |
[production] |
| 23:14 |
<kaldari> |
Finished syncing Wikimedia installation... : |
[production] |
| 23:12 |
<mutante> |
killing nagios-wm. it stopped talking even though stuff gets written to --infile |
[production] |
| 22:51 |
<kaldari> |
Started syncing Wikimedia installation... : |
[production] |
| 22:25 |
<preilly> |
Finished syncing Wikimedia installation... : update mobile frontend |
[production] |
| 22:04 |
<preilly> |
Started syncing Wikimedia installation... : update mobile frontend |
[production] |
| 22:03 |
<notpeter> |
restarting puppet on nfs1/2 |
[production] |
| 21:54 |
<notpeter> |
restarting puppet on locke |
[production] |
| 21:51 |
<notpeter> |
restarting puppet on emery |
[production] |
| 21:39 |
<notpeter> |
restarting puppet on oxygen |
[production] |
| 21:37 |
<cmjohnson1> |
shutting ms-be6 down for hardware testing/replacing |
[production] |
| 21:27 |
<notpeter> |
stopping puppet on nfs2 and restarting both udp2log instances to switch user. will keep puppet off until I merge new init script into puppet |
[production] |
| 21:20 |
<notpeter> |
stopping puppet on nfs1 and restarting both udp2log instances to switch user. will keep puppet off until I merge new init script into puppet |
[production] |
| 21:12 |
<maplebed> |
ms-be6 down for bad disk repair |
[production] |
| 20:58 |
<Ryan_Lane> |
attempting to upgrade virt1000 to precise |
[production] |
| 20:47 |
<cmjohnson1> |
ms-be6 shutting down to replace 2 disks |
[production] |
| 20:38 |
<notpeter> |
stopping puppet on locke and restarting both udp2log instances to switch user. will keep puppet off until I merge new init script into puppet |
[production] |
| 20:12 |
<RobH> |
ms-be1004 is ready to be installed into service |
[production] |
| 19:57 |
<RobH> |
ms-be1004 down for ssd install |
[production] |
| 19:44 |
<notpeter> |
stopping puppet on emery and restarting both udp2log instances to switch user. will keep puppet off until I merge new init script into puppet |
[production] |
| 19:34 |
<aaron> |
synchronized wmf-config/filebackend.php 'Set $readFromSwiftShared = true;' |
[production] |
| 19:31 |
<aaron> |
synchronized wmf-config/filebackend.php |
[production] |
| 19:29 |
<notpeter> |
stopping puppet on oxygen and restarting both udp2log instances to switch user. will keep puppet off until I merge new init script into puppet |
[production] |
| 19:23 |
<aaron> |
synchronized wmf-config/filebackend.php |
[production] |
| 19:17 |
<binasher> |
running purgeParserCache.php again |
[production] |
| 19:05 |
<RobH> |
puppet restarted on brewster |
[production] |
| 18:58 |
<aaron> |
synchronized wmf-config/filebackend.php 'Fixed container mapping for shared repo' |
[production] |
| 18:28 |
<aaron> |
synchronized wmf-config/filebackend.php 'Use NFS for reads for shared-multiwrite' |
[production] |
| 18:14 |
<aaron> |
synchronized wmf-config/swift.php 'Disabled redundant thumb copy/purge hooks.' |
[production] |
| 18:01 |
<RobH> |
authdns-update for new es1005-1010 |
[production] |
| 17:59 |
<aaron> |
synchronized wmf-config/filebackend.php 'Make internal reads come from swift for all wikis' |
[production] |
| 17:50 |
<apergos> |
powercycled ms-be3 ... in theory |
[production] |
| 16:52 |
<cmjohnson1> |
shutting down mw18 and mw19 to replace DIMM |
[production] |
| 16:29 |
<ottomata> |
Stopping puppet on brewster again. Sigh. PARTMAAAAN! |
[production] |
| 16:22 |
<reedy> |
synchronized php-1.20wmf9/includes/QueryPage.php |
[production] |
| 16:07 |
<cmjohnson1> |
shutting down mw8 to replace bad DIMM |
[production] |
| 15:59 |
<ottomata> |
starting puppet on brewster. (Woo, partman looking better!) |
[production] |
| 14:15 |
<ottomata> |
stopping puppet on brewster to continue partman troubleshooting for analytics dells |
[production] |
| 13:26 |
<mark> |
Enabled and started SIS deduplication on home_pmtpa on nas1-a |
[production] |
| 12:05 |
<mark> |
Removed OSPF metric on xe-5/2/1.0 on cr2-eqiad, to move eqiad->pmtpa traffic to the lower latency link |
[production] |
| 11:27 |
<pp-pdf2> |
restarted all services |
[production] |