4651-4700 of 10000 results (33ms)
2012-08-16 ยง
23:39 <Tim> on fluorine: chown'd log files and restarted udp2log to get new uid [production]
23:39 <binasher> reslaved es1002 after conversion to innodb [production]
23:31 <olivneh> synchronized php-1.20wmf9/extensions/E3Experiments/Experiments.hooks.php [production]
23:26 <mutante> fix date/NTP on sq36 [production]
23:14 <kaldari> Finished syncing Wikimedia installation... : [production]
23:12 <mutante> killing nagios-wm. it stopped talking even though stuff gets written to --infile [production]
22:51 <kaldari> Started syncing Wikimedia installation... : [production]
22:25 <preilly> Finished syncing Wikimedia installation... : update mobile frontend [production]
22:04 <preilly> Started syncing Wikimedia installation... : update mobile frontend [production]
22:03 <notpeter> restarting puppet on nfs1/2 [production]
21:54 <notpeter> restarting puppet on locke [production]
21:51 <notpeter> restarting puppet on emery [production]
21:39 <notpeter> restarting puppet on oxygen [production]
21:37 <cmjohnson1> shutting ms-be6 down for hardware testing/replacing [production]
21:27 <notpeter> stopping puppet on nfs2 and restarting both udp2log instances to switch user. will keep puppet off until I merge new init script into puppet [production]
21:20 <notpeter> stopping puppet on nfs1 and restarting both udp2log instances to switch user. will keep puppet off until I merge new init script into puppet [production]
21:12 <maplebed> ms-be6 down for bad disk repair [production]
20:58 <Ryan_Lane> attempting to upgrade virt1000 to precise [production]
20:47 <cmjohnson1> ms-be6 shutting down to replace 2 disks [production]
20:38 <notpeter> stopping puppet on locke and restarting both udp2log instances to switch user. will keep puppet off until I merge new init script into puppet [production]
20:12 <RobH> ms-be1004 is ready to be installed into service [production]
19:57 <RobH> ms-be1004 down for ssd install [production]
19:44 <notpeter> stopping puppet on emery and restarting both udp2log instances to switch user. will keep puppet off until I merge new init script into puppet [production]
19:34 <aaron> synchronized wmf-config/filebackend.php 'Set $readFromSwiftShared = true;' [production]
19:31 <aaron> synchronized wmf-config/filebackend.php [production]
19:29 <notpeter> stopping puppet on oxygen and restarting both udp2log instances to switch user. will keep puppet off until I merge new init script into puppet [production]
19:23 <aaron> synchronized wmf-config/filebackend.php [production]
19:17 <binasher> running purgeParserCache.php again [production]
19:05 <RobH> puppet restarted on brewster [production]
18:58 <aaron> synchronized wmf-config/filebackend.php 'Fixed container mapping for shared repo' [production]
18:28 <aaron> synchronized wmf-config/filebackend.php 'Use NFS for reads for shared-multiwrite' [production]
18:14 <aaron> synchronized wmf-config/swift.php 'Disabled redundant thumb copy/purge hooks.' [production]
18:01 <RobH> authdns-update for new es1005-1010 [production]
17:59 <aaron> synchronized wmf-config/filebackend.php 'Make internal reads come from swift for all wikis' [production]
17:50 <apergos> powercycled ms-be3 ... in theory [production]
16:52 <cmjohnson1> shutting down mw18 and mw19 to replace DIMM [production]
16:29 <ottomata> Stopping puppet on brewster again. Sigh. PARTMAAAAN! [production]
16:22 <reedy> synchronized php-1.20wmf9/includes/QueryPage.php [production]
16:07 <cmjohnson1> shutting down mw8 to replace bad DIMM [production]
15:59 <ottomata> starting puppet on brewster. (Woo, partman looking better!) [production]
14:15 <ottomata> stopping puppet on brewster to continue partman troubleshooting for analytics dells [production]
13:26 <mark> Enabled and started SIS deduplication on home_pmtpa on nas1-a [production]
12:05 <mark> Removed OSPF metric on xe-5/2/1.0 on cr2-eqiad, to move eqiad->pmtpa traffic to the lower latency link [production]
11:27 <pp-pdf2> restarted all services [production]
11:27 <pp-pdf1> restarted all services [production]
11:27 <pp-pdf3> restarted all services [production]
11:26 <pp-pdf3> updated mwlib.epub to 0.14.1 [production]
11:26 <pp-pdf2> updated mwlib.epub to 0.14.1 [production]
11:25 <pp-pdf1> updated mwlib.epub to 0.14.1 [production]
10:50 <mark> Setup semi-sync snapmirror from nas1-a:home_pmtpa to nas1001-a:home_pmtpa [production]