7101-7150 of 10000 results (30ms)
2010-06-29 §
17:54 <Rob> connected mr1-pmtpa port 0/1 to csw5 port 7/1 [production]
17:48 <Rob> and msw1-pmtpa:prt24 to msw-b2 (port unimportant) [production]
17:47 <Rob> new mgmt connections: mgmt-gateway: serial to scs-ca-pmtpa:port1; mgmt-gateway:0/0 to msw1-pmta:port23, msw1-pmtpa:mgmt to scs-c1-pmtpa port2 [production]
16:23 <Rob> dataset1 bad disk swapped and array shows rebuilding [production]
15:37 <Rob> srv89 resurrected and playing nicely with the other server kids [production]
15:15 <Rob> srv146 updated (puppet,sync-docroot,sync-apache), working, and back in lvs cluster [production]
15:09 <Rob> fixing srv146, removed from lvs until fixed [production]
08:19 <midom> synchronized php-1.5/wmf-config/CommonSettings.php [production]
08:14 <midom> synchronized php-1.5/includes/db/DatabaseMysql.php '68713 live' [production]
08:13 <midom> synchronized php-1.5/includes/DefaultSettings.php '68713 live' [production]
08:08 <midom> synchronized php-1.5/includes/GlobalFunctions.php 'removing msg profiling' [production]
06:00 <apergos> restarted morebots on wikitech [production]
2010-06-28 §
17:43 <Rob> ignore sq33 flapping, its disabled in lvs and I am working on it. [production]
16:43 <Fred> restarted apache on mobile1. Had locked up for some reason (probably too many threads). [production]
15:57 <aaron> synchronized php-1.5/extensions/FlaggedRevs/forms/RevisionReviewForm.php 'Deployed r68663' [production]
15:54 <aaron> synchronized php-1.5/extensions/FlaggedRevs/FlaggedRevs.class.php 'Deployed r68663' [production]
2010-06-27 §
08:12 <domas> locke locked up for no apparent reason :( [production]
2010-06-25 §
18:13 <Rob> srv104 disk failure, shutting it down (via ticket to the noc) [production]
15:01 <Rob> srv284 has E1410 System Fatal Error, will place ticket later today [production]
14:59 <Rob> db28 is borked, needs more replacement memory, reopened ticket, will remain offline for now. [production]
14:59 <Rob> fixed srv281 issues, needs reinstallation later today [production]
14:58 <Rob> tested db34, LOM is doa, calling in later today [production]
14:03 <catrope> synchronized php-1.5/wmf-config/InitialiseSettings.php 'Switch private wikis to Vector per Erik M' [production]
13:53 <Rob> ignore db28 flapping, working on it. [production]
09:43 <domas> updated password formats for wikiuser on s1 and s2 [production]
08:20 <midom> synchronized php-1.5/wmf-config/mc.php 'swapping out srv104, putting in srv242' [production]
07:38 <JeLuF> enabled PHP modules on fenari so that noc.wikimedia.org deliveres syntax highlighted config files. [production]
00:10 <andrew> synchronized php-1.5/extensions/AbuseFilter/SpecialAbuseLog.php [production]
2010-06-23 §
22:18 <andrew> synchronized php-1.5/extensions/StrategyWiki/ActiveStrategy/ActiveStrategy_body.php [production]
22:11 <andrew> synchronized php-1.5/extensions/StrategyWiki/ActiveStrategy/ActiveStrategy_body.php 'Finishing touch' [production]
21:58 <andrew> synchronized php-1.5/extensions/StrategyWiki/ActiveStrategy/ActiveStrategy_body.php 'Testing' [production]
21:49 <andrew> synchronized php-1.5/extensions/StrategyWiki/ActiveStrategy/ActiveStrategy_body.php 'Testing' [production]
21:42 <andrew> synchronized php-1.5/extensions/StrategyWiki/ActiveStrategy/ActiveStrategy_body.php 'Merge r68488' [production]
14:23 <domas> 'fixed' abusefilterlog performance issue with a livehack, hehehe: http://p.defau.lt/?55XRFbMETCGrQHRI5a5PDQ [production]
14:22 <midom> synchronized php-1.5/extensions/AbuseFilter/SpecialAbuseLog.php [production]
13:49 <domas> reduced db9 killing threshold from 30s to 10s :) [production]
2010-06-22 §
22:55 <tomaszf> switching cname of download. from storage2 to dataset1 [production]
14:47 <catrope> synchronized php-1.5/wmf-config/InitialiseSettings.php 'Reenable CollapsibleNav on officewiki per Guillaume' [production]
14:38 <catrope> synchronized php-1.5/wmf-config/CommonSettings.php 'Reenable EditWarning' [production]
14:35 <catrope> synchronized php-1.5/extensions/UsabilityInitiative/Vector/Modules/EditWarning/EditWarning.i18n.php 'r68406' [production]
14:32 <Tim> on mayflower: disabled sshd TCP forwarding [production]
14:03 <midom> synchronized php-1.5/wmf-config/CommonSettings.php 'disabled editwarning' [production]
14:03 <Tim> upgrading libtiff4 on all apaches due to USN-954-1 [production]
13:35 <midom> synchronized php-1.5/includes/GlobalFunctions.php 'msg profiling hook' [production]
13:17 <mark> (and domas) Restarted DNS on ns0 and ns2 [production]
10:21 <mark> Depreffed _1299_16265_43821_ route [production]
2010-06-21 §
18:56 <tomaszf> sync'ing public dir from storage2 to dataset1 [production]
18:29 <tomaszf> importing prod civi database onto dev [production]
12:36 <domas> so easy to earn a beer! [production]
12:32 <domas> powercycled pdf1, OOM [production]