101-150 of 2973 results (4ms)
2009-07-16 §
21:09 <brion> ran sync-common-all [production]
21:08 <brion> attempting to replace the old php-1.5 dir with wmf-deployment symlink [production]
21:02 <brion> synchronized wmf-deployment/wmf-config/InitialiseSettings.php 'I think touching the new master InitialiseSettings will fix it' [production]
21:01 <brion> synchronized wmf-deployment/includes/GlobalFunctions.php 'mkdir error trackdown hack' [production]
20:54 <brion> synchronized wmf-deployment/wmf-config/missing.php [production]
20:52 <brion> synchronized wmf-deployment/wmf-config/CommonSettings.php [production]
20:52 <brion> synchronized wmf-deployment/wmf-config/reporting-setup.php [production]
20:48 <brion> switching all sites to wmf-deployment branch [production]
20:48 <brion> synchronized live-1.5/MWVersion.php [production]
19:06 <Tim> copying ExtensionDistributor stuff to ms4:/export/ext-dist, from root screen on ms1 [production]
19:01 <brion> Now running test.wikipedia.org, www.mediawiki.org, and meta.wikimedia.org on new deployment checkout [production]
19:01 <brion> synchronized live-1.5/MWVersion.php [production]
18:58 <brion> ran sync-common-all [production]
18:39 <Tim> restarted xinetd on zwinger [production]
18:24 <tstarling> synchronized php-1.5/CommonSettings.php [production]
17:57 <brion> also restarted 186, 196 which had some funkiness in php err log [production]
17:56 <brion> srv186 also bad sudo [production]
17:55 <brion> srv171 has some borkage; sudo config is broken can't run apache-restart as user [production]
17:52 <brion> ran sync-common-all [production]
17:51 <brion> running updated sync-common-all friendly to non-NFS boxes [production]
17:49 <brion> swapped private SVN-managed /home/wikipedia/bin into place [production]
15:09 <apergos> removing the last of our snapshots on ms1 :-( getting us a little more space [production]
14:47 <apergos> disabled snapshots on ms1 in preparation for move of thumbnails to ms4 [production]
14:38 <brion> updated wikibugs-l list config to allow bugzilla-daemon@wikimedia.org to post [production]
14:34 <brion> restarted wikibugs bot [production]
14:27 <brion> ms1 performance seems to be sucking again [production]
14:17 <brion> synchronized php-1.5/InitialiseSettings.php 'adjusting throttle temporarily for outreach event' [production]
11:55 <RoanKattouw> ExtensionDistributor repeatedly reported broken in the past 48 hrs [production]
07:08 <Fred> traffic profile switched back to normal. Esams is back to normal. [production]
06:11 <hcatlin> Mobile1 has returned to normal function. [production]
05:58 <hcatlin> Error after restarting mobile1 stopped stats logging from working. Stats will be low for July 15th and higher for July 16th. Parsing of the 6 hour log file (about 1GB) might slow server for next few minutes until caught up. [production]
04:24 <Rob> outage for esams servers started at approx 3:20 gmt [production]
04:15 <Rob> still waiting on esams to update us about the rack(s), moving traffic to pmtpa [production]
00:59 <tomaszf> started backup for latest xml snapshots from storage2 to ms4 [production]
2009-07-15 §
22:30 <Rob> updated dns for new snapshot servers becasue tomasz did not want to be in charge of dump servers. [production]
22:10 <brion> brion checking around for 0-byte files (not thumbs) to see if we can recover [production]
21:33 <atglenn> verified that zfs patch is in place on ms4 (it got sucked in during river's update yesterday) [production]
21:26 <brion> synchronized php-1.5/CommonSettings.php 'Restore fancy captcha mode' [production]
21:16 <I_am_not_root> synchronized php-1.5/CommonSettings.php 're-enabling Uploads and removing site notice.' [production]
21:01 <atglenn> rebooting ms1 after applying zfs patch. *cross fingers* [production]
20:51 <brion> synchronized php-1.5/CommonSettings.php [production]
20:51 <brion> synchronized php-1.5/InitialiseSettings.php [production]
20:42 <brion> reenabled captcha in simple mode (no images; math q) [production]
20:37 <brion> captcha system broken while images are offline, need to disable it temporarily [production]
20:18 <brion> updated http://en.wikipedia.org/wiki/MediaWiki:Uploaddisabledtext & http://commons.wikimedia.org/wiki/MediaWiki:Uploaddisabledtext [production]
19:43 <fvassard> synchronized php-1.5/CommonSettings.php 'Disabling Uploads while ms1 gets fixed (again with an s after upload).' [production]
19:40 <fvassard> synchronized php-1.5/CommonSettings.php 'Disabling Uploads while ms1 gets fixed.' [production]
19:40 <atglenn> bringing solaris up to current patch level on ms1 [production]
19:34 <brion> Ok, we're going to temporarily shut off uploading and unmount the uploads dir while we muck about with ms1. [production]
19:14 <brion> dropping export/upload@daily-2009-07-11_03:10:00 [production]