3451-3500 of 10000 results (23ms)
2010-10-22 §
17:25 <RobH> at this time no issues are apparent and site access appears normal again. [production]
17:25 <RobH> Reported issues with accessing cluster hitting esams, possible network issues, further investigation shows no server errors. If network links continue to cause issues, we may redirect traffic stateside [production]
02:36 <apergos> shot some hung converts on the image scalers, that should hold us for awhile [production]
2010-10-21 §
21:10 <tfinc> synchronized php-1.5/wmf-config/CommonSettings.php 'Whitelisting new landing pages' [production]
20:37 <Ryan_Lane> adding account for jdavis on mchenry and sanger [production]
18:31 <mark> Powercycled sq67 and sq68 [production]
18:10 <mark> Unstuck srv219, 223, 224 [production]
18:05 <AaronSchulz> ran runBatchedQuery.php to finish enwiki rename 'Voice of All' => 'Aaron Schulz' on archive/revision tables [production]
17:58 <Ryan_Lane|food> enabled eth0 interface on test-payments, and changed the IP to the new IP [production]
17:56 <RobH> added dns entry for test-payments on prototype server [production]
16:47 <catrope> synchronized php-1.5/extensions/WikimediaMessages/WikimediaLicenseTexts.i18n.php 'r75158' [production]
15:26 <catrope> synchronized php-1.5/wmf-config/CommonSettings.php 'Bump style version appendix' [production]
15:14 <RoanKattouw> Commented out srv154 in /etc/dsh/groups/mediawiki-installation because it's down and blocking sync-file [production]
15:13 <catrope> synchronized php-1.5/extensions/UsabilityInitiative/WikiEditor/WikiEditor.combined.min.js 'r75156' [production]
01:02 <tfinc> synchronized php-1.5/wmf-config/CommonSettings.php 'Readding payments sidebar links after outage' [production]
2010-10-20 §
22:03 <mark> Removed squid.conf log line sending packets to yaseo [production]
21:54 <RobH> tired of misdated cron emails from dataset1, fixed the date again, it will go off date on its own eventually [production]
21:52 <Ryan_Lane> restarting opendj on nfs1 [production]
21:23 <Ryan_Lane> adding nis indexes on sanger, and restarting the ldap server [production]
21:22 <Ryan_Lane> updating opendj on sanger [production]
21:22 <Ryan_Lane> updating opendj on nfs1 [production]
21:21 <Ryan_Lane> restarting the ldap servers one at a time [production]
21:21 <Ryan_Lane> creating nis indexes in the ldap server on nfs1 and nfs2 [production]
21:09 <Ryan_Lane> upgrading opendj on nfs2 [production]
21:05 <Ryan_Lane> updating opendj package in repository to opendj_2.4.0-7 [production]
20:40 <laner> synchronized php-1.5/wmf-config/InitialiseSettings.php 'Disabling local uploads for outreachwiki, and enabling subpages on namespace 0' [production]
20:19 <jeluf> synchronized php-1.5/wmf-config/flaggedrevs.php 'Bug 24304 - Reconfigure English Wikibooks' [production]
18:10 <mark> Punched hole in loudon firewall for squid stats from streber [production]
17:46 <Ryan_Lane> setting svn.wikimedia.org to 60 seconds ttl in dns [production]
17:25 <mark> Added loudon to torrus (CDN/Squid) [production]
17:24 <tfinc> synchronized php-1.5/wmf-config/CommonSettings.php 'taking outage on payments server' [production]
2010-10-19 §
21:36 <tfinc> synchronized php-1.5/wmf-config/CommonSettings.php 'Adding new Appeal pages' [production]
20:52 <Ryan_Lane> restarting varnish on all bits [production]
17:12 <JeLuF> uninstalled broken php5-xdebug package on srv181 [production]
15:23 <catrope> synchronized php-1.5/wmf-config/CommonSettings.php [production]
15:22 <catrope> synchronized php-1.5/extensions/CentralNotice/SpecialBannerController.php [production]
15:08 <JeLuF> killed old convert jobs on srv100 [production]
14:17 <JeLuF> stopped job runner on srv 258-289, checking impact on ext stores [production]
10:59 <JeLuF> added srv258-289 as job runners. We now have 69 active job runners [production]
10:34 <JeLuF> added srv181-190 as job runners. We now have 38 active job runners [production]
06:44 <tfinc> synchronized php-1.5/wmf-config/InitialiseSettings.php 'Turning central notice off for closed advisory wki' [production]
2010-10-18 §
20:10 <Ryan_Lane> adding ldap management scripts to formey via puppet class ldap::client::sdk [production]
15:44 <JeLuF> Set default charset for http://noc.wikimedia.org/conf/ to utf-8 [production]
14:52 <JeLuF> killed stuck runJobs.php tasks on srv{150-170} [production]
14:36 <jeluf> synchronized php-1.5/wmf-config/db.php 'removed db28 from s5' [production]
14:32 <jeluf> synchronized php-1.5/wmf-config/db.php 'removed db13 from s2' [production]
13:44 <RoanKattouw> Removed trailing ?> from mc.php, InitialiseSettings.php, lucene.php, wgConf.php, secure.php, checkers.php [production]
06:44 <jeluf> synchronized php-1.5/wmf-config/InitialiseSettings.php '25557 - Index namespace on Telugu Wikisource' [production]
06:41 <jeluf> synchronized php-1.5/wmf-config/InitialiseSettings.php '25554 - Change the "upload file" link on jawiki' [production]
2010-10-17 §
22:06 <apergos> edited /etc/apache2/envvars in place and set APACHE_ULIMIT_MAX_FILES to 2000, hoping that will address the "too many open files" issue [production]