9801-9850 of 10000 results (36ms)
2010-10-20 §
18:10 <mark> Punched hole in loudon firewall for squid stats from streber [production]
17:46 <Ryan_Lane> setting svn.wikimedia.org to 60 seconds ttl in dns [production]
17:25 <mark> Added loudon to torrus (CDN/Squid) [production]
17:24 <tfinc> synchronized php-1.5/wmf-config/CommonSettings.php 'taking outage on payments server' [production]
2010-10-19 §
21:36 <tfinc> synchronized php-1.5/wmf-config/CommonSettings.php 'Adding new Appeal pages' [production]
20:52 <Ryan_Lane> restarting varnish on all bits [production]
17:12 <JeLuF> uninstalled broken php5-xdebug package on srv181 [production]
15:23 <catrope> synchronized php-1.5/wmf-config/CommonSettings.php [production]
15:22 <catrope> synchronized php-1.5/extensions/CentralNotice/SpecialBannerController.php [production]
15:08 <JeLuF> killed old convert jobs on srv100 [production]
14:17 <JeLuF> stopped job runner on srv 258-289, checking impact on ext stores [production]
10:59 <JeLuF> added srv258-289 as job runners. We now have 69 active job runners [production]
10:34 <JeLuF> added srv181-190 as job runners. We now have 38 active job runners [production]
06:44 <tfinc> synchronized php-1.5/wmf-config/InitialiseSettings.php 'Turning central notice off for closed advisory wki' [production]
2010-10-18 §
20:10 <Ryan_Lane> adding ldap management scripts to formey via puppet class ldap::client::sdk [production]
15:44 <JeLuF> Set default charset for http://noc.wikimedia.org/conf/ to utf-8 [production]
14:52 <JeLuF> killed stuck runJobs.php tasks on srv{150-170} [production]
14:36 <jeluf> synchronized php-1.5/wmf-config/db.php 'removed db28 from s5' [production]
14:32 <jeluf> synchronized php-1.5/wmf-config/db.php 'removed db13 from s2' [production]
13:44 <RoanKattouw> Removed trailing ?> from mc.php, InitialiseSettings.php, lucene.php, wgConf.php, secure.php, checkers.php [production]
06:44 <jeluf> synchronized php-1.5/wmf-config/InitialiseSettings.php '25557 - Index namespace on Telugu Wikisource' [production]
06:41 <jeluf> synchronized php-1.5/wmf-config/InitialiseSettings.php '25554 - Change the "upload file" link on jawiki' [production]
2010-10-17 §
22:06 <apergos> edited /etc/apache2/envvars in place and set APACHE_ULIMIT_MAX_FILES to 2000, hoping that will address the "too many open files" issue [production]
21:29 <hcatlin> mobile3 is having file limit issues. Turned off apache so that is de-pooled. Issue description sent to Ariel for RT submission. [production]
18:17 <mark> Restarted all varnish processes on sq67-70 [production]
18:10 <mark> authdns-scenario normal [production]
18:07 <apergos> stopped and restarted varnish on knsq1, 4... loads back to normal there now [production]
18:05 <mark> Powercycled sq69 [production]
18:00 <Ryan_Lane> restarting varnish on esams bits [production]
17:50 <JeLuF> Setting scenario to esams-down. [production]
17:47 <JeLuF> restarted varnish on knsq1, load average was 5149.87 [production]
15:39 <jeluf> ran sync-common-all 'Bug 25056 - Create new wiki for Persian Wikinews' [production]
15:15 <jeluf> ran sync-common-all 'Bug 25130 - Create Wikipedia in Komi-Permyak' [production]
14:42 <jeluf> ran sync-common-all 'Bug 25307 - Create Wikipedia in Banjar' [production]
14:03 <jeluf> ran sync-common-all 'Bug 25544 - Create a new Wikipedia in Hill Mari' [production]
12:59 <jeluf> synchronized php-1.5/wmf-config/InitialiseSettings.php '25345 - outreachwiki import sources' [production]
2010-10-16 §
16:44 <catrope> synchronized php-1.5/extensions/CodeReview/ui/CodeRevisionView.php 'r74785' [production]
16:43 <catrope> synchronized php-1.5/wmf-config/CommonSettings.php 'Bump style version appendix' [production]
16:42 <catrope> synchronized php-1.5/extensions/UsabilityInitiative/js/plugins.combined.min.js 'r74788' [production]
2010-10-15 §
20:30 <RoanKattouw> Ran a DB query to set status of 'new' pre-r50000 revs to 'old'. 8,327 revs affected [production]
00:50 <Ryan_Lane> add ldap::client::nss configuration to formey, so it can see ldap users [production]
00:48 <Ryan_Lane> add all mayflower users and keys to wmf ldap [production]
00:47 <Ryan_Lane> add sudo and openssh-lpk schema to nfs1 and nfs2 ldap servers [production]
2010-10-14 §
20:36 <Ryan_Lane> also added rkattouw to the engineering alias [production]
20:34 <Ryan_Lane> adding ^demon and myself to the engineering alias [production]
20:00 <Ryan_Lane> adding ldap::client::wmf-cluster include to formey in puppet. Adding openldap client as well. [production]
19:59 <Ryan_Lane> enabling opendj replication on nfs1 and nfs2 [production]
18:01 <hcatlin> mobiles are acting up. keep an eye on them! [production]
17:20 <mark> Fixed mobile by restarting apache on mobile2 [production]
17:15 <hcatlin> LVS is down for mobile... not sure why [production]