|
2010-10-20
§
|
| 21:54 |
<RobH> |
tired of misdated cron emails from dataset1, fixed the date again, it will go off date on its own eventually |
[production] |
| 21:52 |
<Ryan_Lane> |
restarting opendj on nfs1 |
[production] |
| 21:23 |
<Ryan_Lane> |
adding nis indexes on sanger, and restarting the ldap server |
[production] |
| 21:22 |
<Ryan_Lane> |
updating opendj on sanger |
[production] |
| 21:22 |
<Ryan_Lane> |
updating opendj on nfs1 |
[production] |
| 21:21 |
<Ryan_Lane> |
restarting the ldap servers one at a time |
[production] |
| 21:21 |
<Ryan_Lane> |
creating nis indexes in the ldap server on nfs1 and nfs2 |
[production] |
| 21:09 |
<Ryan_Lane> |
upgrading opendj on nfs2 |
[production] |
| 21:05 |
<Ryan_Lane> |
updating opendj package in repository to opendj_2.4.0-7 |
[production] |
| 20:40 |
<laner> |
synchronized php-1.5/wmf-config/InitialiseSettings.php 'Disabling local uploads for outreachwiki, and enabling subpages on namespace 0' |
[production] |
| 20:19 |
<jeluf> |
synchronized php-1.5/wmf-config/flaggedrevs.php 'Bug 24304 - Reconfigure English Wikibooks' |
[production] |
| 18:10 |
<mark> |
Punched hole in loudon firewall for squid stats from streber |
[production] |
| 17:46 |
<Ryan_Lane> |
setting svn.wikimedia.org to 60 seconds ttl in dns |
[production] |
| 17:25 |
<mark> |
Added loudon to torrus (CDN/Squid) |
[production] |
| 17:24 |
<tfinc> |
synchronized php-1.5/wmf-config/CommonSettings.php 'taking outage on payments server' |
[production] |
|
2010-10-19
§
|
| 21:36 |
<tfinc> |
synchronized php-1.5/wmf-config/CommonSettings.php 'Adding new Appeal pages' |
[production] |
| 20:52 |
<Ryan_Lane> |
restarting varnish on all bits |
[production] |
| 17:12 |
<JeLuF> |
uninstalled broken php5-xdebug package on srv181 |
[production] |
| 15:23 |
<catrope> |
synchronized php-1.5/wmf-config/CommonSettings.php |
[production] |
| 15:22 |
<catrope> |
synchronized php-1.5/extensions/CentralNotice/SpecialBannerController.php |
[production] |
| 15:08 |
<JeLuF> |
killed old convert jobs on srv100 |
[production] |
| 14:17 |
<JeLuF> |
stopped job runner on srv 258-289, checking impact on ext stores |
[production] |
| 10:59 |
<JeLuF> |
added srv258-289 as job runners. We now have 69 active job runners |
[production] |
| 10:34 |
<JeLuF> |
added srv181-190 as job runners. We now have 38 active job runners |
[production] |
| 06:44 |
<tfinc> |
synchronized php-1.5/wmf-config/InitialiseSettings.php 'Turning central notice off for closed advisory wki' |
[production] |
|
2010-10-18
§
|
| 20:10 |
<Ryan_Lane> |
adding ldap management scripts to formey via puppet class ldap::client::sdk |
[production] |
| 15:44 |
<JeLuF> |
Set default charset for http://noc.wikimedia.org/conf/ to utf-8 |
[production] |
| 14:52 |
<JeLuF> |
killed stuck runJobs.php tasks on srv{150-170} |
[production] |
| 14:36 |
<jeluf> |
synchronized php-1.5/wmf-config/db.php 'removed db28 from s5' |
[production] |
| 14:32 |
<jeluf> |
synchronized php-1.5/wmf-config/db.php 'removed db13 from s2' |
[production] |
| 13:44 |
<RoanKattouw> |
Removed trailing ?> from mc.php, InitialiseSettings.php, lucene.php, wgConf.php, secure.php, checkers.php |
[production] |
| 06:44 |
<jeluf> |
synchronized php-1.5/wmf-config/InitialiseSettings.php '25557 - Index namespace on Telugu Wikisource' |
[production] |
| 06:41 |
<jeluf> |
synchronized php-1.5/wmf-config/InitialiseSettings.php '25554 - Change the "upload file" link on jawiki' |
[production] |
|
2010-10-17
§
|
| 22:06 |
<apergos> |
edited /etc/apache2/envvars in place and set APACHE_ULIMIT_MAX_FILES to 2000, hoping that will address the "too many open files" issue |
[production] |
| 21:29 |
<hcatlin> |
mobile3 is having file limit issues. Turned off apache so that is de-pooled. Issue description sent to Ariel for RT submission. |
[production] |
| 18:17 |
<mark> |
Restarted all varnish processes on sq67-70 |
[production] |
| 18:10 |
<mark> |
authdns-scenario normal |
[production] |
| 18:07 |
<apergos> |
stopped and restarted varnish on knsq1, 4... loads back to normal there now |
[production] |
| 18:05 |
<mark> |
Powercycled sq69 |
[production] |
| 18:00 |
<Ryan_Lane> |
restarting varnish on esams bits |
[production] |
| 17:50 |
<JeLuF> |
Setting scenario to esams-down. |
[production] |
| 17:47 |
<JeLuF> |
restarted varnish on knsq1, load average was 5149.87 |
[production] |
| 15:39 |
<jeluf> |
ran sync-common-all 'Bug 25056 - Create new wiki for Persian Wikinews' |
[production] |
| 15:15 |
<jeluf> |
ran sync-common-all 'Bug 25130 - Create Wikipedia in Komi-Permyak' |
[production] |
| 14:42 |
<jeluf> |
ran sync-common-all 'Bug 25307 - Create Wikipedia in Banjar' |
[production] |
| 14:03 |
<jeluf> |
ran sync-common-all 'Bug 25544 - Create a new Wikipedia in Hill Mari' |
[production] |
| 12:59 |
<jeluf> |
synchronized php-1.5/wmf-config/InitialiseSettings.php '25345 - outreachwiki import sources' |
[production] |