|
2012-02-22
ยง
|
| 19:39 |
<LeslieCarr> |
blocking all new puppet connections on all hosts except neon |
[production] |
| 19:35 |
<catrope> |
synchronized php-1.19/thumb.php 'use temp path correctly' |
[production] |
| 19:31 |
<catrope> |
synchronized php-1.19/thumb.php 'readd debugging for 404s' |
[production] |
| 19:30 |
<catrope> |
synchronized php-1.19/thumb.php 'disable debugging' |
[production] |
| 19:27 |
<catrope> |
synchronized php-1.19/thumb.php 'attempt at debugging' |
[production] |
| 19:24 |
<LeslieCarr> |
removing old wap (mobile) site from ekrem as it hasn't been accessed in a day |
[production] |
| 19:18 |
<catrope> |
synchronized php-1.19/thumb.php 'missing name key' |
[production] |
| 19:16 |
<catrope> |
synchronized php-1.19/thumb.php 'missing global' |
[production] |
| 19:13 |
<aaron> |
synchronized php-1.19/includes/logging/LogFormatter.php 'deployed [[rev:112136|r112136]]' |
[production] |
| 19:05 |
<RoanKattouw_away> |
running sync-common on srv256 because Aaron gets key errors for that box |
[production] |
| 18:48 |
<aaron> |
synchronizing Wikimedia installation... : deploying [[rev:112128|r112128]] |
[production] |
| 18:36 |
<Ryan_Lane> |
shutting down labstore1 |
[production] |
| 17:04 |
<notpeter> |
increasing mem for java to 3300 on pmtpa search hosts |
[production] |
| 16:09 |
<Jeff_Green> |
restarted lsearchd on search3 and search9, was running but nonresponsive |
[production] |
| 16:09 |
<Jeff_Green> |
restarted lsearchd on search15, was not running |
[production] |
| 15:34 |
<notpeter> |
extending database user grants to eqiad private subnets |
[production] |
| 10:09 |
<hashar> |
synchronized php-1.19/extensions/CodeReview/backend/DiffHighlighter.php '[[rev:112098|r112098]] - ([[bugzilla:34554|bug 34554]]) diff chunk fail to parse file add/rm' |
[production] |
| 09:45 |
<Tim> |
on fenair: stopped apache again due to overload. Restarted it with reduced MaxClients |
[production] |
| 09:34 |
<tstarling> |
synchronizing Wikimedia installation... : |
[production] |
| 09:23 |
<Tim> |
on fenari: started apache |
[production] |
| 09:09 |
<tstarling> |
synchronizing Wikimedia installation... : |
[production] |
| 09:05 |
<tstarling> |
synchronizing Wikimedia installation... : |
[production] |
| 09:02 |
<tstarling> |
synchronizing Wikimedia installation... : |
[production] |
| 08:07 |
<ariel> |
rebuilt wikiversions.cdb and synchronized wikiversions files: fix dewikiversity typo in wikiversions file |
[production] |
| 06:49 |
<tstarling> |
synchronized php-1.19/languages/messages/MessagesEn.php 'test change for manualRecache' |
[production] |
| 06:33 |
<tstarling> |
synchronized wmf-config/CommonSettings.php 'enabling manual recache' |
[production] |
| 06:26 |
<Tim> |
installed new scap manually since puppet is broken |
[production] |
| 05:51 |
<tstarling> |
synchronizing Wikimedia installation... : |
[production] |
| 05:18 |
<catrope> |
synchronized php-1.19/thumb.php 'Experimental fix for UploadStash thumbs in 1.19' |
[production] |
| 05:14 |
<Tim> |
started xinetd |
[production] |
| 04:34 |
<catrope> |
synchronized php-1.19/thumb.php 'Experimental fix for 1.19 UploadWizard thumb issue' |
[production] |
| 04:17 |
<tstarling> |
rebuilt wikiversions.cdb and synchronized wikiversions files: rolling back commons to 1.18 |
[production] |
| 03:48 |
<catrope> |
synchronized php-1.19/skins/common/shared.css '[[rev:112081|r112081]]' |
[production] |
| 03:25 |
<tstarling> |
rebuilt wikiversions.cdb and synchronized wikiversions files: |
[production] |
| 03:25 |
<Tim> |
switching commons back to 1.19 |
[production] |
| 03:18 |
<tstarling> |
synchronized php-1.19/includes/LocalisationCache.php |
[production] |
| 03:18 |
<tstarling> |
synchronized php-1.19/includes/LocalisationCache.php |
[production] |
| 03:10 |
<Tim> |
on fenari: NFS overload, killed apache and xinetd |
[production] |
| 03:03 |
<RoanKattouw> |
Manually started ircecho on fenari ; why doesn't this happen upon boot? Why didn't puppet start it? |
[production] |
| 02:57 |
<RoanKattouw> |
Synced php-1.19/includes/MessageBlobStore.php to disable ::clear() ; where's the logging bot? |
[production] |
| 02:53 |
<LeslieCarr> |
manually lowering nagios max checks to 300 |
[production] |
| 02:48 |
<Tim> |
rebooted fenari, nonresponsive |
[production] |
| 02:46 |
<LeslieCarr> |
reset the drac console for spence |
[production] |
| 02:21 |
<tstarling> |
synchronizing Wikimedia installation... : |
[production] |
| 02:18 |
<tstarling> |
synchronizing Wikimedia installation... : |
[production] |
| 02:18 |
<LocalisationUpdate> |
completed (1.18) at Wed Feb 22 02:18:08 UTC 2012 |
[production] |
| 02:15 |
<Tim> |
testing new scap script ~tstarling/bin/scap-new |
[production] |
| 01:57 |
<reedy> |
synchronized php-1.19/extensions/CentralAuth/specials/ '[[rev:112075|r112075]]' |
[production] |
| 01:18 |
<tstarling> |
rebuilt wikiversions.cdb and synchronized wikiversions files: |
[production] |
| 01:18 |
<Tim> |
reverting to 1.18 on commons due to DB overload |
[production] |