|
2012-07-23
§
|
| 20:44 |
<cmjohnson1> |
ms-be10 taking off-line for some hardware testing |
[production] |
| 20:13 |
<reedy> |
synchronized php-1.20wmf7/includes/specials/SpecialUserlogin.php |
[production] |
| 20:12 |
<reedy> |
synchronized php-1.20wmf8/includes/specials/SpecialUserlogin.php |
[production] |
| 19:31 |
<RobH> |
authdns-update for transcode name updates |
[production] |
| 19:28 |
<RobH> |
powering down old transcode1, was camera gateway sandbox, reclaiming name |
[production] |
| 18:57 |
<maplebed> |
took ms-be10 out of rotation because it ate itself |
[production] |
| 18:05 |
<reedy> |
rebuilt wikiversions.cdb and synchronized wikiversions files: testwiki and mediawikiwiki to 1.20wmf8 |
[production] |
| 17:03 |
<RobH> |
reobooting potassium, shouldnt be in use, had tons of cruft ssh connections from month ago |
[production] |
| 16:26 |
<Reedy> |
running ddsh -cM -g mediawiki-installation -o -oSetupTimeout=30 -F30 -- "sudo -u mwdeploy rm -rf /usr/local/apache/common/php-1.20wmf5" |
[production] |
| 16:23 |
<Reedy> |
running ddsh -cM -g mediawiki-installation -o -oSetupTimeout=30 -F30 -- "sudo -u mwdeploy rm -rf /usr/local/apache/common/php-1.20wmf4" |
[production] |
| 16:22 |
<reedy> |
Finished syncing Wikimedia installation... : 1.20wmf8 messages |
[production] |
| 16:04 |
<paravoid> |
reinstalling srv281; disk full, hasn't run puppet for 300 days, depooled for ages |
[production] |
| 15:54 |
<reedy> |
Started syncing Wikimedia installation... : 1.20wmf8 messages |
[production] |
| 15:44 |
<reedy> |
Started syncing Wikimedia installation... : 1.20wmf8 messages |
[production] |
| 15:42 |
<reedy> |
Finished syncing Wikimedia installation... : test2wiki to 1.20wmf8 and rebuild localisation cache |
[production] |
| 15:23 |
<reedy> |
Started syncing Wikimedia installation... : test2wiki to 1.20wmf8 and rebuild localisation cache |
[production] |
| 15:21 |
<reedy> |
rebuilt wikiversions.cdb and synchronized wikiversions files: rm chwikimedia we dont host it |
[production] |
| 15:19 |
<reedy> |
rebuilt wikiversions.cdb and synchronized wikiversions files: chwikimedia to 1.20wmf7 |
[production] |
| 15:14 |
<Reedy> |
srv281 has a full / and hasn't had a puppet run in over 434298 minutes |
[production] |
| 15:10 |
<reedy> |
synchronized php-1.20wmf8/cache/ |
[production] |
| 15:06 |
<reedy> |
synchronized php-1.20wmf8/ 'Initial sync out of 1.20wmf8' |
[production] |
| 13:44 |
<RobH> |
authdns-update for ms-be eqiad hosts |
[production] |
| 12:46 |
<maplebed> |
rebooting ms-be10 for xfs errors and a clean boot |
[production] |
| 12:38 |
<maplebed> |
rebalanced swift rings moving more content to new object servers |
[production] |
| 12:26 |
<reedy> |
synchronized flaggedrevs.dblist |
[production] |
| 12:26 |
<reedy> |
synchronized wmf-config/flaggedrevs.php |
[production] |
| 12:25 |
<Reedy> |
Created trwikiquote flagged revs tables |
[production] |
| 12:23 |
<reedy> |
synchronized wmf-config/ |
[production] |
| 02:22 |
<LocalisationUpdate> |
completed (1.20wmf6) at Mon Jul 23 02:22:45 UTC 2012 |
[production] |
| 02:22 |
<LocalisationUpdate> |
completed (1.20wmf7) at Mon Jul 23 02:22:33 UTC 2012 |
[production] |
|
2012-07-20
§
|
| 18:57 |
<paravoid> |
powerin on owa1/owa2 again, they're being used as ganglia aggregators for swift |
[production] |
| 18:11 |
<Ryan_Lane> |
starting gerrit |
[production] |
| 17:59 |
<binasher> |
db48 is now replicating from db1048 (and db1048 from db48) |
[production] |
| 17:26 |
<RobHalsell> |
authdns-update run for new servers |
[production] |
| 15:29 |
<paravoid> |
powering off the rest of mw10[0-9][0-9] |
[production] |
| 14:35 |
<mark> |
Added server hydrogen to the dns_rec eqiad LVS pool |
[production] |
| 14:22 |
<paravoid> |
powering off owa1/2/3, unused |
[production] |
| 13:54 |
<paravoid> |
powering off all of mw1[0-9][0-9][0-9].eqiad.wmnet, unused |
[production] |
| 13:36 |
<mark> |
Reinstalling hydrogen |
[production] |
| 13:19 |
<paravoid> |
powercycling hydrogen, down since yesterday |
[production] |
| 12:59 |
<paravoid> |
powercycling nescio/ns2, unresponsive network & console |
[production] |
| 10:38 |
<mark> |
Built new varnish 3.0.3~rc1+persistent1-wm1 packages and inserted them into the precise-wikimedia APT repository |
[production] |
| 02:23 |
<LocalisationUpdate> |
completed (1.20wmf6) at Fri Jul 20 02:23:39 UTC 2012 |
[production] |
| 02:23 |
<LocalisationUpdate> |
completed (1.20wmf7) at Fri Jul 20 02:23:27 UTC 2012 |
[production] |