|
2010-05-25
§
|
| 17:02 |
<catrope> |
synchronized php-1.5/wmf-config/CommonSettings.php 'Re-add style version appendix now that borked usability JS was purged from Varnish' |
[production] |
| 12:51 |
<domas> |
what happened - server goes down, configuration gets updated, server comes up, builds new cache out of old conf, sync has timestamp older than cache, mw has stale config |
[production] |
| 12:47 |
<domas> |
cleaned /tmp/mw-cache for some servers - apparently sync-common is not enough to get stuff in sync anymore :) we have now monobook pages in caches, I guess. |
[production] |
| 12:26 |
<rainman-sr> |
freed up some space and restarted indexing on searchidx1, indexing was stuck because the disk was full |
[production] |
| 11:16 |
<mark> |
Downgraded puppet on db36 |
[production] |
| 06:56 |
<domas> |
resynced srv206/srv193 - seems to have lost critical configuration updates while they were down. Again, why servers are not resynced after downtime? |
[production] |
| 01:24 |
<Tim> |
fixed redirect from http://racktables to https://racktables, was broken due to IP address change |
[production] |
| 01:15 |
<tstarling> |
synchronized php-1.5/wmf-config/CommonSettings.php 'removed cruft from wgStyleVersion' |
[production] |
| 01:12 |
<tstarling> |
synchronized php-1.5/skins/common/wikibits.js |
[production] |
| 00:19 |
<aaron> |
synchronized php-1.5/wmf-config/flaggedrevs.php 'removed Editor group from flaggedrevs_labswikimedia' |
[production] |
| 00:02 |
<AaronSchulz> |
unhide the username of edits by "The Thing That Should Not Be" after accidental account locking (and unlock didn't work) |
[production] |
|
2010-05-24
§
|
| 15:01 |
<Rob> |
sq39 will stay offline for a bit, have a configuration concern with replacement disk performance. |
[production] |
| 15:01 |
<Rob> |
pushed updates to srv206 and srv193, they should be back online and ok now. |
[production] |
| 14:54 |
<Rob> |
sq39 has disk replaced and reinstalled, but its failing squid backend due to configuration. pulling out of rotation to look at later today. |
[production] |
| 14:51 |
<Rob> |
working on srv206 and srv193 |
[production] |
| 14:21 |
<Rob> |
replaced bad disk in sq39, reinstalling. |
[production] |
| 12:16 |
<domas> |
db32, db36, db38 and db40 are now serving enwiki (+ db12 and db26 ) |
[production] |
| 12:15 |
<midom> |
synchronized php-1.5/wmf-config/db.php |
[production] |
| 09:25 |
<midom> |
synchronized php-1.5/wmf-config/db.php 'db22 being removed too' |
[production] |
| 09:23 |
<midom> |
synchronized php-1.5/wmf-config/db.php 'removing db14, db16 from enwiki duty, will host different clusters, db26 upgrade' |
[production] |
| 09:17 |
<domas> |
master switch db16->db36, new master position - db36-bin.000001:106 |
[production] |
| 09:16 |
<midom> |
synchronized php-1.5/wmf-config/db.php |
[production] |
| 09:16 |
<midom> |
synchronized php-1.5/wmf-config/db.php |
[production] |
| 09:09 |
<midom> |
synchronized php-1.5/wmf-config/db.php |
[production] |
| 09:06 |
<domas> |
srv141 was in prod, but not in mw_inst |
[production] |
| 07:24 |
<midom> |
synchronized php-1.5/wmf-config/db.php |
[production] |
| 07:09 |
<midom> |
synchronized php-1.5/wmf-config/db.php |
[production] |
| 07:06 |
<domas> |
srv134 was having i/o issues, probably bad disk, rebooted for it to stop flapping, sorry Jens :) |
[production] |
|
2010-05-21
§
|
| 22:53 |
<jeluf> |
synchronized php-1.5/wmf-config/InitialiseSettings.php '23545 - Rights changes for frwiktionary' |
[production] |
| 19:36 |
<catrope> |
synchronized php-1.5/wmf-config/InitialiseSettings.php 'Use separate Apple Touch icon for testwiki' |
[production] |
| 18:17 |
<catrope> |
synchronized php-1.5/wmf-config/CommonSettings.php 'Bump style version appendix' |
[production] |
| 18:16 |
<catrope> |
synchronized php-1.5/extensions/UsabilityInitiative/js/plugins.combined.min.js 'r66729' |
[production] |
| 16:33 |
<catrope> |
synchronized php-1.5/wmf-config/CommonSettings.php 'Bump style version appendix' |
[production] |
| 16:33 |
<catrope> |
synchronized php-1.5/extensions/UsabilityInitiative/js/plugins.combined.min.js 'r66726' |
[production] |
| 16:18 |
<catrope> |
synchronized php-1.5/wmf-config/CommonSettings.php 'Bump style version appendix' |
[production] |
| 16:17 |
<catrope> |
synchronized php-1.5/extensions/UsabilityInitiative/js/plugins.combined.min.js 'Resync, seems this didn't get updated properly last time' |
[production] |
| 09:53 |
<RoanKattouw> |
Deployed new favicon and apple toch icon on test; overwrote the latter locally on srv124, will be overwritten by scap until we change the wikipedia.org-wide default |
[production] |