|
2009-03-25
§
|
| 01:29 |
<Tim> |
running trackBlobs.php again on hume |
[production] |
| 01:23 |
<Tim> |
db18 back up, replicating, 14285s lag |
[production] |
| 01:18 |
<tstarling> |
synchronized php-1.5/db.php |
[production] |
| 01:14 |
<Tim> |
rebooted ILOM on db18, was refusing to reboot the machine |
[production] |
| 00:58 |
<Tim> |
db18 was locked up in kswapd, attempting reboot |
[production] |
| 00:30 |
<Tim> |
installed NRPE etc. on ms2 and ms3 |
[production] |
| 00:15 |
<tstarling> |
synchronized php-1.5/db.php |
[production] |
| 00:11 |
<tstarling> |
synchronized php-1.5/db.php |
[production] |
| 00:09 |
<tstarling> |
synchronized php-1.5/db.php |
[production] |
| 00:04 |
<Prodego> |
domas is logging |
[production] |
|
2009-03-24
§
|
| 23:57 |
<Tim> |
changing master for rc1 to ms3. Omitting srv183, which will be removed from the group. |
[production] |
| 23:46 |
<azafred_> |
udpated motd on srv32 to reflect its puppeteer status. |
[production] |
| 23:35 |
<domas> |
experimented with PG vs MySQL5.0 performance on db28 :) |
[production] |
| 23:34 |
<robh> |
synchronized php-1.5/InitialiseSettings.php 'Ack, added to foundationwiki, not fishbowl, reverted, and added to fishbowl.' |
[production] |
| 23:07 |
<Rob> |
lowered the memory limit on usability project server |
[production] |
| 22:52 |
<robh> |
synchronized php-1.5/InitialiseSettings.php 'Adding an inactive group to foundationwiki' |
[production] |
| 22:43 |
<brion> |
usability.wikimedia.org timing out |
[production] |
| 22:23 |
<azafred_> |
fixed spamassassin rules compilation on mchenry to speed up the process |
[production] |
| 22:22 |
<azafred_> |
Updated spamassassin rules to include more spam definitions on mchenry. |
[production] |
| 21:36 |
<brion> |
updating usability.wikimedia.org to current, installing AntiSpoof, AbuseFilter to help clean up vandalism problems |
[production] |
| 18:59 |
<azafred_> |
bounced apache on srv201 |
[production] |
| 18:58 |
<azafred_> |
bounced apache on srv188 |
[production] |
| 18:30 |
<Rob> |
pushing apache changes for wikizdroje.cz for cs.wikisource.org |
[production] |
| 17:40 |
<azafred_> |
restarted apache on srv190 |
[production] |
| 15:30 |
<robh> |
synchronized php-1.5/InitialiseSettings.php 'Bug 18023 Enable Collection extension on svwiki' |
[production] |
| 15:22 |
<robh> |
synchronized php-1.5/InitialiseSettings.php '//For bug 18061 Remove obsolete settings from cluster config files' |
[production] |
| 10:45 |
<midom> |
synchronized php-1.5/includes/specials/SpecialRecentchanges.php 'RC cost became too high to support 5000 limit, decreased to 500' |
[production] |
| 06:56 |
<Tim> |
stopped mysql on srv171 and srv183 for copy to ms2 and ms3. Depooled. |
[production] |
| 06:55 |
<tstarling> |
synchronized php-1.5/db.php |
[production] |
| 06:53 |
<Tim> |
installed ganglia on ms2 and ms3, put them in the mysql cluster |
[production] |
| 04:31 |
<andrew> |
synchronized php-1.5/InitialiseSettings.php 'I broke plwiki' |
[production] |
| 04:27 |
<andrew> |
synchronized php-1.5/InitialiseSettings.php 'Bugs 18073, 18094, 18102, AbuseFilter for commons, plwiki, svwiki' |
[production] |
| 04:22 |
<andrew> |
synchronized php-1.5/CommonSettings.php 'Custom AbuseFilter settings for plwiki (bug 18073)' |
[production] |
| 01:41 |
<mark> |
Installed Ubuntu on ms2; ms3 and ms2 are now ready for ES usage |
[production] |
|
2009-03-23
§
|
| 23:32 |
<tstarling> |
synchronized php-1.5/InitialiseSettings.php 'rate limit exemption for usability testing' |
[production] |
| 22:56 |
<domas> |
db1 will serve fr/ja soonish |
[production] |
| 22:56 |
<midom> |
synchronized php-1.5/db.php 'removing db1' |
[production] |
| 18:58 |
<Rob> |
upgraded spam plugin on wikimedia blog (shows old stuff in dashboard due to caching, its updated now) |
[production] |
| 18:23 |
<aZaFred> |
Setup access on LDAP and NIS for fvassard. |
[production] |
| 13:36 |
<midom> |
synchronized php-1.5/db.php 'rename s2a into s2dewiki, add s2commons with single primary server ixia, enable ixia with commons-only dataset, *poof*' |
[production] |
| 00:34 |
<brion-weekend> |
customized style a bit on [[techblog.wikimedia.org]] |
[production] |
|
2009-03-22
§
|
| 23:14 |
<Tim> |
killed long-running tidy instance on srv108 |
[production] |
| 22:10 |
<Tim> |
restarted memcached on srv82 |
[production] |
| 12:15 |
<domas> |
dumping commonswiki from db30 with server still pooled in and 4 dumper threads |
[production] |
| 10:38 |
<domas> |
hey, I found remote code execution vulnerability, it seems! :) |
[production] |
| 10:37 |
<andrew> |
synchronized php-1.5/extensions/AbuseFilter/AbuseFilter.parser.php '--message=Arbitrary execution vulnerability in AbuseFilter, exploitable only by admins' |
[production] |
| 06:00 |
<tstarling> |
synchronized php-1.5/db.php 'depooled ixia, is full' |
[production] |
| 05:54 |
<Tim> |
db5 was running out of disk space due to excessive relay logs. Ran RESET SLAVE. |
[production] |
| 03:02 |
<andrew> |
synchronized php-1.5/extensions/AbuseFilter/Views/AbuseFilterViewExamine.php '18096 Special:AbuseFilter/examine doesn't list new account creation log entries' |
[production] |
| 02:47 |
<andrew> |
synchronized php-1.5/extensions/AbuseFilter/AbuseFilter.class.php 'Fixed bug in batch testing interface' |
[production] |