|
2008-12-30
§
|
| 23:02 |
<RobH> |
is leaving on a jet plane, weeeeeeeee.. in 8 hours. |
[production] |
| 23:01 |
<RobH> |
all knams squids are now online. |
[production] |
| 22:49 |
<RobH> |
knsq23-26 back in rotation, 3 more to go. |
[production] |
| 22:33 |
<RobH> |
enabled knsq16-knsq22 in lvs, almost time to go back to hotel and die. |
[production] |
| 22:22 |
<brion> |
attempting to purge affected pages on dawiktionary, dawiki |
[production] |
| 22:21 |
<brion> |
taking dawiki, dawiktionary out of read-only because the rest of the fixes won't work until it's disabled :P |
[production] |
| 22:14 |
<brion> |
poking diff version in live DifferenceEngine.php to eliminate bogus cache entries for dawiki/dawiktionary |
[production] |
| 22:11 |
<RobH> |
stopping and clearing the cache on knsq16-knsq30. |
[production] |
| 22:06 |
<brion> |
trying it again, but this time with the right variable names |
[production] |
| 22:02 |
<brion> |
attempting to clear revision text loading cache entries for dawiktionary, dawiki |
[production] |
| 21:47 |
<brion> |
live-merging r45206 so [[bugzilla:16841]] corrupted entries will be loaded properly on dawiki/dawiktionary. need to clear revision, diff, parser caches... |
[production] |
| 21:15 |
<brion> |
locking dawiki, dawiktionary ($wgReadOnly) pending encoding fix |
[production] |
| 20:07 |
<brion> |
killed recompressTracked.php processes on hume pending investigation of encoding breakage |
[production] |
| 20:02 |
<brion> |
commenting ariel out of pmtpa also |
[production] |
| 19:58 |
<brion> |
trying to clear no-longer-in-dns hosts from ALL node group |
[production] |
| 19:57 |
<brion> |
PLEASE SAY WHAT SERVER YOU'RE RUNNING BATCH PROCESSES ON IF THEY'RE NOT ON ZWINGER. thanks |
[production] |
| 19:56 |
<RobH> |
power disconnection for primary routing rack in esams. power restored, and totally was not robh's fault regardless of what lies mark may say to the contrary. |
[production] |
| 19:54 |
<brion> |
encoding issues reported with some old edits on dawiki. wondering if this is recompression-related? |
[production] |
| 18:46 |
<brion> |
added PMTPA nameserver back in mayflower's resolv.conf so DNS actually works on it until things are fixed |
[production] |
| 17:42 |
<brion> |
internal DNS for knams seems to be down (at least on mayflower), this is breaking at least SVN update notifications |
[production] |
| 17:14 |
<brion> |
updating logo for pmswiki [[bugzilla:16587]] |
[production] |
| 13:29 |
<Tim> |
starting recompressTracked.php on all wikis |
[production] |
| 11:22 |
<mark> |
Shutting down knsq16-30 |
[production] |
| 11:00 |
<mark> |
In case of overload problems, please move traffic to pmtpa (scenario knams-down) |
[production] |
| 10:54 |
<mark> |
Depooled knsq16-30 |
[production] |
| 10:47 |
<mark> |
Set DNS timeout on fuchsia (LVS) to 1s, PyBal timeout to 8s |
[production] |
| 10:21 |
<mark> |
Unracking pascal, mint, lily |
[production] |
| 09:57 |
<Tim> |
testing recompressTracked on huwiki |
[production] |
| 09:38 |
<mark> |
ts-array3/A --> yarrow/0 |
[production] |
| 09:23 |
<TimStarling> |
testing recompressTracked on testwiki |
[production] |
| 09:20 |
<mark> |
hemlock/eth1 <--> clematis/eth1 |
[production] |
| 09:17 |
<mark> |
ts-array2 -> zedler scsi B, ts-array1/0 -> zedler scsi A |
[production] |
| 08:47 |
<TimStarling> |
running FlaggedRevs/maintenance/clearCachedText.php on all FlaggedRevs wikis |
[production] |