Re: I-O Performance
Lew wrote:
The output files will be a limiting factor. The requirement that
"[l]ines will be appended unchanged to a small number of output files"
implies that consumers of the Readers will have to wait their turn at
the output side to prevent interleaving.
This is a classic producer-consumer scenario with a few standard
solution architectures.
You seem to have extracted a lot more detail from the
problem statement than I was able to find. The only things
I know (think I know) about the problem are:
- There is a "large number" of input files,
- They contain "lines" (not, e.g., serialized JButtons),
- They are "relatively small," containing "a few hundred
lines each,"
- The lines are "appended" to output files (whether those
pre-exist or not isn't clear),
- The number of output files is "small," and
- An existing solution uses Buffered{Reader,Writer}.
I don't even know for sure that the performance of the
existing solution is unsatisfactory -- That would be one reason
for asking the question in the first place, but it might also
have been asked purely out of curiosity.
All else is mere hypothecation, until and unless Loial
chooses to amplify his description.
--
Eric Sosman
esosman@ieee-dot-org.invalid