The LinesChunker reads as many lines as it can. If the buffer runs out in the
middle of a line it will return all the previous full lines. On the next
read it will move the left over data to the beginning of the buffer and continue reading.
If it cannot read a full line it will either return partial lines or it will throw an
error depending on what the user specifies.
Options on how to handle lines that are too long
1. Return partial lines
2. Resize the buffer to hold the entire line
3. Throw an exception/cause an error
The LinesChunker reads as many lines as it can. If the buffer runs out in the middle of a line it will return all the previous full lines. On the next read it will move the left over data to the beginning of the buffer and continue reading. If it cannot read a full line it will either return partial lines or it will throw an error depending on what the user specifies. Options on how to handle lines that are too long 1. Return partial lines 2. Resize the buffer to hold the entire line 3. Throw an exception/cause an error