- Improved for multi-line token processing
- resolved efficiency issue with binary file (not reading line
by line any more)
- introduced parameters skipinsert and allow_iproc
Approved by: co-mentor (vanilla)
- documentation improvement
- introduced first and last n-gram in the output
- made _reduce_to_limit more efficient (--limit parameter)
PR: ports/69779
Submitted by: maintainer