Some time ago I was working on a project where we only wanted to process the new files from a logfile - the requirement was that we should never process the same line more than once.

So we started counting the lines of the logfile and adding a bunch of checks …