Remove Duplicates Token Filter

edit

Remove Duplicates Token Filter

edit

A token filter of type remove_duplicates that drops identical tokens at the same position.