The goal of this demo is to show how a filter in the CLaRK system can be created.
Note that filters are not used independently, they are used by the other tools in the system.
Filters work over token categories and/or elements.
Our goal here is to create a filter which discards all spaces. It can be used when a grammar over a pure text is applied.
In order to create a filter you have to perform the following steps:
Definitions
.New
button. A new dialog appears in which the user
must specify the name of the filter. In the text box Name
write
no-blank
.MixedWord
tokenizer from the combo box with all
tokenizers.Choose from
with token categories select
SPACE
. These are categories of the selected tokenizer and of its
parent tokenizer.=>
button or double click over a category - in order to
add the selected category to the filter. More than one categories can be added
to a filter - they are visible in Token Types
list. Save
button in order to save the filter in the
system.