The following example shows how a clause is composed of tokens:
Example 1.14. Special characters
This example is composed of six tokens—a literal string ("REPEAT"
), a blank operator, a symbol (A
, which can have an assigned value), an operator (+
), a second symbol (3
, which is a number and a symbol), and the clause delimiter (;
). The blanks between the A
and the +
and between the +
and the 3
are removed. However, one of the blanks between the "REPEAT"
and the A
remains as an operator. Thus, this clause is treated as though written:
"REPEAT" A+3;