tmp/tmpj2fwk87m/{from.md → to.md}
RENAMED
|
@@ -6,15 +6,16 @@ token:
|
|
| 6 |
keyword
|
| 7 |
literal
|
| 8 |
operator-or-punctuator
|
| 9 |
```
|
| 10 |
|
| 11 |
-
There are five kinds of tokens: identifiers, keywords, literals,[^
|
| 12 |
|
| 13 |
-
operators, and other separators.
|
| 14 |
-
|
|
|
|
| 15 |
described below, are ignored except as they serve to separate tokens.
|
| 16 |
|
| 17 |
-
[*Note 1*:
|
| 18 |
-
|
| 19 |
-
|
| 20 |
|
|
|
|
| 6 |
keyword
|
| 7 |
literal
|
| 8 |
operator-or-punctuator
|
| 9 |
```
|
| 10 |
|
| 11 |
+
There are five kinds of tokens: identifiers, keywords, literals,[^6]
|
| 12 |
|
| 13 |
+
operators, and other separators. Comments and the characters
|
| 14 |
+
U+0020 (space), U+0009 (character tabulation), U+000b (line tabulation),
|
| 15 |
+
U+000c (form feed), and new-line (collectively, “whitespace”), as
|
| 16 |
described below, are ignored except as they serve to separate tokens.
|
| 17 |
|
| 18 |
+
[*Note 1*: Whitespace can separate otherwise adjacent identifiers,
|
| 19 |
+
keywords, numeric literals, and alternative tokens containing alphabetic
|
| 20 |
+
characters. — *end note*]
|
| 21 |
|