Beruflich Dokumente
Kultur Dokumente
Rationalist position
Knowledge of language involves in the first
place knowledge of grammar language is a
derivative and perhaps not very interesting concept
Chomsky, 1980
Empiricist position
Dont think but look! the more we examine
actual language, the sharper becomes the conflict
between it and
our requirement, the crystalline
purity of logic
Wittgenstein, 1945
NB Chomsky has modified his position over the years,
and now says that empirical evidence is relevant.
Type 1:
Context sensitive
Type 2:
Context free
Type 3:
Regular
Many
race
noun, verb
cut
her
flies
noun, verb
10
Tagsets
11
Sample tagset
Tagset with 10 classes
Content words
noun
verb
adjective
adverb
Function words
determiner
pronoun
preposition
conjunction
auxiliary verb
Other
13
14
15
proper noun
plural noun
3rd person singular verb
full stop
NNS or VBZ
NP
NNS
VBZ
NNS
28
VBZ
17
---
135
37
Following tag
18
CLAWS process
Lexicon holds a list of words and possible tags.
The processor will take each word in turn and look it up.
If not there, tags are assigned using suffix or prefix rules.
Examples:
suffix
probable tag
-able
adjective
e.g. suitable
-cle
noun
e.g. article
-dle
noun or verb e.g. handle
If word does not have suffix or prefix in list, default to
noun or verb
19
20
24
27
28