RegexTokenizer (Okapi Framework SDK 1.44.0 API)

java.lang.Object
- net.sf.okapi.filters.doxygen.RegexTokenizer

Direct Known Subclasses:

DelimiterTokenizer, PrefixSuffixTokenizer
```
public abstract class RegexTokenizer
extends Object
```

Nested Class Summary

Nested Classes
Modifier and Type Class Description

static class RegexTokenizer.MatchRecord

class RegexTokenizer.Token

class RegexTokenizer.Tuple

Field Summary

Fields
Modifier and Type	Field	Description
`protected Matcher`	`currentPrefixMatcher`
`protected boolean`	`firstRun`
`protected int`	`i`
`protected IdentityHashMap<Matcher,Matcher>`	`matchers`
`protected String`	`s`

Constructor Summary

Constructors
Constructor Description

RegexTokenizer()

Method Summary

All Methods Instance Methods Concrete Methods
Modifier and Type	Method	Description
`protected void`	`cache(Matcher m)`
`protected Matcher`	`getPrefixMatcher()`
`protected boolean`	`isDuplicate(Matcher m)`

Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

s
```
protected String s
```

i
```
protected int i
```

firstRun
```
protected boolean firstRun
```

matchers

protected IdentityHashMap<Matcher,Matcher> matchers

currentPrefixMatcher
```
protected Matcher currentPrefixMatcher
```

Constructor Detail
- RegexTokenizer
```
public RegexTokenizer()
```

Method Detail

getPrefixMatcher
```
protected Matcher getPrefixMatcher()
```

cache
```
protected void cache(Matcher m)
```

isDuplicate

protected boolean isDuplicate(Matcher m)