Clément Fournier
a11f45e511
Cleanup spec
2020-09-17 22:54:59 +02:00
Clément Fournier
155a895a93
Move charstream
2020-09-17 22:54:20 +02:00
Clément Fournier
51170633b0
Remove fragmented doc cursor
2020-09-17 22:54:09 +02:00
Clément Fournier
3fbb8b51d7
Cleanup
2020-09-17 22:54:09 +02:00
Clément Fournier
2d9d74e1ec
Cleanup exception messages
2020-09-17 22:54:08 +02:00
Clément Fournier
a6e1f634f5
Add MalformedSourceException
2020-09-17 22:53:54 +02:00
Clément Fournier
eaed142496
Move text file stuff into the main document package
2020-09-17 22:53:28 +02:00
Clément Fournier
9a4fc3cee6
Move factory methods to the interface
2020-09-17 22:48:43 +02:00
Clément Fournier
3481e6b699
Checkstyle
2020-09-17 22:45:23 +02:00
Clément Fournier
9843ac0b9d
Fix c++
2020-09-17 22:45:13 +02:00
Clément Fournier
cd3ed7a286
Fix rebase
2020-09-17 22:44:38 +02:00
Clément Fournier
b8af0dda6e
Move AbstractTokenManager
2020-09-17 22:44:38 +02:00
Clément Fournier
7f65b1f910
Improve pooling stats
2020-09-17 22:44:38 +02:00
Clément Fournier
1c4b241255
Pool some strings
2020-09-17 22:44:37 +02:00
Clément Fournier
6064d16ecc
Add fast paths
2020-09-17 22:44:19 +02:00
Clément Fournier
01468cd733
Reuse stringbuilders
2020-09-17 22:44:18 +02:00
Clément Fournier
db70196159
Ignore MORE token accumulation
2020-09-17 22:44:07 +02:00
Clément Fournier
02684accba
PICKME
2020-09-17 22:44:07 +02:00
Clément Fournier
3170fcf3c4
Optimal impl for appendMarkSuffix
2020-09-17 22:44:07 +02:00
Clément Fournier
5ab241ecc5
Use string internally
...
This is to profit from
compact string features,
and to make the use of
StringBuilders more
efficient.
2020-09-17 22:44:00 +02:00
Clément Fournier
1210d68640
Remove mutable char buffers
2020-09-17 22:43:53 +02:00
Clément Fournier
f6b8bdc975
Replace old impl with newer one
...
This uses "fragmented docs". This
is less efficient when there are
a lot of escapes, but:
- it doesn't require the initial
buffer copy
- it doesn't mutate any buffer, so
Chars can be readonly all the time
- it handles escapes of arbitrary
inLen/outLen ratio and is thus
future proof
- it is much more maintainable
On the downside there is
- efficiency (this data structure is
"pointy")
- clarity of the Reader implementation
(one more state to support, ie reading
not from the input buffer but from an
escape)
2020-09-17 22:43:53 +02:00
Clément Fournier
ad9d83a294
Cleanup cursor
2020-09-17 22:43:53 +02:00
Clément Fournier
5d7e57ca9b
Move tests
2020-09-17 22:43:45 +02:00
Clément Fournier
ea62ad7f2e
Remove lazy image token
...
Slicing Chars will be enough
2020-09-17 22:43:44 +02:00
Clément Fournier
e93e5b0a4c
Move into .io package
2020-09-17 22:43:29 +02:00
Clément Fournier
6142dc3978
Rename java reader
2020-09-17 22:42:22 +02:00
Clément Fournier
dc8ac96013
Fix cherry-pick
2020-09-17 22:42:21 +02:00
Clément Fournier
41d747ead2
Abstract backslash escape readers
2020-09-17 22:42:12 +02:00
Clément Fournier
fd375e4bcd
More opts
2020-09-17 22:42:11 +02:00
Clément Fournier
b662cadcc0
Some opts
2020-09-17 22:41:40 +02:00
Clément Fournier
1f8c5b65b3
Better implementation for appendSuffix
2020-09-17 22:41:16 +02:00
Clément Fournier
c088a6add5
Rename charStream methods
2020-09-17 22:41:16 +02:00
Clément Fournier
95bac5eb95
Convert CharStream to class
2020-09-17 22:41:16 +02:00
Clément Fournier
d3de455ede
Fix backup
2020-09-17 22:41:15 +02:00
Clément Fournier
052103ff0c
Test several escapes
2020-09-17 22:41:15 +02:00
Clément Fournier
3b309ce628
Gobble multiple us
2020-09-17 22:41:15 +02:00
Clément Fournier
d4be567652
Fix zero-length escapes
2020-09-17 22:41:15 +02:00
Clément Fournier
2e725038ac
Checkout tests
2020-09-17 22:41:15 +02:00
Clément Fournier
d3a434a933
Remove pmd core ant sources
2020-09-17 22:41:15 +02:00
Clément Fournier
b779abd08b
Align cpd
2020-09-17 22:41:14 +02:00
Clément Fournier
b31edc52c2
Add Chars
2020-09-17 22:40:57 +02:00
Clément Fournier
0d5270a2dc
Checkout javacc utils
2020-09-17 22:40:57 +02:00
Clément Fournier
fb70b24485
Remove Chars reader
2020-09-17 22:37:24 +02:00
Clément Fournier
65a0387296
Rename TextDocumentImpl
2020-09-17 22:37:24 +02:00
Clément Fournier
b1fb2a4251
More tests
2020-09-17 22:37:24 +02:00
Clément Fournier
d690b50c07
Move text file stuff into the main document package
2020-09-17 22:37:23 +02:00
Clément Fournier
0d7d0a0fcc
Make builder for sourceCode positioner
2020-09-17 22:37:12 +02:00
Clément Fournier
4f797e77f5
Simplify
2020-09-17 22:37:12 +02:00
Clément Fournier
50d6cd1b33
Use some default methods
2020-09-17 22:37:12 +02:00
