Commit Graph

73 Commits

Author SHA1 Message Date
6163f67b06 [core] Rename Tokenizer to CpdLexer
See #4065
2024-01-11 17:04:48 +01:00
32afa53f8e All language modules: getInstance()
Use a consistent implementation of getInstance().
Now all modules resolve against the LanguageRegistry.
2023-08-24 16:01:27 +02:00
c572cb88d7 Rename package cpd.internal to cpd.impl 2023-02-13 15:18:37 +01:00
ddbfc90c14 Fix build 2023-02-12 20:06:28 +01:00
fb9f49624d Delete old CPD Language interface
reorganize cpd modules
2023-02-12 18:03:58 +01:00
cf81809990 Change a ton of stuff in CPD 2023-02-10 18:21:23 +01:00
d4c05d1fb5 Make pmd language have a hook to launch CPD
This allows removing the CPD language instances,
sharing more logic between CPD and PMD, and using
language properties to configure CPD and PMD uniformly.
2023-02-10 16:45:52 +01:00
f454e19ca7 [python] Migrate tests to JUnit5 2022-10-03 16:30:00 +02:00
63c01f0f5b Merge branch '7.0.x' into text-utils-javacc 2022-07-17 17:06:37 +02:00
59d931cd91 Merge remote-tracking branch 'upstream/pmd/7.0.x' into text-utils-simple 2022-07-10 13:50:03 +02:00
8248f6e4e1 Fix unit tests 2022-05-26 11:49:51 +02:00
82dd4d46ca Merge branch 'master' into pmd/7.0.x 2022-05-26 11:21:38 +02:00
f80c73e44f Test dollar in ident in python 2022-05-01 18:56:45 +02:00
71b9362828 [python] unicode support
Fix #2604
2022-05-01 17:51:38 +02:00
474deca0e2 Fix cpd 2022-04-02 15:43:28 +02:00
20472d492d Merge branch 'text-utils-simple' into text-utils-javacc 2022-03-07 21:25:32 +01:00
f3454949d7 Fix build 2022-03-07 21:24:35 +01:00
8231542746 Merge branch 'text-utils-simple' into text-utils-javacc 2022-03-07 20:09:38 +01:00
3b8d7a32a7 Cleanups 2022-03-07 19:59:50 +01:00
f4f7f4b65d Move nspmd.util.document -> lang.document 2022-03-05 18:05:04 +01:00
fa31d54bd7 Fix tests 2021-07-08 19:11:20 +02:00
f7909ae78a Merge branch 'master' into pr-2963-update 2021-01-21 11:43:01 +01:00
c37f208d3e Call jjtree/javacc with UTF-8 as default encoding
Fixes #2970
2020-12-17 18:31:13 +01:00
af31b3a773 Add GenericToken.getKind() to interface 2020-12-10 12:10:47 +01:00
c88919bbc7 Cleanup 2020-09-17 22:56:45 +02:00
3ee32effda Refactor token documents
Isolate static parts
2020-09-17 22:56:01 +02:00
155a895a93 Move charstream 2020-09-17 22:54:20 +02:00
e93e5b0a4c Move into .io package 2020-09-17 22:43:29 +02:00
95bac5eb95 Convert CharStream to class 2020-09-17 22:41:16 +02:00
b779abd08b Align cpd 2020-09-17 22:41:14 +02:00
2356f2f69d Use TextRegion in tokens 2020-09-17 22:29:59 +02:00
2b1d071930 Fix tests due to endColumn changes 2020-08-21 12:38:37 +02:00
ab489832fe Merge branch 'master' into pmd/7.0.x 2020-08-21 11:51:54 +02:00
6fb5ac59b9 Ensure CPD uses tab width of 1 for tabs consistently
The columns that are reported by CPD were inconsistent across languages
before. A language like Java (using a JavaCC-based tokenizer) would use
a width of 8 for tabs, whereas a language like C# (using an Antlr-based
tokenizer) would use 1 instead.

This includes unit tests for most languages to ensure a tab character is
counted as 1. The configuration for JavaCC has been adjusted to respect
this as well.
2020-07-20 10:42:21 +02:00
e4690cb56a Fix compile errors for CPD only languages 2020-07-17 15:04:43 +02:00
5b7ed588ea Make CPD end column exclusive
This is to align it with PMD columns,
which in 7.0 are already exclusive.
2020-06-19 02:21:45 +02:00
c49d9e315f Merge branch 'master' into 7.0.x 2020-06-19 01:32:32 +02:00
aedd2ce493 Convert python tests 2020-06-13 23:56:55 +02:00
f64acb6c38 python 2020-03-20 18:07:56 +01:00
3cdcba2299 Fix file name for token manager error 2020-03-20 18:07:56 +01:00
b487ef94d0 [python] Deprecate/Internalize PythonTokenManager
Refs #2293
2020-03-13 10:30:43 +01:00
57429b0ff9 Fix class cast exception 2020-02-17 01:43:08 +01:00
579c134061 Port python module 2020-02-16 22:27:09 +01:00
d90d5d267c Remove trailing whitespace everywhere 2020-01-24 23:40:06 +01:00
b02ab00e87 Merge remote-tracking branch 'origin/master' into pmd/7.0.x 2020-01-24 19:18:17 +01:00
5feca7fd93 Exclude generated AST*.java files from internalization 2020-01-24 16:19:24 +01:00
60e97d0ec8 Deprecate javacc generated code 2020-01-22 17:19:29 +01:00
99700d7526 Extract changes from #2166 to 7.0.x
* Make Java nodes text-available
* Introduce shared JavaccToken in pmd-core
* Use factory to produce char streams

Tests are still on java-grammar,
since they use the DSL & newer
AST structure.

This is to prepare for other changes
that concern all javacc languages and
should not be done on java-grammar
2020-01-10 21:15:15 +01:00
1fe9c59212 Remove cpp lang 2019-09-24 06:15:34 +02:00
47f8192764 Merge remote-tracking branch 'origin/master' into pmd/7.0.x 2019-05-11 12:03:08 +02:00