65 Commits

Author SHA1 Message Date
Clément Fournier
63c01f0f5b Merge branch '7.0.x' into text-utils-javacc 2022-07-17 17:06:37 +02:00
Clément Fournier
59d931cd91 Merge remote-tracking branch 'upstream/pmd/7.0.x' into text-utils-simple 2022-07-10 13:50:03 +02:00
Andreas Dangel
8248f6e4e1 Fix unit tests 2022-05-26 11:49:51 +02:00
Andreas Dangel
82dd4d46ca Merge branch 'master' into pmd/7.0.x 2022-05-26 11:21:38 +02:00
Clément Fournier
f80c73e44f Test dollar in ident in python 2022-05-01 18:56:45 +02:00
Clément Fournier
71b9362828 [python] unicode support
Fix #2604
2022-05-01 17:51:38 +02:00
Clément Fournier
474deca0e2 Fix cpd 2022-04-02 15:43:28 +02:00
Clément Fournier
20472d492d Merge branch 'text-utils-simple' into text-utils-javacc 2022-03-07 21:25:32 +01:00
Clément Fournier
f3454949d7 Fix build 2022-03-07 21:24:35 +01:00
Clément Fournier
8231542746 Merge branch 'text-utils-simple' into text-utils-javacc 2022-03-07 20:09:38 +01:00
Clément Fournier
3b8d7a32a7 Cleanups 2022-03-07 19:59:50 +01:00
Clément Fournier
f4f7f4b65d Move nspmd.util.document -> lang.document 2022-03-05 18:05:04 +01:00
Clément Fournier
fa31d54bd7 Fix tests 2021-07-08 19:11:20 +02:00
Andreas Dangel
f7909ae78a Merge branch 'master' into pr-2963-update 2021-01-21 11:43:01 +01:00
Andreas Dangel
c37f208d3e Call jjtree/javacc with UTF-8 as default encoding
Fixes #2970
2020-12-17 18:31:13 +01:00
Maikel Steneker
af31b3a773 Add GenericToken.getKind() to interface 2020-12-10 12:10:47 +01:00
Clément Fournier
c88919bbc7 Cleanup 2020-09-17 22:56:45 +02:00
Clément Fournier
3ee32effda Refactor token documents
Isolate static parts
2020-09-17 22:56:01 +02:00
Clément Fournier
155a895a93 Move charstream 2020-09-17 22:54:20 +02:00
Clément Fournier
e93e5b0a4c Move into .io package 2020-09-17 22:43:29 +02:00
Clément Fournier
95bac5eb95 Convert CharStream to class 2020-09-17 22:41:16 +02:00
Clément Fournier
b779abd08b Align cpd 2020-09-17 22:41:14 +02:00
Clément Fournier
2356f2f69d Use TextRegion in tokens 2020-09-17 22:29:59 +02:00
Andreas Dangel
2b1d071930 Fix tests due to endColumn changes 2020-08-21 12:38:37 +02:00
Andreas Dangel
ab489832fe Merge branch 'master' into pmd/7.0.x 2020-08-21 11:51:54 +02:00
Maikel Steneker
6fb5ac59b9 Ensure CPD uses tab width of 1 for tabs consistently
The columns that are reported by CPD were inconsistent across languages
before. A language like Java (using a JavaCC-based tokenizer) would use
a width of 8 for tabs, whereas a language like C# (using an Antlr-based
tokenizer) would use 1 instead.

This includes unit tests for most languages to ensure a tab character is
counted as 1. The configuration for JavaCC has been adjusted to respect
this as well.
2020-07-20 10:42:21 +02:00
Andreas Dangel
e4690cb56a Fix compile errors for CPD only languages 2020-07-17 15:04:43 +02:00
Clément Fournier
5b7ed588ea Make CPD end column exclusive
This is to align it with PMD columns,
which in 7.0 are already exclusive.
2020-06-19 02:21:45 +02:00
Clément Fournier
c49d9e315f Merge branch 'master' into 7.0.x 2020-06-19 01:32:32 +02:00
Clément Fournier
aedd2ce493 Convert python tests 2020-06-13 23:56:55 +02:00
Clément Fournier
f64acb6c38 python 2020-03-20 18:07:56 +01:00
Clément Fournier
3cdcba2299 Fix file name for token manager error 2020-03-20 18:07:56 +01:00
Andreas Dangel
b487ef94d0 [python] Deprecate/Internalize PythonTokenManager
Refs #2293
2020-03-13 10:30:43 +01:00
Clément Fournier
57429b0ff9 Fix class cast exception 2020-02-17 01:43:08 +01:00
Clément Fournier
579c134061 Port python module 2020-02-16 22:27:09 +01:00
Clément Fournier
d90d5d267c Remove trailing whitespace everywhere 2020-01-24 23:40:06 +01:00
Andreas Dangel
b02ab00e87 Merge remote-tracking branch 'origin/master' into pmd/7.0.x 2020-01-24 19:18:17 +01:00
Andreas Dangel
5feca7fd93 Exclude generated AST*.java files from internalization 2020-01-24 16:19:24 +01:00
Clément Fournier
60e97d0ec8 Deprecate javacc generated code 2020-01-22 17:19:29 +01:00
Clément Fournier
99700d7526 Extract changes from #2166 to 7.0.x
* Make Java nodes text-available
* Introduce shared JavaccToken in pmd-core
* Use factory to produce char streams

Tests are still on java-grammar,
since they use the DSL & newer
AST structure.

This is to prepare for other changes
that concern all javacc languages and
should not be done on java-grammar
2020-01-10 21:15:15 +01:00
Clément Fournier
1fe9c59212 Remove cpp lang 2019-09-24 06:15:34 +02:00
Andreas Dangel
47f8192764 Merge remote-tracking branch 'origin/master' into pmd/7.0.x 2019-05-11 12:03:08 +02:00
Maikel Steneker
a5b12a4e83 Added test case for Python backticks. 2019-04-29 14:01:03 +02:00
Clément Fournier
6d84530d52 Merge branch 'master' into 7.0.x 2019-02-18 19:32:55 +01:00
Andreas Dangel
89c8f47b2b Move JavaCCTokenizer to internal package 2019-01-26 19:19:46 +01:00
Andreas Dangel
08b7dd49dd [core] Add a generic JavaCCTokenizer for CPD 2019-01-26 11:24:32 +01:00
Andreas Dangel
b745f331b8 CPD: Fix error handling for lexical errors
* TokenMgrError must not be caught by the tokenizer. This is handled
  by CPD itself
* The token managers need to know the filename for proper error messages
2019-01-20 10:18:56 +01:00
Clément Fournier
12b647c548 Merge branch 'master' into 7.0.x
Conflicts:
	pmd-apex-jorje/pom.xml
	pmd-apex/pom.xml
	pmd-core/pom.xml
	pmd-core/src/main/java/net/sourceforge/pmd/lang/LanguageVersionHandler.java
	pmd-core/src/main/java/net/sourceforge/pmd/util/designer/Designer.java
	pmd-cpp/pom.xml
	pmd-cpp/src/main/java/net/sourceforge/pmd/lang/cpp/CppHandler.java
	pmd-cs/pom.xml
	pmd-dist/pom.xml
	pmd-doc/pom.xml
	pmd-fortran/pom.xml
	pmd-go/pom.xml
	pmd-groovy/pom.xml
	pmd-java/pom.xml
	pmd-java8/pom.xml
	pmd-javascript/pom.xml
	pmd-jsp/pom.xml
	pmd-kotlin/pom.xml
	pmd-lang-test/pom.xml
	pmd-matlab/pom.xml
	pmd-matlab/src/main/java/net/sourceforge/pmd/lang/matlab/MatlabHandler.java
	pmd-objectivec/pom.xml
	pmd-objectivec/src/main/java/net/sourceforge/pmd/lang/objectivec/ObjectiveCHandler.java
	pmd-perl/pom.xml
	pmd-php/pom.xml
	pmd-plsql/pom.xml
	pmd-python/pom.xml
	pmd-python/src/main/java/net/sourceforge/pmd/lang/python/PythonHandler.java
	pmd-ruby/pom.xml
	pmd-scala/pom.xml
	pmd-swift/pom.xml
	pmd-test/pom.xml
	pmd-ui/pom.xml
	pmd-visualforce/pom.xml
	pmd-vm/pom.xml
	pmd-xml/pom.xml
	pom.xml
2018-12-13 18:53:10 +01:00
Andreas Dangel
10e27ca3c0 Deprecate PMD LanguageModule for languages, that only support CPD 2018-11-26 13:55:35 +01:00
Clément Fournier
5eb1d23a38 Create system to declare processing stages in an extensible fashion 2018-11-02 07:39:16 +01:00