Skip to content
Projects
Groups
Snippets
Help
Loading...
Help
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
L
lmp_server
Project
Project
Details
Activity
Releases
Cycle Analytics
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Charts
Issues
0
Issues
0
List
Board
Labels
Milestones
Merge Requests
0
Merge Requests
0
CI / CD
CI / CD
Pipelines
Jobs
Schedules
Charts
Wiki
Wiki
Snippets
Snippets
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Charts
Create a new issue
Jobs
Commits
Issue Boards
Open sidebar
lmp
lmp_server
Commits
039f6610
Commit
039f6610
authored
Apr 09, 2024
by
pengxin
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
去掉清洗数据规则。
parent
aac5aa9d
Changes
2
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
1 addition
and
6 deletions
+1
-6
DatasetCleanServiceImpl.java
...ce/webadmin/app/service/impl/DatasetCleanServiceImpl.java
+1
-5
DataCleanerUtil.java
...main/java/com/yice/webadmin/app/util/DataCleanerUtil.java
+0
-1
No files found.
application-webadmin/src/main/java/com/yice/webadmin/app/service/impl/DatasetCleanServiceImpl.java
View file @
039f6610
...
...
@@ -312,15 +312,11 @@ public class DatasetCleanServiceImpl extends BaseService<DatasetClean, Long> imp
}
}
public
static
void
main
(
String
[]
args
)
{
readJsonAppendSymbol
(
"C:\\Users\\Administrator\\Desktop\\ee_V1.json"
);
}
/**
* 解析文件去掉多余的数据,比如文件里面最后一个,多加了一个",",缺少符号[]
* @param filePath 文件地址
*/
private
static
void
readJsonAppendSymbol
(
String
filePath
)
{
private
void
readJsonAppendSymbol
(
String
filePath
)
{
try
(
FileReader
fileReader
=
new
FileReader
(
filePath
);
BufferedReader
bufferedReader
=
new
BufferedReader
(
fileReader
))
{
...
...
application-webadmin/src/main/java/com/yice/webadmin/app/util/DataCleanerUtil.java
View file @
039f6610
...
...
@@ -25,7 +25,6 @@ public class DataCleanerUtil {
badWords
.
add
(
"色情"
);
badWords
.
add
(
"淫秽"
);
badWords
.
add
(
"迷信"
);
badWords
.
add
(
"黄色"
);
badWords
.
add
(
"性行为"
);
badWords
.
add
(
"暴力"
);
}
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment