Skip to content
Projects
Groups
Snippets
Help
Loading...
Help
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
L
lmp_server
Project
Project
Details
Activity
Releases
Cycle Analytics
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Charts
Issues
0
Issues
0
List
Board
Labels
Milestones
Merge Requests
0
Merge Requests
0
CI / CD
CI / CD
Pipelines
Jobs
Schedules
Charts
Wiki
Wiki
Snippets
Snippets
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Charts
Create a new issue
Jobs
Commits
Issue Boards
Open sidebar
lmp
lmp_server
Commits
924d41e6
Commit
924d41e6
authored
Apr 12, 2024
by
pengxin
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
代码整理。
parent
5d9f2821
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
1 addition
and
7 deletions
+1
-7
DatasetVersionServiceImpl.java
.../webadmin/app/service/impl/DatasetVersionServiceImpl.java
+1
-7
No files found.
application-webadmin/src/main/java/com/yice/webadmin/app/service/impl/DatasetVersionServiceImpl.java
View file @
924d41e6
...
...
@@ -319,12 +319,9 @@ public class DatasetVersionServiceImpl extends BaseService<DatasetVersion, Long>
*/
@Override
public
boolean
saveDatasetJsonPath
(
DatasetVersion
datasetVersion
)
throws
IOException
{
//导入时不需要写入到json文件中
String
versionName
=
datasetVersion
.
getVersionName
();
//先存储文件
String
fullName
=
pythonConfig
.
getDatasetFileBaseDir
()
+
versionName
+
".json"
;
this
.
doDealTaskHandler
(
datasetVersion
.
getVersionId
(),
fullName
);
//再存储数据集配置文件
this
.
saveDatasetInfo
(
versionName
);
DatasetVersion
filter
=
new
DatasetVersion
();
filter
.
setVersionId
(
datasetVersion
.
getVersionId
());
...
...
@@ -335,11 +332,8 @@ public class DatasetVersionServiceImpl extends BaseService<DatasetVersion, Long>
/**
* ==============================
* ===总数据清洗过程===
* 1、分页处理每页10000条数据
* 2、更新Mongodb数据库中的数据
* 3、更新json存储地址的数据集数据
* 4、更新版本数据集状态
* 2、分别写入到json文件中
* ==============================
* 处理数据集
* @param datasetId 清洗任务id
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment