Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix rank issue, add metadata support and debug mode, add wrf, openfoam, lammps jarvis packages, clean the code and add cmake flags #45

Merged
merged 121 commits into from
Feb 5, 2024

Conversation

hxu65
Copy link
Collaborator

@hxu65 hxu65 commented Nov 13, 2023

No description provided.

hxu65 and others added 30 commits November 1, 2023 14:27
@hxu65 hxu65 changed the title support metadata extraction of adios2 variable with spdlog fix rank issue, add metadata support and debug mode, add wrf, openfoam, lammps jarvis packages Feb 4, 2024
@hxu65 hxu65 changed the title fix rank issue, add metadata support and debug mode, add wrf, openfoam, lammps jarvis packages fix rank issue, add metadata support and debug mode, add wrf, openfoam, lammps jarvis packages, clean the code and add cmake flags Feb 5, 2024
Copy link
Member

@JaimeCernuda JaimeCernuda left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@hxu65 you need to look into some of the comments, you need to either delete them or put them around a #ifdef debug if you want to

README.md Show resolved Hide resolved
char* errMsg = 0;
int rc = sqlite3_exec(db, sql.c_str(), callbackFunc, data, &errMsg);
if (rc != SQLITE_OK) {
std::cerr << "SQL error: " << errMsg << std::endl;
//std::cerr << "MDM: SQL error: " << errMsg << std::endl;
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@hxu65 this is an error report, this can be left in, also dont comment stuff

@@ -52,6 +58,7 @@ class SQLiteWrapper {
createAppsTable();
createBlobLocationsTable();
createVariableMetadataTable();
// std::cout << "MDM: table METADATA: " << getpid() << " "<< dbName << std::endl;
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@hxu65 again, either put them around a debug if def or remove, dont keep coments

order = GetCount;
GetCount++;
GetMap[name].push_back(GetCount);
}
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@hxu65 big comment herer, please delete

#include "globalVariable.h"

//____________Hua_______________
// this the variable metadata structure, it can collect the variable metadata information
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@hxu65 clear the grammar, and remove the name

@@ -44,13 +44,29 @@ struct ConstructTask : public CreateTaskStateTask {
: CreateTaskStateTask(alloc, task_node, domain_id, state_name,
"coeus_mdm", id, queue_info) {
// Custom params
// std::cout << "Constructor path: " << db_path << std::endl;
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@hxu65 comments

@@ -94,6 +110,7 @@ struct Mdm_insertTask : public Task, TaskFlags<TF_LOCAL> {
const TaskStateId &state_id,
const DbOperation &db_op) : Task(alloc) {
// Initialize task
//std::cout << "MDM: task insertion creation" << std::endl;
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@hxu65 comments

db = std::make_unique<SQLiteWrapper>(task->db_path_->str());

//std::cout << "MDM: mdm task constructor: " << task->db_path_->str() << std::endl;
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@hxu65 comments

db->UpdateTotalSteps(db_op.uid, db_op.currentStep);
//std::cout << "MDM: Hermes update MDM done " << std::endl;
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@hxu65 comments

add_subdirectory(io_comp)
add_subdirectory(operator_comp)
#add_subdirectory(io_comp)
#add_subdirectory(operator_comp)
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@hxu65 why is this commented out?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

io_comp and operator_comp cause adios2 undefined function error occasionally, commenting them out can solve this issue.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

can you document this in an issue

add_subdirectory(io_comp)
add_subdirectory(operator_comp)
#add_subdirectory(io_comp)
#add_subdirectory(operator_comp)
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

can you document this in an issue

@JaimeCernuda JaimeCernuda merged commit b56771e into master Feb 5, 2024
1 check failed
@JaimeCernuda JaimeCernuda deleted the ML-assist branch February 5, 2024 20:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants