Column Name Issue in Pruning

[lindsayrblank]

Hi all,

I'm trying to prune a database. I'm using the first XML from Chapter 5 of the METviewer UG (Example 1). The only differences are no "model" field and I'm using "fcst_init_beg" instead of "fcst_valid_beg". I am getting the following error:

 java.sql.SQLSyntaxErrorException: (conn=129) Unknown column 'fcst_init_beg' in 'where clause'
	at org.mariadb.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:62)
	at org.mariadb.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:153)
	at org.mariadb.jdbc.MariaDbStatement.executeExceptionEpilogue(MariaDbStatement.java:274)
	at org.mariadb.jdbc.ClientSidePreparedStatement.executeInternal(ClientSidePreparedStatement.java:229)
	at org.mariadb.jdbc.ClientSidePreparedStatement.execute(ClientSidePreparedStatement.java:149)
	at org.mariadb.jdbc.ClientSidePreparedStatement.executeUpdate(ClientSidePreparedStatement.java:181)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.tomcat.jdbc.pool.StatementFacade$StatementProxy.invoke(StatementFacade.java:114)
	at com.sun.proxy.$Proxy2.executeUpdate(Unknown Source)
	at edu.ucar.metviewer.prune.PruneDbManagerMysql.deleteRows(Unknown Source)
	at edu.ucar.metviewer.prune.PruneDbManagerMysql.processTable(Unknown Source)
	at edu.ucar.metviewer.prune.PruneDbManagerMysql.pruneData(Unknown Source)
	at edu.ucar.metviewer.prune.MVPruneDB.main(Unknown Source)

I know that "fcst_init_beg" is a valid column name and my syntax is the same as the UG example. I'm running METviewer 4.1 on AWS. Any help would be greatly appreciated!

Best,
Lindsay

[TatianaBurek]

Lindsay
In order to replicate your problem I created XML file with

<fields>
  <field name="fcst_init_beg">
    <value_range>
      <start>2012-04-09 00:00:00</start>
      <end>2012-04-09 06:00:00</end>
    </value_range>
  </field>
</fields>

During the execution I had a few errors like this:

java.sql.SQLSyntaxErrorException: (conn=7499) Unknown column 'fcst_init_beg' in 'where clause'
Field fcst_init_beg is not in table 'mode_cts'. Skipping this table

This is normal and indicates that this table was skipped because mode_cts doesn't have fcst_init_beg.

Did your execution finish with
---- MVPruneDB Done ----
message?

[lindsayrblank]

Absolutely. I've removed the details from the connection setting, but everything else is the same.

<prune_spec>
  <connection>
    <host></host>
    <database></database>
    <user></user>
    <password></password>
  </connection>

  <info_only>false</info_only>

  <fields>
    <field name="fcst_init_beg">
      <value_range>
        <start>2022-03-01 00:00:00</start>
        <end>2022-06-30 12:00:00</end>
      </value_range>
    </field>
  </fields>
</prune_spec>                                         

[TatianaBurek]

I can't reproduce your error on our server.
Would you be able to provide the schema of the database that you have problems with?
To do that you need to run this command:
mysqldump --no-data -u<db_user_name> -p<db_user_pwd> <database_name> > schema.sql

[lindsayrblank]

Hi Tatiana, can I send the schema to you via email? It's quite long.

[jprestop]

Hi @lindsayrblank. I was reviewing the unanswered Discussions and noticed this one. Please upload your schema to our ftp server following the directions in the How to Send Us Data post and let me know once you have so that I can grab it. @TatianaBurek is out through 10/5. Is there any specific timeline you have for this work?

[lindsayrblank]

No timeline, sorry this took me so long to respond to! I've uploaded the database schema via ftp.

[TatianaBurek]

Sure

…

On Wed, Sep 21, 2022, 15:43 Lindsay Blank ***@***.***> wrote: Hi Tatiana, can I send the schema to you via email? It's quite long. — Reply to this email directly, view it on GitHub <#1775 (reply in thread)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AFC3TUD266WPWMT7NCFUZ6DV7N6PPANCNFSM6AAAAAAQCXQIWE> . You are receiving this because you commented.Message ID: ***@***.***>

[jprestop]

@TatianaBurek Since @lindsayrblank put her schema on the ftp server, I grabbed it for you and sent it to you via email. It is also available at /scratch/WEEKLY/jpresto/schema.sql.

[TatianaBurek]

Hi Lindsay
I created a database using your schema and executed pruning with the XML file similar to yours.
I did not see any unexpected errors and the execution finished with the message
---- MVPruneDB Done ----
I am not sure how to reproduce the error that you see. Do you know which version of Java do you use?

[lindsayrblank]

We are using OpenJDK 1.8.0

[TatianaBurek]

@lindsayrblank
Do you still need help with this issue?

[lindsayrblank]

No, thank you for your help. If it comes up again, I will reach out.