Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG] Unsupported Presto type error when using Glue table for metadata with connector DocDB #2378

Open
aidanasal opened this issue Nov 5, 2024 · 0 comments
Labels
bug Something isn't working

Comments

@aidanasal
Copy link

Describe the bug
DocumentDB connector can't handle querying Document fields that nested. I defined a Glue Table for metadata and am trying to query a field in my DocumentDB collection that is several layers nested. I get the following error when trying to reference that field.

NOT_SUPPORTED: Unsupported Presto Type [row( array(row( varchar, varchar)), row( varchar, array(row( varchar, bigint, varchar, varchar)), double))] in Lambda Data Source

I think its having an issue when translating the types from the glue table schema and ending up with row type within a row.

This schema works when derived using Schema inference but not when using Glue table metadata.

To Reproduce
Steps to reproduce the behavior:

  1. Deploy Athena DocumentDB Connector
  2. Put data in DocumentDB Collection that is multiple layers deep.
  3. Define explicit schema in Glue for connector to use.
  4. Execute athena query that references field with nested levels like a where field is not null clause.
  5. See error

Expected behavior
Data to be returned and no error

Screenshots / Exceptions / Errors
If applicable, add screenshots, exception stack traces, or error messages to help explain your problem. Stack traces for exceptions thrown by your Connector can be found in CloudWatch Logs under the 'aws/lambda/<Lambda_function_name>' log group.

Connector Details (please complete the following information):

  • Version: 2024.33.1
  • Name: DocumentDB
  • Athena Query IDs : can provide if needed.

Additional context

@aidanasal aidanasal added the bug Something isn't working label Nov 5, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant