You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Describe the bug
DocumentDB connector can't handle querying Document fields that nested. I defined a Glue Table for metadata and am trying to query a field in my DocumentDB collection that is several layers nested. I get the following error when trying to reference that field.
NOT_SUPPORTED: Unsupported Presto Type [row( array(row( varchar, varchar)), row( varchar, array(row( varchar, bigint, varchar, varchar)), double))] in Lambda Data Source
I think its having an issue when translating the types from the glue table schema and ending up with row type within a row.
This schema works when derived using Schema inference but not when using Glue table metadata.
To Reproduce
Steps to reproduce the behavior:
Deploy Athena DocumentDB Connector
Put data in DocumentDB Collection that is multiple layers deep.
Define explicit schema in Glue for connector to use.
Execute athena query that references field with nested levels like a where field is not null clause.
See error
Expected behavior
Data to be returned and no error
Screenshots / Exceptions / Errors
If applicable, add screenshots, exception stack traces, or error messages to help explain your problem. Stack traces for exceptions thrown by your Connector can be found in CloudWatch Logs under the 'aws/lambda/<Lambda_function_name>' log group.
Connector Details (please complete the following information):
Version: 2024.33.1
Name: DocumentDB
Athena Query IDs : can provide if needed.
Additional context
The text was updated successfully, but these errors were encountered:
Describe the bug
DocumentDB connector can't handle querying Document fields that nested. I defined a Glue Table for metadata and am trying to query a field in my DocumentDB collection that is several layers nested. I get the following error when trying to reference that field.
NOT_SUPPORTED: Unsupported Presto Type [row( array(row( varchar, varchar)), row( varchar, array(row( varchar, bigint, varchar, varchar)), double))] in Lambda Data Source
I think its having an issue when translating the types from the glue table schema and ending up with row type within a row.
This schema works when derived using Schema inference but not when using Glue table metadata.
To Reproduce
Steps to reproduce the behavior:
Expected behavior
Data to be returned and no error
Screenshots / Exceptions / Errors
If applicable, add screenshots, exception stack traces, or error messages to help explain your problem. Stack traces for exceptions thrown by your Connector can be found in CloudWatch Logs under the 'aws/lambda/<Lambda_function_name>' log group.
Connector Details (please complete the following information):
Additional context
The text was updated successfully, but these errors were encountered: