Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

CDC MySQL Source: Append-only syncs fail with binlog deserialization errors while append+dedupe works fine #50856

Open
1 task
rtol5 opened this issue Jan 2, 2025 · 0 comments
Open
1 task

CDC MySQL Source: Append-only syncs fail with binlog deserialization errors while append+dedupe works fine #50856

rtol5 opened this issue Jan 2, 2025 · 0 comments
Labels
area/connectors Connector related issues autoteam cdc community connectors/source/mysql team/db-dw-sources Backlog for Database and Data Warehouse Sources team type/bug Something isn't working

Comments

@rtol5
Copy link

rtol5 commented Jan 2, 2025 •
edited
Loading

Connector Name

source-mysql

Connector Version

3.9.4

What step the error happened?

During the sync

Relevant information

Description

We're experiencing consistent failures in our MySQL CDC append-only pipeline, while an identical append+dedupe pipeline (using the same source/settings) works without issues. The failures manifest as binlog deserialization errors, specifically when processing UPDATE events.

Environment

  • Airbyte Version: [Your version]
  • Source: MySQL
  • Destination: Snowflake
  • Deployment: OSS
  • Connection Method: CDC/Binlog

Configuration

We have two pipelines:

  1. Append-only pipeline (fails)
  2. Append+dedupe pipeline (works)

Both pipelines:

  • Use identical source configurations
  • Read from the same MySQL tables
  • Run during low-traffic hours
  • Have the same sync frequency (daily)
  • MySQL has a 3-day binlog retention period

Error Details

The sync fails with:

Failed to deserialize data of EventHeaderV4{timestamp=1735819981000, eventType=EXT_UPDATE_ROWS, serverId=1856999076, headerLength=19, dataLength=782, nextPosition=2351002, flags=0}
Root cause:
java.io.EOFException: Failed to read remaining 21 of 27 bytes from position 13910349. Block length: 184. Initial block length: 782.

This appears to be a buffer management issue in the append-only implementation rather than actual binlog corruption because:

  1. The error occurs at precise byte boundaries
  2. The identical append+dedupe pipeline never experiences these issues
  3. The failures happen during low-traffic periods
  4. Our binlog retention period (3 days) ensures logs aren't being purged
  5. The error specifically occurs when processing UPDATE events

Steps to Reproduce

  1. Set up a MySQL CDC source connector
  2. Set up a Snowflake destination connector
  3. Create two connections with identical settings except:
    • Connection 1: Use append-only mode
    • Connection 2: Use append+dedupe mode
  4. Run syncs
    • Append+dedupe sync completes successfully
    • Append-only sync fails with deserialization errors

Additional Context

The error suggests this might be related to how the append-only implementation handles UPDATE events in its streaming buffer, different from the buffering mechanism used in append+dedupe mode.

Impact

This is making it impossible to keep running our append-only pipeline, which is critical as a changelog.

Relevant log output

2025-01-02 12:26:39 destination ERROR Jan 02, 2025 8:26:39 PM net.snowflake.client.jdbc.SnowflakeConnectionV1 initConnectionWithImpl
2025-01-02 12:26:39 destination ERROR : Initializing new connection
2025-01-02 12:26:40 destination ERROR Jan 02, 2025 8:26:39 PM net.snowflake.client.core.SFSession open
2025-01-02 12:26:40 destination ERROR : Opening session with server: https://uhb00206.snowflakecomputing.com:443/, account: uhb00206, user: AIRBYTE_USER, password is provided, role: AIRBYTE_ROLE, database: AIRBYTE_DATABASE, schema: AIRBYTE_SCHEMA, warehouse: DATA_LOADING_WAREHOUSE, validate default parameters: null, authenticator: null, ocsp mode: FAIL_OPEN, passcode in password: null, passcode is not provided, private key is not provided, disable socks proxy: null, application: airbyte_oss, app id: JDBC, app version: 3.20.0, login timeout: null, retry timeout: null, network timeout: 60, query timeout: null, connection timeout: null, socket timeout: null, tracing: null, private key file: null, private key pwd is not provided, enable_diagnostics: not provided, diagnostics_allowlist_path: null, session parameters: client store temporary credential: null, gzip disabled: null, browser response timeout: null
2025-01-02 12:26:40 destination ERROR Jan 02, 2025 8:26:40 PM net.snowflake.client.core.SFBaseSession logHttpClientInitInfo
2025-01-02 12:26:40 destination ERROR : Driver OCSP mode: FAIL_OPEN, gzip disabled: false and no proxy
2025-01-02 12:26:40 destination ERROR Jan 02, 2025 8:26:40 PM net.snowflake.client.core.SFSession open
2025-01-02 12:26:40 destination ERROR : Connecting to GLOBAL Snowflake domain
2025-01-02 12:26:40 destination ERROR Jan 02, 2025 8:26:40 PM net.snowflake.client.core.FileUtil logFileUsage
2025-01-02 12:26:40 destination ERROR : Cache file creation: Accessing file: /root/.cache/snowflake/ocsp_response_cache.json
2025-01-02 12:26:40 destination ERROR Jan 02, 2025 8:26:40 PM net.snowflake.client.core.FileUtil logFileUsage
2025-01-02 12:26:40 destination ERROR : Read cache: Accessing file: /root/.cache/snowflake/ocsp_response_cache.json
2025-01-02 12:26:40 destination ERROR Jan 02, 2025 8:26:40 PM net.snowflake.client.core.FileUtil logFileUsage
2025-01-02 12:26:40 destination ERROR : Write to cache: Accessing file: /root/.cache/snowflake/ocsp_response_cache.json
2025-01-02 12:26:40 destination ERROR Jan 02, 2025 8:26:40 PM net.snowflake.client.core.SFSession open
2025-01-02 12:26:40 destination ERROR : Session 1220488122093906 opened in 789 ms.
2025-01-02 12:26:40 destination ERROR Jan 02, 2025 8:26:40 PM net.snowflake.client.jdbc.SnowflakeConnectionV1 initConnectionWithImpl
2025-01-02 12:26:40 destination ERROR : Connection initialized successfully in 803 ms. Session id: 1220488122093906
2025-01-02 12:26:40 destination ERROR Jan 02, 2025 8:26:40 PM net.snowflake.client.jdbc.SnowflakeConnectionV1 initConnectionWithImpl
2025-01-02 12:26:40 destination ERROR : Initializing new connection
2025-01-02 12:26:40 destination ERROR Jan 02, 2025 8:26:40 PM net.snowflake.client.core.SFSession open
2025-01-02 12:26:40 destination ERROR : Opening session with server: https://uhb00206.snowflakecomputing.com:443/, account: uhb00206, user: AIRBYTE_USER, password is provided, role: AIRBYTE_ROLE, database: AIRBYTE_DATABASE, schema: AIRBYTE_SCHEMA, warehouse: DATA_LOADING_WAREHOUSE, validate default parameters: null, authenticator: null, ocsp mode: FAIL_OPEN, passcode in password: null, passcode is not provided, private key is not provided, disable socks proxy: null, application: airbyte_oss, app id: JDBC, app version: 3.20.0, login timeout: null, retry timeout: null, network timeout: 60, query timeout: null, connection timeout: null, socket timeout: null, tracing: null, private key file: null, private key pwd is not provided, enable_diagnostics: not provided, diagnostics_allowlist_path: null, session parameters: client store temporary credential: null, gzip disabled: null, browser response timeout: null
2025-01-02 12:26:40 destination ERROR Jan 02, 2025 8:26:40 PM net.snowflake.client.core.SFBaseSession logHttpClientInitInfo
2025-01-02 12:26:40 destination ERROR : Driver OCSP mode: FAIL_OPEN, gzip disabled: false and no proxy
2025-01-02 12:26:40 destination ERROR Jan 02, 2025 8:26:40 PM net.snowflake.client.core.SFSession open
2025-01-02 12:26:40 destination ERROR : Connecting to GLOBAL Snowflake domain
2025-01-02 12:26:41 destination ERROR Jan 02, 2025 8:26:41 PM net.snowflake.client.core.SFSession open
2025-01-02 12:26:41 destination ERROR : Session 1220488122097774 opened in 156 ms.
2025-01-02 12:26:41 destination ERROR Jan 02, 2025 8:26:41 PM net.snowflake.client.jdbc.SnowflakeConnectionV1 initConnectionWithImpl
2025-01-02 12:26:41 destination ERROR : Connection initialized successfully in 158 ms. Session id: 1220488122097774
2025-01-02 12:26:41 destination ERROR Jan 02, 2025 8:26:41 PM net.snowflake.client.jdbc.SnowflakeConnectionV1 initConnectionWithImpl
2025-01-02 12:26:41 destination ERROR : Initializing new connection
2025-01-02 12:26:41 destination ERROR Jan 02, 2025 8:26:41 PM net.snowflake.client.core.SFSession open
2025-01-02 12:26:41 destination ERROR : Opening session with server: https://uhb00206.snowflakecomputing.com:443/, account: uhb00206, user: AIRBYTE_USER, password is provided, role: AIRBYTE_ROLE, database: AIRBYTE_DATABASE, schema: AIRBYTE_SCHEMA, warehouse: DATA_LOADING_WAREHOUSE, validate default parameters: null, authenticator: null, ocsp mode: FAIL_OPEN, passcode in password: null, passcode is not provided, private key is not provided, disable socks proxy: null, application: airbyte_oss, app id: JDBC, app version: 3.20.0, login timeout: null, retry timeout: null, network timeout: 60, query timeout: null, connection timeout: null, socket timeout: null, tracing: null, private key file: null, private key pwd is not provided, enable_diagnostics: not provided, diagnostics_allowlist_path: null, session parameters: client store temporary credential: null, gzip disabled: null, browser response timeout: null
2025-01-02 12:26:41 destination ERROR Jan 02, 2025 8:26:41 PM net.snowflake.client.core.SFBaseSession logHttpClientInitInfo
2025-01-02 12:26:41 destination ERROR : Driver OCSP mode: FAIL_OPEN, gzip disabled: false and no proxy
2025-01-02 12:26:41 destination ERROR Jan 02, 2025 8:26:41 PM net.snowflake.client.core.SFSession open
2025-01-02 12:26:41 destination ERROR : Connecting to GLOBAL Snowflake domain
2025-01-02 12:26:41 destination ERROR Jan 02, 2025 8:26:41 PM net.snowflake.client.core.SFSession open
2025-01-02 12:26:41 destination ERROR : Session 1220488122093910 opened in 77 ms.
2025-01-02 12:26:41 destination ERROR Jan 02, 2025 8:26:41 PM net.snowflake.client.jdbc.SnowflakeConnectionV1 initConnectionWithImpl
2025-01-02 12:26:41 destination ERROR : Connection initialized successfully in 79 ms. Session id: 1220488122093910
2025-01-02 12:26:41 destination ERROR Jan 02, 2025 8:26:41 PM net.snowflake.client.jdbc.SnowflakeConnectionV1 initConnectionWithImpl
2025-01-02 12:26:41 destination ERROR : Initializing new connection
2025-01-02 12:26:41 destination ERROR Jan 02, 2025 8:26:41 PM net.snowflake.client.core.SFSession open
2025-01-02 12:26:41 destination ERROR : Opening session with server: https://uhb00206.snowflakecomputing.com:443/, account: uhb00206, user: AIRBYTE_USER, password is provided, role: AIRBYTE_ROLE, database: AIRBYTE_DATABASE, schema: AIRBYTE_SCHEMA, warehouse: DATA_LOADING_WAREHOUSE, validate default parameters: null, authenticator: null, ocsp mode: FAIL_OPEN, passcode in password: null, passcode is not provided, private key is not provided, disable socks proxy: null, application: airbyte_oss, app id: JDBC, app version: 3.20.0, login timeout: null, retry timeout: null, network timeout: 60, query timeout: null, connection timeout: null, socket timeout: null, tracing: null, private key file: null, private key pwd is not provided, enable_diagnostics: not provided, diagnostics_allowlist_path: null, session parameters: client store temporary credential: null, gzip disabled: null, browser response timeout: null
2025-01-02 12:26:41 destination ERROR Jan 02, 2025 8:26:41 PM net.snowflake.client.core.SFBaseSession logHttpClientInitInfo
2025-01-02 12:26:41 destination ERROR : Driver OCSP mode: FAIL_OPEN, gzip disabled: false and no proxy
2025-01-02 12:26:41 destination ERROR Jan 02, 2025 8:26:41 PM net.snowflake.client.core.SFSession open
2025-01-02 12:26:41 destination ERROR : Connecting to GLOBAL Snowflake domain
2025-01-02 12:26:41 destination ERROR Jan 02, 2025 8:26:41 PM net.snowflake.client.core.SFSession open
2025-01-02 12:26:41 destination ERROR : Session 1220488122097778 opened in 94 ms.
2025-01-02 12:26:41 destination ERROR Jan 02, 2025 8:26:41 PM net.snowflake.client.jdbc.SnowflakeConnectionV1 initConnectionWithImpl
2025-01-02 12:26:41 destination ERROR : Connection initialized successfully in 96 ms. Session id: 1220488122097778
2025-01-02 12:26:41 destination ERROR Jan 02, 2025 8:26:41 PM net.snowflake.client.jdbc.SnowflakeConnectionV1 initConnectionWithImpl
2025-01-02 12:26:41 destination ERROR : Initializing new connection
2025-01-02 12:26:41 destination ERROR Jan 02, 2025 8:26:41 PM net.snowflake.client.core.SFSession open
2025-01-02 12:26:41 destination ERROR : Opening session with server: https://uhb00206.snowflakecomputing.com:443/, account: uhb00206, user: AIRBYTE_USER, password is provided, role: AIRBYTE_ROLE, database: AIRBYTE_DATABASE, schema: AIRBYTE_SCHEMA, warehouse: DATA_LOADING_WAREHOUSE, validate default parameters: null, authenticator: null, ocsp mode: FAIL_OPEN, passcode in password: null, passcode is not provided, private key is not provided, disable socks proxy: null, application: airbyte_oss, app id: JDBC, app version: 3.20.0, login timeout: null, retry timeout: null, network timeout: 60, query timeout: null, connection timeout: null, socket timeout: null, tracing: null, private key file: null, private key pwd is not provided, enable_diagnostics: not provided, diagnostics_allowlist_path: null, session parameters: client store temporary credential: null, gzip disabled: null, browser response timeout: null
2025-01-02 12:26:41 destination ERROR Jan 02, 2025 8:26:41 PM net.snowflake.client.core.SFBaseSession logHttpClientInitInfo
2025-01-02 12:26:41 destination ERROR : Driver OCSP mode: FAIL_OPEN, gzip disabled: false and no proxy
2025-01-02 12:26:41 destination ERROR Jan 02, 2025 8:26:41 PM net.snowflake.client.core.SFSession open
2025-01-02 12:26:41 destination ERROR : Connecting to GLOBAL Snowflake domain
2025-01-02 12:26:41 destination ERROR Jan 02, 2025 8:26:41 PM net.snowflake.client.core.SFSession open
2025-01-02 12:26:41 destination ERROR : Session 1220488122093914 opened in 103 ms.
2025-01-02 12:26:41 destination ERROR Jan 02, 2025 8:26:41 PM net.snowflake.client.jdbc.SnowflakeConnectionV1 initConnectionWithImpl
2025-01-02 12:26:41 destination ERROR : Connection initialized successfully in 105 ms. Session id: 1220488122093914
2025-01-02 12:26:41 destination ERROR Jan 02, 2025 8:26:41 PM net.snowflake.client.jdbc.SnowflakeConnectionV1 initConnectionWithImpl
2025-01-02 12:26:41 destination ERROR : Initializing new connection
2025-01-02 12:26:41 destination ERROR Jan 02, 2025 8:26:41 PM net.snowflake.client.core.SFSession open
2025-01-02 12:26:41 destination ERROR : Opening session with server: https://uhb00206.snowflakecomputing.com:443/, account: uhb00206, user: AIRBYTE_USER, password is provided, role: AIRBYTE_ROLE, database: AIRBYTE_DATABASE, schema: AIRBYTE_SCHEMA, warehouse: DATA_LOADING_WAREHOUSE, validate default parameters: null, authenticator: null, ocsp mode: FAIL_OPEN, passcode in password: null, passcode is not provided, private key is not provided, disable socks proxy: null, application: airbyte_oss, app id: JDBC, app version: 3.20.0, login timeout: null, retry timeout: null, network timeout: 60, query timeout: null, connection timeout: null, socket timeout: null, tracing: null, private key file: null, private key pwd is not provided, enable_diagnostics: not provided, diagnostics_allowlist_path: null, session parameters: client store temporary credential: null, gzip disabled: null, browser response timeout: null
2025-01-02 12:26:41 destination ERROR Jan 02, 2025 8:26:41 PM net.snowflake.client.core.SFBaseSession logHttpClientInitInfo
2025-01-02 12:26:41 destination ERROR : Driver OCSP mode: FAIL_OPEN, gzip disabled: false and no proxy
2025-01-02 12:26:41 destination ERROR Jan 02, 2025 8:26:41 PM net.snowflake.client.core.SFSession open
2025-01-02 12:26:41 destination ERROR : Connecting to GLOBAL Snowflake domain
2025-01-02 12:26:41 destination ERROR Jan 02, 2025 8:26:41 PM net.snowflake.client.core.SFSession open
2025-01-02 12:26:41 destination ERROR : Session 1220488122097782 opened in 92 ms.
2025-01-02 12:26:41 destination ERROR Jan 02, 2025 8:26:41 PM net.snowflake.client.jdbc.SnowflakeConnectionV1 initConnectionWithImpl
2025-01-02 12:26:41 destination ERROR : Connection initialized successfully in 94 ms. Session id: 1220488122097782
2025-01-02 12:26:41 destination ERROR Jan 02, 2025 8:26:41 PM net.snowflake.client.jdbc.SnowflakeConnectionV1 initConnectionWithImpl
2025-01-02 12:26:41 destination ERROR : Initializing new connection
2025-01-02 12:26:41 destination ERROR Jan 02, 2025 8:26:41 PM net.snowflake.client.core.SFSession open
2025-01-02 12:26:41 destination ERROR : Opening session with server: https://uhb00206.snowflakecomputing.com:443/, account: uhb00206, user: AIRBYTE_USER, password is provided, role: AIRBYTE_ROLE, database: AIRBYTE_DATABASE, schema: AIRBYTE_SCHEMA, warehouse: DATA_LOADING_WAREHOUSE, validate default parameters: null, authenticator: null, ocsp mode: FAIL_OPEN, passcode in password: null, passcode is not provided, private key is not provided, disable socks proxy: null, application: airbyte_oss, app id: JDBC, app version: 3.20.0, login timeout: null, retry timeout: null, network timeout: 60, query timeout: null, connection timeout: null, socket timeout: null, tracing: null, private key file: null, private key pwd is not provided, enable_diagnostics: not provided, diagnostics_allowlist_path: null, session parameters: client store temporary credential: null, gzip disabled: null, browser response timeout: null
2025-01-02 12:26:41 destination ERROR Jan 02, 2025 8:26:41 PM net.snowflake.client.core.SFBaseSession logHttpClientInitInfo
2025-01-02 12:26:41 destination ERROR : Driver OCSP mode: FAIL_OPEN, gzip disabled: false and no proxy
2025-01-02 12:26:41 destination ERROR Jan 02, 2025 8:26:41 PM net.snowflake.client.core.SFSession open
2025-01-02 12:26:41 destination ERROR : Connecting to GLOBAL Snowflake domain
2025-01-02 12:26:41 destination ERROR Jan 02, 2025 8:26:41 PM net.snowflake.client.core.SFSession open
2025-01-02 12:26:41 destination ERROR : Session 1220488122093918 opened in 92 ms.
2025-01-02 12:26:41 destination ERROR Jan 02, 2025 8:26:41 PM net.snowflake.client.jdbc.SnowflakeConnectionV1 initConnectionWithImpl
2025-01-02 12:26:41 destination ERROR : Connection initialized successfully in 94 ms. Session id: 1220488122093918
2025-01-02 12:26:41 destination ERROR Jan 02, 2025 8:26:41 PM net.snowflake.client.jdbc.SnowflakeConnectionV1 initConnectionWithImpl
2025-01-02 12:26:41 destination ERROR : Initializing new connection
2025-01-02 12:26:41 destination ERROR Jan 02, 2025 8:26:41 PM net.snowflake.client.core.SFSession open
2025-01-02 12:26:41 destination ERROR : Opening session with server: https://uhb00206.snowflakecomputing.com:443/, account: uhb00206, user: AIRBYTE_USER, password is provided, role: AIRBYTE_ROLE, database: AIRBYTE_DATABASE, schema: AIRBYTE_SCHEMA, warehouse: DATA_LOADING_WAREHOUSE, validate default parameters: null, authenticator: null, ocsp mode: FAIL_OPEN, passcode in password: null, passcode is not provided, private key is not provided, disable socks proxy: null, application: airbyte_oss, app id: JDBC, app version: 3.20.0, login timeout: null, retry timeout: null, network timeout: 60, query timeout: null, connection timeout: null, socket timeout: null, tracing: null, private key file: null, private key pwd is not provided, enable_diagnostics: not provided, diagnostics_allowlist_path: null, session parameters: client store temporary credential: null, gzip disabled: null, browser response timeout: null
2025-01-02 12:26:41 destination ERROR Jan 02, 2025 8:26:41 PM net.snowflake.client.core.SFBaseSession logHttpClientInitInfo
2025-01-02 12:26:41 destination ERROR : Driver OCSP mode: FAIL_OPEN, gzip disabled: false and no proxy
2025-01-02 12:26:41 destination ERROR Jan 02, 2025 8:26:41 PM net.snowflake.client.core.SFSession open
2025-01-02 12:26:41 destination ERROR : Connecting to GLOBAL Snowflake domain
2025-01-02 12:26:41 destination ERROR Jan 02, 2025 8:26:41 PM net.snowflake.client.core.SFSession open
2025-01-02 12:26:41 destination ERROR : Session 1220488122097786 opened in 100 ms.
2025-01-02 12:26:41 destination ERROR Jan 02, 2025 8:26:41 PM net.snowflake.client.jdbc.SnowflakeConnectionV1 initConnectionWithImpl
2025-01-02 12:26:41 destination ERROR : Connection initialized successfully in 101 ms. Session id: 1220488122097786
2025-01-02 12:26:41 destination ERROR Jan 02, 2025 8:26:41 PM net.snowflake.client.jdbc.SnowflakeConnectionV1 initConnectionWithImpl
2025-01-02 12:26:41 destination ERROR : Initializing new connection
2025-01-02 12:26:41 destination ERROR Jan 02, 2025 8:26:41 PM net.snowflake.client.core.SFSession open
2025-01-02 12:26:41 destination ERROR : Opening session with server: https://uhb00206.snowflakecomputing.com:443/, account: uhb00206, user: AIRBYTE_USER, password is provided, role: AIRBYTE_ROLE, database: AIRBYTE_DATABASE, schema: AIRBYTE_SCHEMA, warehouse: DATA_LOADING_WAREHOUSE, validate default parameters: null, authenticator: null, ocsp mode: FAIL_OPEN, passcode in password: null, passcode is not provided, private key is not provided, disable socks proxy: null, application: airbyte_oss, app id: JDBC, app version: 3.20.0, login timeout: null, retry timeout: null, network timeout: 60, query timeout: null, connection timeout: null, socket timeout: null, tracing: null, private key file: null, private key pwd is not provided, enable_diagnostics: not provided, diagnostics_allowlist_path: null, session parameters: client store temporary credential: null, gzip disabled: null, browser response timeout: null
2025-01-02 12:26:41 destination ERROR Jan 02, 2025 8:26:41 PM net.snowflake.client.core.SFBaseSession logHttpClientInitInfo
2025-01-02 12:26:41 destination ERROR : Driver OCSP mode: FAIL_OPEN, gzip disabled: false and no proxy
2025-01-02 12:26:41 destination ERROR Jan 02, 2025 8:26:41 PM net.snowflake.client.core.SFSession open
2025-01-02 12:26:41 destination ERROR : Connecting to GLOBAL Snowflake domain
2025-01-02 12:26:41 destination ERROR Jan 02, 2025 8:26:41 PM net.snowflake.client.core.SFSession open
2025-01-02 12:26:41 destination ERROR : Session 1220488122093922 opened in 88 ms.
2025-01-02 12:26:41 destination ERROR Jan 02, 2025 8:26:41 PM net.snowflake.client.jdbc.SnowflakeConnectionV1 initConnectionWithImpl
2025-01-02 12:26:41 destination ERROR : Connection initialized successfully in 90 ms. Session id: 1220488122093922
2025-01-02 12:26:41 destination ERROR Jan 02, 2025 8:26:41 PM net.snowflake.client.jdbc.SnowflakeConnectionV1 initConnectionWithImpl
2025-01-02 12:26:41 destination ERROR : Initializing new connection
2025-01-02 12:26:41 destination ERROR Jan 02, 2025 8:26:41 PM net.snowflake.client.core.SFSession open
2025-01-02 12:26:41 destination ERROR : Opening session with server: https://uhb00206.snowflakecomputing.com:443/, account: uhb00206, user: AIRBYTE_USER, password is provided, role: AIRBYTE_ROLE, database: AIRBYTE_DATABASE, schema: AIRBYTE_SCHEMA, warehouse: DATA_LOADING_WAREHOUSE, validate default parameters: null, authenticator: null, ocsp mode: FAIL_OPEN, passcode in password: null, passcode is not provided, private key is not provided, disable socks proxy: null, application: airbyte_oss, app id: JDBC, app version: 3.20.0, login timeout: null, retry timeout: null, network timeout: 60, query timeout: null, connection timeout: null, socket timeout: null, tracing: null, private key file: null, private key pwd is not provided, enable_diagnostics: not provided, diagnostics_allowlist_path: null, session parameters: client store temporary credential: null, gzip disabled: null, browser response timeout: null
2025-01-02 12:26:41 destination ERROR Jan 02, 2025 8:26:41 PM net.snowflake.client.core.SFBaseSession logHttpClientInitInfo
2025-01-02 12:26:41 destination ERROR : Driver OCSP mode: FAIL_OPEN, gzip disabled: false and no proxy
2025-01-02 12:26:41 destination ERROR Jan 02, 2025 8:26:41 PM net.snowflake.client.core.SFSession open
2025-01-02 12:26:41 destination ERROR : Connecting to GLOBAL Snowflake domain
2025-01-02 12:26:42 destination ERROR Jan 02, 2025 8:26:42 PM net.snowflake.client.core.SFSession open
2025-01-02 12:26:42 destination ERROR : Session 1220488122097790 opened in 84 ms.
2025-01-02 12:26:42 destination ERROR Jan 02, 2025 8:26:42 PM net.snowflake.client.jdbc.SnowflakeConnectionV1 initConnectionWithImpl
2025-01-02 12:26:42 destination ERROR : Connection initialized successfully in 85 ms. Session id: 1220488122097790
2025-01-02 12:26:43 destination ERROR Jan 02, 2025 8:26:43 PM net.snowflake.client.jdbc.SnowflakeChunkDownloader$2 call
2025-01-02 12:26:43 destination ERROR : Processed JSON chunk#0 in 209 ms (1 out of 2) for query 01b9730a-0004-5b2c-0004-560707e8cb56. Download took 80 ms, parsing took 129 ms. Chunk uncompressed size: 1,880 kB, cols: 4, rows: 15,584, scrubbed URL: https://sfc-prod3-ds1-2-customer-stage.s3.us-west-2.amazonaws.com/2me20000-s/results/01b9730a-0004-5b2c-0004-560707e8cb56_0/main/data_0_0_1_1?x-amz-server-side-encryption-customer-algorithm=AES256&response-content-encoding=gzip&X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Date=20250102T202643Z&X-Amz-SignedHeaders=host&X-Amz-Expires=21599&X-Amz-Credential=AKIAQ4XWINDGKX342YUP%2F20250102%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Signature=****
2025-01-02 12:26:43 source ERROR Jan 02, 2025 8:26:43 PM com.github.shyiko.mysql.binlog.BinaryLogClient resolveDatabaseVersion
2025-01-02 12:26:43 source ERROR : Database version: 8.0.35 (major=8, minor=0, mariadb=false)
2025-01-02 12:26:43 source ERROR Jan 02, 2025 8:26:43 PM com.github.shyiko.mysql.binlog.BinaryLogClient tryUpgradeToSSL
2025-01-02 12:26:43 source ERROR : SSL enabled
2025-01-02 12:26:43 source ERROR Jan 02, 2025 8:26:43 PM com.github.shyiko.mysql.binlog.BinaryLogClient connect
2025-01-02 12:26:43 source ERROR : Connected to [redacted].[redacted].us-west-2.rds.amazonaws.com:3306 at mysql-bin-changelog.611003/23893 (sid:6290, cid:4779048)
2025-01-02 12:26:45 destination ERROR Jan 02, 2025 8:26:45 PM net.snowflake.client.jdbc.SnowflakeChunkDownloader terminate
2025-01-02 12:26:45 destination ERROR : Completed processing 2 JSON chunks for query 01b9730a-0004-5b2c-0004-560707e8cb56 in 365 ms. Download took 103 ms (average: 51 ms), parsing took 262 ms (average: 131 ms). Chunks uncompressed size: 3 MB (average: 1 MB), rows in chunks: 32,554 (total: 33,343, average in chunk: 16,277), total memory used: 252 MB
2025-01-02 12:27:30 destination ERROR Jan 02, 2025 8:27:30 PM net.snowflake.client.jdbc.SnowflakeChunkDownloader$2 call
2025-01-02 12:27:30 destination ERROR : Processed JSON chunk#0 in 76 ms (1 out of 3) for query 01b9730b-0004-5bc1-0004-560707e8eebe. Download took 71 ms, parsing took 5 ms. Chunk uncompressed size: 97 kB, cols: 4, rows: 789, scrubbed URL: https://sfc-prod3-ds1-2-customer-stage.s3.us-west-2.amazonaws.com/2me20000-s/results/01b9730a-0004-5b2c-0004-560707e8cb56_0/main/data_0_0_0_1?x-amz-server-side-encryption-customer-algorithm=AES256&response-content-encoding=gzip&X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Date=20250102T202730Z&X-Amz-SignedHeaders=host&X-Amz-Expires=21599&X-Amz-Credential=AKIAQ4XWINDGKX342YUP%2F20250102%2Fus-west-2%2Fs3%2Faws4_request&X-Amz-Signature=****
2025-01-02 12:27:31 destination ERROR Jan 02, 2025 8:27:31 PM net.snowflake.client.jdbc.SnowflakeChunkDownloader terminate
2025-01-02 12:27:31 destination ERROR : Completed processing 3 JSON chunks for query 01b9730b-0004-5bc1-0004-560707e8eebe in 288 ms. Download took 166 ms (average: 55 ms), parsing took 122 ms (average: 40 ms). Chunks uncompressed size: 3 MB (average: 1 MB), rows in chunks: 33,343 (total: 33,343, average in chunk: 11,114), total memory used: 380 MB
2025-01-02 12:28:12 source ERROR Jan 02, 2025 8:28:12 PM com.github.shyiko.mysql.binlog.BinaryLogClient$5 run
2025-01-02 12:28:12 source ERROR : threadExecutor is shut down, terminating keepalive thread
2025-01-02 12:28:12 source ERROR blc-[redacted].[redacted].us-west-2.rds.amazonaws.com:3306 i.d.c.b.BinlogStreamingChangeEventSource(logStreamingSourceState):1145 Error during binlog processing. Last offset stored = {ts_sec=1735819981, file=mysql-bin-changelog.611209, pos=2348874, server_id=1856999076, event=4}, binlog reader near position = mysql-bin-changelog.611209/2349979
2025-01-02 12:28:12 source ERROR blc-[redacted].[redacted].us-west-2.rds.amazonaws.com:3306 i.d.p.ErrorHandler(setProducerThrowable):52 Producer failure io.debezium.DebeziumException: Failed to deserialize data of EventHeaderV4{timestamp=1735819981000, eventType=EXT_UPDATE_ROWS, serverId=1856999076, headerLength=19, dataLength=782, nextPosition=2351002, flags=0}
	at io.debezium.connector.binlog.BinlogStreamingChangeEventSource.wrap(BinlogStreamingChangeEventSource.java:1190) ~[debezium-connector-binlog-3.0.0.Final.jar:3.0.0.Final]
	at io.debezium.connector.binlog.BinlogStreamingChangeEventSource$ReaderThreadLifecycleListener.onCommunicationFailure(BinlogStreamingChangeEventSource.java:1235) ~[debezium-connector-binlog-3.0.0.Final.jar:3.0.0.Final]
	at com.github.shyiko.mysql.binlog.BinaryLogClient.listenForEventPackets(BinaryLogClient.java:1105) ~[mysql-binlog-connector-java-0.31.0.jar:0.31.0]
	at com.github.shyiko.mysql.binlog.BinaryLogClient.connect(BinaryLogClient.java:655) ~[mysql-binlog-connector-java-0.31.0.jar:0.31.0]
	at com.github.shyiko.mysql.binlog.BinaryLogClient$7.run(BinaryLogClient.java:954) ~[mysql-binlog-connector-java-0.31.0.jar:0.31.0]
	at java.base/java.lang.Thread.run(Thread.java:1583) [?:?]
Caused by: com.github.shyiko.mysql.binlog.event.deserialization.EventDataDeserializationException: Failed to deserialize data of EventHeaderV4{timestamp=1735819981000, eventType=EXT_UPDATE_ROWS, serverId=1856999076, headerLength=19, dataLength=782, nextPosition=2351002, flags=0}
	at com.github.shyiko.mysql.binlog.event.deserialization.EventDeserializer.deserializeEventData(EventDeserializer.java:343) ~[mysql-binlog-connector-java-0.31.0.jar:0.31.0]
	at com.github.shyiko.mysql.binlog.event.deserialization.EventDeserializer.nextEvent(EventDeserializer.java:246) ~[mysql-binlog-connector-java-0.31.0.jar:0.31.0]
	at io.debezium.connector.binlog.BinlogStreamingChangeEventSource$1.nextEvent(BinlogStreamingChangeEventSource.java:415) ~[debezium-connector-binlog-3.0.0.Final.jar:3.0.0.Final]
	at com.github.shyiko.mysql.binlog.BinaryLogClient.listenForEventPackets(BinaryLogClient.java:1077) ~[mysql-binlog-connector-java-0.31.0.jar:0.31.0]
	... 3 more
Caused by: java.io.EOFException: Failed to read remaining 21 of 27 bytes from position 13910349. Block length: 184. Initial block length: 782.
	at com.github.shyiko.mysql.binlog.io.ByteArrayInputStream.fill(ByteArrayInputStream.java:115) ~[mysql-binlog-connector-java-0.31.0.jar:0.31.0]
	at com.github.shyiko.mysql.binlog.io.ByteArrayInputStream.read(ByteArrayInputStream.java:105) ~[mysql-binlog-connector-java-0.31.0.jar:0.31.0]
	at io.debezium.connector.binlog.event.RowDeserializers.deserializeVarString(RowDeserializers.java:284) ~[debezium-connector-binlog-3.0.0.Final.jar:3.0.0.Final]
	at io.debezium.connector.binlog.event.RowDeserializers$UpdateRowsDeserializer.deserializeVarString(RowDeserializers.java:147) ~[debezium-connector-binlog-3.0.0.Final.jar:3.0.0.Final]
	at com.github.shyiko.mysql.binlog.event.deserialization.AbstractRowsEventDataDeserializer.deserializeCell(AbstractRowsEventDataDeserializer.java:189) ~[mysql-binlog-connector-java-0.31.0.jar:0.31.0]
	at com.github.shyiko.mysql.binlog.event.deserialization.AbstractRowsEventDataDeserializer.deserializeRow(AbstractRowsEventDataDeserializer.java:143) ~[mysql-binlog-connector-java-0.31.0.jar:0.31.0]
	at com.github.shyiko.mysql.binlog.event.deserialization.UpdateRowsEventDataDeserializer.deserializeRows(UpdateRowsEventDataDeserializer.java:72) ~[mysql-binlog-connector-java-0.31.0.jar:0.31.0]
	at com.github.shyiko.mysql.binlog.event.deserialization.UpdateRowsEventDataDeserializer.deserialize(UpdateRowsEventDataDeserializer.java:58) ~[mysql-binlog-connector-java-0.31.0.jar:0.31.0]
	at com.github.shyiko.mysql.binlog.event.deserialization.UpdateRowsEventDataDeserializer.deserialize(UpdateRowsEventDataDeserializer.java:33) ~[mysql-binlog-connector-java-0.31.0.jar:0.31.0]
	at com.github.shyiko.mysql.binlog.event.deserialization.EventDeserializer.deserializeEventData(EventDeserializer.java:337) ~[mysql-binlog-connector-java-0.31.0.jar:0.31.0]
	at com.github.shyiko.mysql.binlog.event.deserialization.EventDeserializer.nextEvent(EventDeserializer.java:246) ~[mysql-binlog-connector-java-0.31.0.jar:0.31.0]
	at io.debezium.connector.binlog.BinlogStreamingChangeEventSource$1.nextEvent(BinlogStreamingChangeEventSource.java:415) ~[debezium-connector-binlog-3.0.0.Final.jar:3.0.0.Final]
	at com.github.shyiko.mysql.binlog.BinaryLogClient.listenForEventPackets(BinaryLogClient.java:1077) ~[mysql-binlog-connector-java-0.31.0.jar:0.31.0]
	... 3 more

Stack Trace: io.debezium.DebeziumException: Failed to deserialize data of EventHeaderV4{timestamp=1735819981000, eventType=EXT_UPDATE_ROWS, serverId=1856999076, headerLength=19, dataLength=782, nextPosition=2351002, flags=0}
	at io.debezium.connector.binlog.BinlogStreamingChangeEventSource.wrap(BinlogStreamingChangeEventSource.java:1190)
	at io.debezium.connector.binlog.BinlogStreamingChangeEventSource$ReaderThreadLifecycleListener.onCommunicationFailure(BinlogStreamingChangeEventSource.java:1235)
	at com.github.shyiko.mysql.binlog.BinaryLogClient.listenForEventPackets(BinaryLogClient.java:1105)
	at com.github.shyiko.mysql.binlog.BinaryLogClient.connect(BinaryLogClient.java:655)
	at com.github.shyiko.mysql.binlog.BinaryLogClient$7.run(BinaryLogClient.java:954)
	at java.base/java.lang.Thread.run(Thread.java:1583)
Caused by: com.github.shyiko.mysql.binlog.event.deserialization.EventDataDeserializationException: Failed to deserialize data of EventHeaderV4{timestamp=1735819981000, eventType=EXT_UPDATE_ROWS, serverId=1856999076, headerLength=19, dataLength=782, nextPosition=2351002, flags=0}
	at com.github.shyiko.mysql.binlog.event.deserialization.EventDeserializer.deserializeEventData(EventDeserializer.java:343)
	at com.github.shyiko.mysql.binlog.event.deserialization.EventDeserializer.nextEvent(EventDeserializer.java:246)
	at io.debezium.connector.binlog.BinlogStreamingChangeEventSource$1.nextEvent(BinlogStreamingChangeEventSource.java:415)
	at com.github.shyiko.mysql.binlog.BinaryLogClient.listenForEventPackets(BinaryLogClient.java:1077)
	... 3 more
Caused by: java.io.EOFException: Failed to read remaining 21 of 27 bytes from position 13910349. Block length: 184. Initial block length: 782.
	at com.github.shyiko.mysql.binlog.io.ByteArrayInputStream.fill(ByteArrayInputStream.java:115)
	at com.github.shyiko.mysql.binlog.io.ByteArrayInputStream.read(ByteArrayInputStream.java:105)
	at io.debezium.connector.binlog.event.RowDeserializers.deserializeVarString(RowDeserializers.java:284)
	at io.debezium.connector.binlog.event.RowDeserializers$UpdateRowsDeserializer.deserializeVarString(RowDeserializers.java:147)
	at com.github.shyiko.mysql.binlog.event.deserialization.AbstractRowsEventDataDeserializer.deserializeCell(AbstractRowsEventDataDeserializer.java:189)
	at com.github.shyiko.mysql.binlog.event.deserialization.AbstractRowsEventDataDeserializer.deserializeRow(AbstractRowsEventDataDeserializer.java:143)
	at com.github.shyiko.mysql.binlog.event.deserialization.UpdateRowsEventDataDeserializer.deserializeRows(UpdateRowsEventDataDeserializer.java:72)
	at com.github.shyiko.mysql.binlog.event.deserialization.UpdateRowsEventDataDeserializer.deserialize(UpdateRowsEventDataDeserializer.java:58)
	at com.github.shyiko.mysql.binlog.event.deserialization.UpdateRowsEventDataDeserializer.deserialize(UpdateRowsEventDataDeserializer.java:33)
	at com.github.shyiko.mysql.binlog.event.deserialization.EventDeserializer.deserializeEventData(EventDeserializer.java:337)
	... 6 more
2025-01-02 12:28:12 source ERROR blc-[redacted].[redacted].us-west-2.rds.amazonaws.com:3306 i.d.p.ErrorHandler(hasMoreRetries):129 The maximum number of 0 retries has been attempted
2025-01-02 12:28:12 source ERROR main i.a.c.AirbyteConnectorRunnable(run):36 Failed class io.airbyte.cdk.read.ReadOperation operation execution. org.apache.kafka.connect.errors.ConnectException: An exception occurred in the change event producer. This connector will be stopped.
	at io.debezium.pipeline.ErrorHandler.setProducerThrowable(ErrorHandler.java:67) ~[debezium-core-3.0.0.Final.jar:3.0.0.Final]
	at io.debezium.connector.binlog.BinlogStreamingChangeEventSource$ReaderThreadLifecycleListener.onCommunicationFailure(BinlogStreamingChangeEventSource.java:1235) ~[debezium-connector-binlog-3.0.0.Final.jar:3.0.0.Final]
	at com.github.shyiko.mysql.binlog.BinaryLogClient.listenForEventPackets(BinaryLogClient.java:1105) ~[mysql-binlog-connector-java-0.31.0.jar:0.31.0]
	at com.github.shyiko.mysql.binlog.BinaryLogClient.connect(BinaryLogClient.java:655) ~[mysql-binlog-connector-java-0.31.0.jar:0.31.0]
	at com.github.shyiko.mysql.binlog.BinaryLogClient$7.run(BinaryLogClient.java:954) ~[mysql-binlog-connector-java-0.31.0.jar:0.31.0]
	at java.base/java.lang.Thread.run(Thread.java:1583) ~[?:?]
Caused by: io.debezium.DebeziumException: Failed to deserialize data of EventHeaderV4{timestamp=1735819981000, eventType=EXT_UPDATE_ROWS, serverId=1856999076, headerLength=19, dataLength=782, nextPosition=2351002, flags=0}
	at io.debezium.connector.binlog.BinlogStreamingChangeEventSource.wrap(BinlogStreamingChangeEventSource.java:1190) ~[debezium-connector-binlog-3.0.0.Final.jar:3.0.0.Final]
	... 5 more
Caused by: com.github.shyiko.mysql.binlog.event.deserialization.EventDataDeserializationException: Failed to deserialize data of EventHeaderV4{timestamp=1735819981000, eventType=EXT_UPDATE_ROWS, serverId=1856999076, headerLength=19, dataLength=782, nextPosition=2351002, flags=0}
	at com.github.shyiko.mysql.binlog.event.deserialization.EventDeserializer.deserializeEventData(EventDeserializer.java:343) ~[mysql-binlog-connector-java-0.31.0.jar:0.31.0]
	at com.github.shyiko.mysql.binlog.event.deserialization.EventDeserializer.nextEvent(EventDeserializer.java:246) ~[mysql-binlog-connector-java-0.31.0.jar:0.31.0]
	at io.debezium.connector.binlog.BinlogStreamingChangeEventSource$1.nextEvent(BinlogStreamingChangeEventSource.java:415) ~[debezium-connector-binlog-3.0.0.Final.jar:3.0.0.Final]
	at com.github.shyiko.mysql.binlog.BinaryLogClient.listenForEventPackets(BinaryLogClient.java:1077) ~[mysql-binlog-connector-java-0.31.0.jar:0.31.0]
	... 3 more
Caused by: java.io.EOFException: Failed to read remaining 21 of 27 bytes from position 13910349. Block length: 184. Initial block length: 782.
	at com.github.shyiko.mysql.binlog.io.ByteArrayInputStream.fill(ByteArrayInputStream.java:115) ~[mysql-binlog-connector-java-0.31.0.jar:0.31.0]
	at com.github.shyiko.mysql.binlog.io.ByteArrayInputStream.read(ByteArrayInputStream.java:105) ~[mysql-binlog-connector-java-0.31.0.jar:0.31.0]
	at io.debezium.connector.binlog.event.RowDeserializers.deserializeVarString(RowDeserializers.java:284) ~[debezium-connector-binlog-3.0.0.Final.jar:3.0.0.Final]
	at io.debezium.connector.binlog.event.RowDeserializers$UpdateRowsDeserializer.deserializeVarString(RowDeserializers.java:147) ~[debezium-connector-binlog-3.0.0.Final.jar:3.0.0.Final]
	at com.github.shyiko.mysql.binlog.event.deserialization.AbstractRowsEventDataDeserializer.deserializeCell(AbstractRowsEventDataDeserializer.java:189) ~[mysql-binlog-connector-java-0.31.0.jar:0.31.0]
	at com.github.shyiko.mysql.binlog.event.deserialization.AbstractRowsEventDataDeserializer.deserializeRow(AbstractRowsEventDataDeserializer.java:143) ~[mysql-binlog-connector-java-0.31.0.jar:0.31.0]
	at com.github.shyiko.mysql.binlog.event.deserialization.UpdateRowsEventDataDeserializer.deserializeRows(UpdateRowsEventDataDeserializer.java:72) ~[mysql-binlog-connector-java-0.31.0.jar:0.31.0]
	at com.github.shyiko.mysql.binlog.event.deserialization.UpdateRowsEventDataDeserializer.deserialize(UpdateRowsEventDataDeserializer.java:58) ~[mysql-binlog-connector-java-0.31.0.jar:0.31.0]
	at com.github.shyiko.mysql.binlog.event.deserialization.UpdateRowsEventDataDeserializer.deserialize(UpdateRowsEventDataDeserializer.java:33) ~[mysql-binlog-connector-java-0.31.0.jar:0.31.0]
	at com.github.shyiko.mysql.binlog.event.deserialization.EventDeserializer.deserializeEventData(EventDeserializer.java:337) ~[mysql-binlog-connector-java-0.31.0.jar:0.31.0]
	at com.github.shyiko.mysql.binlog.event.deserialization.EventDeserializer.nextEvent(EventDeserializer.java:246) ~[mysql-binlog-connector-java-0.31.0.jar:0.31.0]
	at io.debezium.connector.binlog.BinlogStreamingChangeEventSource$1.nextEvent(BinlogStreamingChangeEventSource.java:415) ~[debezium-connector-binlog-3.0.0.Final.jar:3.0.0.Final]
	at com.github.shyiko.mysql.binlog.BinaryLogClient.listenForEventPackets(BinaryLogClient.java:1077) ~[mysql-binlog-connector-java-0.31.0.jar:0.31.0]
	... 3 more
Stack Trace: org.apache.kafka.connect.errors.ConnectException: An exception occurred in the change event producer. This connector will be stopped.
	at io.debezium.pipeline.ErrorHandler.setProducerThrowable(ErrorHandler.java:67)
	at io.debezium.connector.binlog.BinlogStreamingChangeEventSource$ReaderThreadLifecycleListener.onCommunicationFailure(BinlogStreamingChangeEventSource.java:1235)
	at com.github.shyiko.mysql.binlog.BinaryLogClient.listenForEventPackets(BinaryLogClient.java:1105)
	at com.github.shyiko.mysql.binlog.BinaryLogClient.connect(BinaryLogClient.java:655)
	at com.github.shyiko.mysql.binlog.BinaryLogClient$7.run(BinaryLogClient.java:954)
	at java.base/java.lang.Thread.run(Thread.java:1583)
Caused by: io.debezium.DebeziumException: Failed to deserialize data of EventHeaderV4{timestamp=1735819981000, eventType=EXT_UPDATE_ROWS, serverId=1856999076, headerLength=19, dataLength=782, nextPosition=2351002, flags=0}
	at io.debezium.connector.binlog.BinlogStreamingChangeEventSource.wrap(BinlogStreamingChangeEventSource.java:1190)
	... 5 more
Caused by: com.github.shyiko.mysql.binlog.event.deserialization.EventDataDeserializationException: Failed to deserialize data of EventHeaderV4{timestamp=1735819981000, eventType=EXT_UPDATE_ROWS, serverId=1856999076, headerLength=19, dataLength=782, nextPosition=2351002, flags=0}
	at com.github.shyiko.mysql.binlog.event.deserialization.EventDeserializer.deserializeEventData(EventDeserializer.java:343)
	at com.github.shyiko.mysql.binlog.event.deserialization.EventDeserializer.nextEvent(EventDeserializer.java:246)
	at io.debezium.connector.binlog.BinlogStreamingChangeEventSource$1.nextEvent(BinlogStreamingChangeEventSource.java:415)
	at com.github.shyiko.mysql.binlog.BinaryLogClient.listenForEventPackets(BinaryLogClient.java:1077)
	... 3 more
Caused by: java.io.EOFException: Failed to read remaining 21 of 27 bytes from position 13910349. Block length: 184. Initial block length: 782.
	at com.github.shyiko.mysql.binlog.io.ByteArrayInputStream.fill(ByteArrayInputStream.java:115)
	at com.github.shyiko.mysql.binlog.io.ByteArrayInputStream.read(ByteArrayInputStream.java:105)
	at io.debezium.connector.binlog.event.RowDeserializers.deserializeVarString(RowDeserializers.java:284)

	at io.debezium.connector.binlog.event.RowDeserializers$UpdateRowsDeserializer.deserializeVarString(RowDeserializers.java:147)
	at com.github.shyiko.mysql.binlog.event.deserialization.AbstractRowsEventDataDeserializer.deserializeCell(AbstractRowsEventDataDeserializer.java:189)
	at com.github.shyiko.mysql.binlog.event.deserialization.AbstractRowsEventDataDeserializer.deserializeRow(AbstractRowsEventDataDeserializer.java:143)
	at com.github.shyiko.mysql.binlog.event.deserialization.UpdateRowsEventDataDeserializer.deserializeRows(UpdateRowsEventDataDeserializer.java:72)
	at com.github.shyiko.mysql.binlog.event.deserialization.UpdateRowsEventDataDeserializer.deserialize(UpdateRowsEventDataDeserializer.java:58)
	at com.github.shyiko.mysql.binlog.event.deserialization.UpdateRowsEventDataDeserializer.deserialize(UpdateRowsEventDataDeserializer.java:33)
	at com.github.shyiko.mysql.binlog.event.deserialization.EventDeserializer.deserializeEventData(EventDeserializer.java:337)
	... 6 more
2025-01-02 12:28:12 source ERROR org.apache.kafka.connect.errors.ConnectException: An exception occurred in the change event producer. This connector will be stopped.
2025-01-02 12:28:12 source ERROR 	at io.debezium.pipeline.ErrorHandler.setProducerThrowable(ErrorHandler.java:67)
2025-01-02 12:28:12 source ERROR 	at io.debezium.connector.binlog.BinlogStreamingChangeEventSource$ReaderThreadLifecycleListener.onCommunicationFailure(BinlogStreamingChangeEventSource.java:1235)
2025-01-02 12:28:12 source ERROR 	at com.github.shyiko.mysql.binlog.BinaryLogClient.listenForEventPackets(BinaryLogClient.java:1105)
2025-01-02 12:28:12 source ERROR 	at com.github.shyiko.mysql.binlog.BinaryLogClient.connect(BinaryLogClient.java:655)
2025-01-02 12:28:12 source ERROR 	at com.github.shyiko.mysql.binlog.BinaryLogClient$7.run(BinaryLogClient.java:954)
2025-01-02 12:28:12 source ERROR 	at java.base/java.lang.Thread.run(Thread.java:1583)
2025-01-02 12:28:12 source ERROR Caused by: io.debezium.DebeziumException: Failed to deserialize data of EventHeaderV4{timestamp=1735819981000, eventType=EXT_UPDATE_ROWS, serverId=1856999076, headerLength=19, dataLength=782, nextPosition=2351002, flags=0}
2025-01-02 12:28:12 source ERROR 	at io.debezium.connector.binlog.BinlogStreamingChangeEventSource.wrap(BinlogStreamingChangeEventSource.java:1190)
2025-01-02 12:28:12 source ERROR 	... 5 more
2025-01-02 12:28:12 source ERROR Caused by: com.github.shyiko.mysql.binlog.event.deserialization.EventDataDeserializationException: Failed to deserialize data of EventHeaderV4{timestamp=1735819981000, eventType=EXT_UPDATE_ROWS, serverId=1856999076, headerLength=19, dataLength=782, nextPosition=2351002, flags=0}
2025-01-02 12:28:12 source ERROR 	at com.github.shyiko.mysql.binlog.event.deserialization.EventDeserializer.deserializeEventData(EventDeserializer.java:343)
2025-01-02 12:28:12 source ERROR 	at com.github.shyiko.mysql.binlog.event.deserialization.EventDeserializer.nextEvent(EventDeserializer.java:246)
2025-01-02 12:28:12 source ERROR 	at io.debezium.connector.binlog.BinlogStreamingChangeEventSource$1.nextEvent(BinlogStreamingChangeEventSource.java:415)
2025-01-02 12:28:12 source ERROR 	at com.github.shyiko.mysql.binlog.BinaryLogClient.listenForEventPackets(BinaryLogClient.java:1077)
2025-01-02 12:28:12 source ERROR 	... 3 more
2025-01-02 12:28:12 source ERROR Caused by: java.io.EOFException: Failed to read remaining 21 of 27 bytes from position 13910349. Block length: 184. Initial block length: 782.
2025-01-02 12:28:12 source ERROR 	at com.github.shyiko.mysql.binlog.io.ByteArrayInputStream.fill(ByteArrayInputStream.java:115)
2025-01-02 12:28:12 source ERROR 	at com.github.shyiko.mysql.binlog.io.ByteArrayInputStream.read(ByteArrayInputStream.java:105)
2025-01-02 12:28:12 source ERROR 	at io.debezium.connector.binlog.event.RowDeserializers.deserializeVarString(RowDeserializers.java:284)
2025-01-02 12:28:12 source ERROR 	at io.debezium.connector.binlog.event.RowDeserializers$UpdateRowsDeserializer.deserializeVarString(RowDeserializers.java:147)
2025-01-02 12:28:12 source ERROR 	at com.github.shyiko.mysql.binlog.event.deserialization.AbstractRowsEventDataDeserializer.deserializeCell(AbstractRowsEventDataDeserializer.java:189)
2025-01-02 12:28:12 source ERROR 	at com.github.shyiko.mysql.binlog.event.deserialization.AbstractRowsEventDataDeserializer.deserializeRow(AbstractRowsEventDataDeserializer.java:143)
2025-01-02 12:28:12 source ERROR 	at com.github.shyiko.mysql.binlog.event.deserialization.UpdateRowsEventDataDeserializer.deserializeRows(UpdateRowsEventDataDeserializer.java:72)
2025-01-02 12:28:12 source ERROR 	at com.github.shyiko.mysql.binlog.event.deserialization.UpdateRowsEventDataDeserializer.deserialize(UpdateRowsEventDataDeserializer.java:58)
2025-01-02 12:28:12 source ERROR 	at com.github.shyiko.mysql.binlog.event.deserialization.UpdateRowsEventDataDeserializer.deserialize(UpdateRowsEventDataDeserializer.java:33)
2025-01-02 12:28:12 source ERROR 	at com.github.shyiko.mysql.binlog.event.deserialization.EventDeserializer.deserializeEventData(EventDeserializer.java:337)
2025-01-02 12:28:12 source ERROR 	... 6 more
2025-01-02 12:28:36 destination ERROR main i.a.c.i.u.ConnectorExceptionHandler(handleException):68 caught exception! io.airbyte.commons.exceptions.TransientErrorException: Some streams were unsuccessful due to a source error. See logs for details.
	at io.airbyte.cdk.integrations.destination.async.AsyncStreamConsumer.close(AsyncStreamConsumer.kt:215) ~[airbyte-cdk-core-0.46.0.jar:?]
	at kotlin.jdk7.AutoCloseableKt.closeFinally(AutoCloseableJVM.kt:48) ~[kotlin-stdlib-2.0.0.jar:2.0.0-release-341]
	at io.airbyte.cdk.integrations.base.IntegrationRunner.runInternal(IntegrationRunner.kt:215) [airbyte-cdk-core-0.46.0.jar:?]
	at io.airbyte.cdk.integrations.base.IntegrationRunner.run(IntegrationRunner.kt:119) [airbyte-cdk-core-0.46.0.jar:?]
	at io.airbyte.cdk.integrations.base.IntegrationRunner.run$default(IntegrationRunner.kt:113) [airbyte-cdk-core-0.46.0.jar:?]
	at io.airbyte.cdk.integrations.base.adaptive.AdaptiveDestinationRunner$Runner.run(AdaptiveDestinationRunner.kt:68) [airbyte-cdk-core-0.46.0.jar:?]
	at io.airbyte.integrations.destination.snowflake.SnowflakeDestinationKt.main(SnowflakeDestination.kt:422) [io.airbyte.airbyte-integrations.connectors-destination-snowflake.jar:?]

Stack Trace: io.airbyte.commons.exceptions.TransientErrorException: Some streams were unsuccessful due to a source error. See logs for details.
	at io.airbyte.cdk.integrations.destination.async.AsyncStreamConsumer.close(AsyncStreamConsumer.kt:215)
	at kotlin.jdk7.AutoCloseableKt.closeFinally(AutoCloseableJVM.kt:48)
	at io.airbyte.cdk.integrations.base.IntegrationRunner.runInternal(IntegrationRunner.kt:215)
	at io.airbyte.cdk.integrations.base.IntegrationRunner.run(IntegrationRunner.kt:119)
	at io.airbyte.cdk.integrations.base.IntegrationRunner.run$default(IntegrationRunner.kt:113)
	at io.airbyte.cdk.integrations.base.adaptive.AdaptiveDestinationRunner$Runner.run(AdaptiveDestinationRunner.kt:68)
	at io.airbyte.integrations.destination.snowflake.SnowflakeDestinationKt.main(SnowflakeDestination.kt:422)

Contribute

  • Yes, I want to contribute
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
area/connectors Connector related issues autoteam cdc community connectors/source/mysql team/db-dw-sources Backlog for Database and Data Warehouse Sources team type/bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@marcosmarxm @octavia-squidington-iii @rtol5