Issue
The dsbulk unload command fails with the following error:
Caused by: com.datastax.oss.driver.api.core.connection.FrameTooLongException: Adjusted frame length exceeds 256000000: 258466636 - discarded
Cause:
This error occurs because the frame length has exceeded the limit set by protocol.max-frame-length in the Java code.
Relevant code can be found here:
Resolution
Overview
Try reducing the number of pages. The default for "--datastax-java-driver.basic.request.page-size" is 5000. You can set a lower value, such as --datastax-java-driver.basic.request.page-size 1000.
For more details on this parameter, visit:
https://github.com/yugabyte/dsbulk/blob/yb-dsbulk-1.6/manual/settings.md?plain=1#L1486
Additional Information
If you are using the Cassandra Driver, this can also be configured on the server side using native_transport_max_frame_size_in_mb Ensure that this setting is consistent in both DSBulk and Cassandra.
Reference: GitHub Issue #389
NOTE: The --driver.advanced.protocol.max-frame-length 'xxx MiB' option for dsbulk works on the command line but not in dsbulk.conf.
Other Reference:
Comments
0 comments
Please sign in to leave a comment.