Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug][rocketmq-source] rocketmq got negative offset from server #400

Open
2 tasks done
hk-lrzy opened this issue Feb 15, 2023 · 0 comments
Open
2 tasks done

[Bug][rocketmq-source] rocketmq got negative offset from server #400

hk-lrzy opened this issue Feb 15, 2023 · 0 comments
Labels
bug Something isn't working

Comments

@hk-lrzy
Copy link
Collaborator

hk-lrzy commented Feb 15, 2023

What happened

2023-02-15T05:25:10.2299019Z Caused by: org.apache.rocketmq.client.exception.MQClientException: offset < 0
2023-02-15T05:25:10.2299460Z For more information, please visit the url, http://rocketmq.apache.org/docs/faq/
2023-02-15T05:25:10.2300210Z 	at org.apache.rocketmq.client.impl.consumer.DefaultMQPullConsumerImpl.pullSyncImpl(DefaultMQPullConsumerImpl.java:239) ~[connector-rocketmq-0.2.0-SNAPSHOT.jar:?]
2023-02-15T05:25:10.2301144Z 	at org.apache.rocketmq.client.impl.consumer.DefaultMQPullConsumerImpl.pull(DefaultMQPullConsumerImpl.java:186) ~[connector-rocketmq-0.2.0-SNAPSHOT.jar:?]
2023-02-15T05:25:10.2301970Z 	at org.apache.rocketmq.client.consumer.DefaultMQPullConsumer.pull(DefaultMQPullConsumer.java:323) ~[connector-rocketmq-0.2.0-SNAPSHOT.jar:?]
2023-02-15T05:25:10.2302864Z 	at com.bytedance.bitsail.connector.rocketmq.source.reader.RocketMQSourceReader.pollNext(RocketMQSourceReader.java:126) ~[connector-rocketmq-0.2.0-SNAPSHOT.jar:?]
2023-02-15T05:25:10.2304075Z 	at com.bytedance.bitsail.core.flink.bridge.reader.delegate.DelegateFlinkSourceReader.pollNext(DelegateFlinkSourceReader.java:159) ~[bitsail-engine-flink-0.2.0-SNAPSHOT.jar:?]
2023-02-15T05:25:10.2305113Z 	at com.bytedance.bitsail.core.flink.bridge.reader.delegate.DelegateFlinkSourceReader.pollNext(DelegateFlinkSourceReader.java:151) ~[bitsail-engine-flink-0.2.0-SNAPSHOT.jar:?]
2023-02-15T05:25:10.2305951Z 	at org.apache.flink.streaming.api.operators.SourceOperator.emitNext(SourceOperator.java:269) ~[flink-dist_2.12-1.11.6.jar:1.11.6]
2023-02-15T05:25:10.2306691Z 	at org.apache.flink.streaming.runtime.io.StreamTaskSourceInput.emitNext(StreamTaskSourceInput.java:47) ~[flink-dist_2.12-1.11.6.jar:1.11.6]
2023-02-15T05:25:10.2307474Z 	at org.apache.flink.streaming.runtime.io.StreamOneInputProcessor.processInput(StreamOneInputProcessor.java:65) ~[flink-dist_2.12-1.11.6.jar:1.11.6]
2023-02-15T05:25:10.2308207Z 	at org.apache.flink.streaming.runtime.tasks.StreamTask.processInput(StreamTask.java:374) ~[flink-dist_2.12-1.11.6.jar:1.11.6]
2023-02-15T05:25:10.2308967Z 	at org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.runMailboxLoop(MailboxProcessor.java:190) ~[flink-dist_2.12-1.11.6.jar:1.11.6]
2023-02-15T05:25:10.2309719Z 	at org.apache.flink.streaming.runtime.tasks.StreamTask.runMailboxLoop(StreamTask.java:608) ~[flink-dist_2.12-1.11.6.jar:1.11.6]
2023-02-15T05:25:10.2310376Z 	at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:574) ~[flink-dist_2.12-1.11.6.jar:1.11.6]
2023-02-15T05:25:10.2310954Z 	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:752) ~[flink-dist_2.12-1.11.6.jar:1.11.6]
2023-02-15T05:25:10.2311491Z 	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:569) ~[flink-dist_2.12-1.11.6.jar:1.11.6]
2023-02-15T05:25:10.2311856Z 	at java.lang.Thread.run(Thread.java:750) ~[?:1.8.0_342]

What do you expect to happen

When we acquire offset from rocketmq server, it should not return negative offset or we need prcoess the case to avoid job faild.

How to reproduce

random

Build Environment

java version "1.8.0_333"
Java(TM) SE Runtime Environment (build 1.8.0_333-b02)
Java HotSpot(TM) 64-Bit Server VM (build 25.333-b02, mixed mode)

Execution Environment

java version "1.8.0_333"
Java(TM) SE Runtime Environment (build 1.8.0_333-b02)
Java HotSpot(TM) 64-Bit Server VM (build 25.333-b02, mixed mode)

BitSail version

master

BitSail Component or Code Module

BitSail Component

Are you willing to submit PR?

  • Yes, I am willing to submit a PR!

Code of Conduct

@hk-lrzy hk-lrzy added the bug Something isn't working label Feb 16, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant