-
-
Notifications
You must be signed in to change notification settings - Fork 155
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Producer can not write to broker nr. 2 #716
Comments
Swapped to confluent kafka go and no producer problems. I still prefer franz-go though. |
@ErlendFax could you capture broker 2 logs around the EOF? EOF usually indicates that SASL is missing, but if br1 and br3 are working, something else is up here. I've never seen a situation like this. The only main network difference I can think of between this client and confluent-kafka-go is the dialer under the hood. |
Thank you for replying! When looking again I did see more clues from the producer logs. Log entry from producer:
Log entry from redpanda-2:
Included some logs, lots have been filtered out. Tried to find the relevant stuff. [
{
"textPayload": "2024/05/02 14:00:02 Processed 58 messages",
"insertId": "w738yii6crmdpalg",
"resource": {
"type": "k8s_container",
"labels": {
"namespace_name": "redpanda",
"cluster_name": "dev",
"location": "europe-west1-b",
"container_name": "lte-m-csv-parser",
"project_id": "hark-tech",
"pod_name": "lte-m-csv-parser-888f76864-p89t5"
}
},
"timestamp": "2024-05-02T14:00:02.481827282Z",
"severity": "ERROR",
"labels": {
"k8s-pod/app": "lte-m-csv-parser",
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq",
"k8s-pod/pod-template-hash": "888f76864"
},
"logName": "projects/hark-tech/logs/stderr",
"receiveTimestamp": "2024-05-02T14:00:07.395487273Z"
},
{
"textPayload": "PRODUCER[DEBUG] opening connection to broker; addr: redpanda-2.redpanda.redpanda.svc.cluster.local.:9093, broker: 2",
"insertId": "vdv0y0y1atgafxa9",
"resource": {
"type": "k8s_container",
"labels": {
"container_name": "lte-m-csv-parser",
"project_id": "hark-tech",
"cluster_name": "dev",
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"location": "europe-west1-b",
"namespace_name": "redpanda"
}
},
"timestamp": "2024-05-02T14:00:03.190972095Z",
"severity": "INFO",
"labels": {
"k8s-pod/app": "lte-m-csv-parser",
"k8s-pod/pod-template-hash": "888f76864",
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq"
},
"logName": "projects/hark-tech/logs/stdout",
"receiveTimestamp": "2024-05-02T14:00:06.722845798Z"
},
{
"textPayload": "PRODUCER[DEBUG] connection opened to broker; addr: redpanda-2.redpanda.redpanda.svc.cluster.local.:9093, broker: 2",
"insertId": "ufgb3q74vjwejjub",
"resource": {
"type": "k8s_container",
"labels": {
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"cluster_name": "dev",
"namespace_name": "redpanda",
"location": "europe-west1-b",
"container_name": "lte-m-csv-parser",
"project_id": "hark-tech"
}
},
"timestamp": "2024-05-02T14:00:03.198944939Z",
"severity": "INFO",
"labels": {
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq",
"k8s-pod/app": "lte-m-csv-parser",
"k8s-pod/pod-template-hash": "888f76864"
},
"logName": "projects/hark-tech/logs/stdout",
"receiveTimestamp": "2024-05-02T14:00:06.722845798Z"
},
{
"textPayload": "PRODUCER[DEBUG] connection initialized successfully; addr: redpanda-2.redpanda.redpanda.svc.cluster.local.:9093, broker: 2",
"insertId": "1f8sb90m1ohhicp7",
"resource": {
"type": "k8s_container",
"labels": {
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"namespace_name": "redpanda",
"container_name": "lte-m-csv-parser",
"location": "europe-west1-b",
"cluster_name": "dev",
"project_id": "hark-tech"
}
},
"timestamp": "2024-05-02T14:00:03.199139269Z",
"severity": "INFO",
"labels": {
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq",
"k8s-pod/app": "lte-m-csv-parser",
"k8s-pod/pod-template-hash": "888f76864"
},
"logName": "projects/hark-tech/logs/stdout",
"receiveTimestamp": "2024-05-02T14:00:06.722845798Z"
},
{
"textPayload": "PRODUCER[DEBUG] wrote Produce v7; broker: 2, bytes_written: 2214, write_wait: 8.316396ms, time_to_write: 41.757µs, err: <nil>",
"insertId": "zafn6xvs4iajyyht",
"resource": {
"type": "k8s_container",
"labels": {
"cluster_name": "dev",
"namespace_name": "redpanda",
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"container_name": "lte-m-csv-parser",
"project_id": "hark-tech",
"location": "europe-west1-b"
}
},
"timestamp": "2024-05-02T14:00:03.199337261Z",
"severity": "INFO",
"labels": {
"k8s-pod/app": "lte-m-csv-parser",
"k8s-pod/pod-template-hash": "888f76864",
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq"
},
"logName": "projects/hark-tech/logs/stdout",
"receiveTimestamp": "2024-05-02T14:00:06.722845798Z"
},
{
"textPayload": "ERROR 2024-05-02 14:00:03,199 [shard 0] kafka - kafka_batch_adapter.cc:130 - Cannot validate Kafka record batch. Missmatching CRC. Expected:1950350817, Got:4140228419",
"insertId": "3dx9gxy4vdwn98c5",
"resource": {
"type": "k8s_container",
"labels": {
"pod_name": "redpanda-2",
"project_id": "hark-tech",
"namespace_name": "redpanda",
"cluster_name": "dev",
"container_name": "redpanda",
"location": "europe-west1-b"
}
},
"timestamp": "2024-05-02T14:00:03.199471802Z",
"severity": "ERROR",
"labels": {
"k8s-pod/app_kubernetes_io/instance": "redpanda",
"k8s-pod/app_kubernetes_io/name": "redpanda",
"k8s-pod/app_kubernetes_io/component": "redpanda-statefulset",
"compute.googleapis.com/resource_name": "gke-dev-redpanda-pool-dev-c433462a-9zms",
"k8s-pod/controller-revision-hash": "redpanda-7f6d9868cf",
"k8s-pod/statefulset_kubernetes_io/pod-name": "redpanda-2",
"k8s-pod/redpanda_com/poddisruptionbudget": "redpanda"
},
"logName": "projects/hark-tech/logs/stderr",
"receiveTimestamp": "2024-05-02T14:00:04.768822253Z"
},
{
"textPayload": "ERROR 2024-05-02 14:00:03,199 [shard 0] kafka - kafka_batch_adapter.cc:171 - batch has invalid CRC: {header_crc:0, size_bytes:1339, base_offset:{0}, type:batch_type::raft_data, crc:1950350817, attrs:{compression:none, type:CreateTime, transactional: 0, control: 0}, last_offset_delta:5, first_timestamp:{timestamp: 1714658396642}, max_timestamp:{timestamp: 1714658396642}, producer_id:-1, producer_epoch:-1, base_sequence:0, record_count:6, ctx:{term:{-1}, owner_shard:{0}}}",
"insertId": "lh6e77uyai7oic81",
"resource": {
"type": "k8s_container",
"labels": {
"container_name": "redpanda",
"location": "europe-west1-b",
"pod_name": "redpanda-2",
"cluster_name": "dev",
"namespace_name": "redpanda",
"project_id": "hark-tech"
}
},
"timestamp": "2024-05-02T14:00:03.199527673Z",
"severity": "ERROR",
"labels": {
"k8s-pod/redpanda_com/poddisruptionbudget": "redpanda",
"k8s-pod/app_kubernetes_io/instance": "redpanda",
"k8s-pod/statefulset_kubernetes_io/pod-name": "redpanda-2",
"compute.googleapis.com/resource_name": "gke-dev-redpanda-pool-dev-c433462a-9zms",
"k8s-pod/app_kubernetes_io/name": "redpanda",
"k8s-pod/controller-revision-hash": "redpanda-7f6d9868cf",
"k8s-pod/app_kubernetes_io/component": "redpanda-statefulset"
},
"logName": "projects/hark-tech/logs/stderr",
"receiveTimestamp": "2024-05-02T14:00:04.768822253Z"
},
{
"textPayload": "PRODUCER[DEBUG] read Produce v7; broker: 2, bytes_read: 62, read_wait: 116.198µs, time_to_read: 404.85µs, err: <nil>",
"insertId": "6v95x55ham3fb5hd",
"resource": {
"type": "k8s_container",
"labels": {
"namespace_name": "redpanda",
"project_id": "hark-tech",
"location": "europe-west1-b",
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"cluster_name": "dev",
"container_name": "lte-m-csv-parser"
}
},
"timestamp": "2024-05-02T14:00:03.199982685Z",
"severity": "INFO",
"labels": {
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq",
"k8s-pod/app": "lte-m-csv-parser",
"k8s-pod/pod-template-hash": "888f76864"
},
"logName": "projects/hark-tech/logs/stdout",
"receiveTimestamp": "2024-05-02T14:00:06.722845798Z"
},
{
"textPayload": "PRODUCER[INFO] batch in a produce request failed; broker: 2, topic: test_slett, partition: 0, err: CORRUPT_MESSAGE: This message has failed its CRC checksum, exceeds the valid size, has a null key for a compacted topic, or is otherwise corrupt., err_is_retryable: true, max_retries_reached: false",
"insertId": "csk5bse8535jdz4g",
"resource": {
"type": "k8s_container",
"labels": {
"namespace_name": "redpanda",
"location": "europe-west1-b",
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"cluster_name": "dev",
"container_name": "lte-m-csv-parser",
"project_id": "hark-tech"
}
},
"timestamp": "2024-05-02T14:00:03.200409998Z",
"severity": "INFO",
"labels": {
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq",
"k8s-pod/app": "lte-m-csv-parser",
"k8s-pod/pod-template-hash": "888f76864"
},
"logName": "projects/hark-tech/logs/stdout",
"receiveTimestamp": "2024-05-02T14:00:06.722845798Z"
},
{
"textPayload": "2024/05/02 14:00:03 Error producing message: CORRUPT_MESSAGE: This message has failed its CRC checksum, exceeds the valid size, has a null key for a compacted topic, or is otherwise corrupt.",
"insertId": "nqccma7jgkyum8kz",
"resource": {
"type": "k8s_container",
"labels": {
"namespace_name": "redpanda",
"location": "europe-west1-b",
"project_id": "hark-tech",
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"container_name": "lte-m-csv-parser",
"cluster_name": "dev"
}
},
"timestamp": "2024-05-02T14:00:03.200579852Z",
"severity": "ERROR",
"labels": {
"k8s-pod/pod-template-hash": "888f76864",
"k8s-pod/app": "lte-m-csv-parser",
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq"
},
"logName": "projects/hark-tech/logs/stderr",
"receiveTimestamp": "2024-05-02T14:00:07.234686375Z"
},
{
"textPayload": "2024/05/02 14:00:03 Error producing message: CORRUPT_MESSAGE: This message has failed its CRC checksum, exceeds the valid size, has a null key for a compacted topic, or is otherwise corrupt.",
"insertId": "9l1qr7peq1p7g1b7",
"resource": {
"type": "k8s_container",
"labels": {
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"project_id": "hark-tech",
"cluster_name": "dev",
"namespace_name": "redpanda",
"container_name": "lte-m-csv-parser",
"location": "europe-west1-b"
}
},
"timestamp": "2024-05-02T14:00:03.200609130Z",
"severity": "ERROR",
"labels": {
"k8s-pod/pod-template-hash": "888f76864",
"k8s-pod/app": "lte-m-csv-parser",
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq"
},
"logName": "projects/hark-tech/logs/stderr",
"receiveTimestamp": "2024-05-02T14:00:07.234686375Z"
},
{
"textPayload": "2024/05/02 14:00:03 Error producing message: CORRUPT_MESSAGE: This message has failed its CRC checksum, exceeds the valid size, has a null key for a compacted topic, or is otherwise corrupt.",
"insertId": "k4huuabqngrilhfz",
"resource": {
"type": "k8s_container",
"labels": {
"namespace_name": "redpanda",
"cluster_name": "dev",
"project_id": "hark-tech",
"location": "europe-west1-b",
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"container_name": "lte-m-csv-parser"
}
},
"timestamp": "2024-05-02T14:00:03.200614891Z",
"severity": "ERROR",
"labels": {
"k8s-pod/app": "lte-m-csv-parser",
"k8s-pod/pod-template-hash": "888f76864",
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq"
},
"logName": "projects/hark-tech/logs/stderr",
"receiveTimestamp": "2024-05-02T14:00:07.234686375Z"
},
{
"textPayload": "2024/05/02 14:00:03 Error producing message: CORRUPT_MESSAGE: This message has failed its CRC checksum, exceeds the valid size, has a null key for a compacted topic, or is otherwise corrupt.",
"insertId": "94idlc262vplj0yq",
"resource": {
"type": "k8s_container",
"labels": {
"cluster_name": "dev",
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"project_id": "hark-tech",
"location": "europe-west1-b",
"container_name": "lte-m-csv-parser",
"namespace_name": "redpanda"
}
},
"timestamp": "2024-05-02T14:00:03.200619820Z",
"severity": "ERROR",
"labels": {
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq",
"k8s-pod/app": "lte-m-csv-parser",
"k8s-pod/pod-template-hash": "888f76864"
},
"logName": "projects/hark-tech/logs/stderr",
"receiveTimestamp": "2024-05-02T14:00:07.234686375Z"
},
{
"textPayload": "2024/05/02 14:00:03 Error producing message: CORRUPT_MESSAGE: This message has failed its CRC checksum, exceeds the valid size, has a null key for a compacted topic, or is otherwise corrupt.",
"insertId": "trnpu6pepk5owoly",
"resource": {
"type": "k8s_container",
"labels": {
"namespace_name": "redpanda",
"cluster_name": "dev",
"location": "europe-west1-b",
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"project_id": "hark-tech",
"container_name": "lte-m-csv-parser"
}
},
"timestamp": "2024-05-02T14:00:03.200625359Z",
"severity": "ERROR",
"labels": {
"k8s-pod/pod-template-hash": "888f76864",
"k8s-pod/app": "lte-m-csv-parser",
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq"
},
"logName": "projects/hark-tech/logs/stderr",
"receiveTimestamp": "2024-05-02T14:00:07.234686375Z"
},
{
"textPayload": "2024/05/02 14:00:03 Error producing message: CORRUPT_MESSAGE: This message has failed its CRC checksum, exceeds the valid size, has a null key for a compacted topic, or is otherwise corrupt.",
"insertId": "uoum93fpnbn1j5dy",
"resource": {
"type": "k8s_container",
"labels": {
"container_name": "lte-m-csv-parser",
"cluster_name": "dev",
"namespace_name": "redpanda",
"location": "europe-west1-b",
"project_id": "hark-tech",
"pod_name": "lte-m-csv-parser-888f76864-p89t5"
}
},
"timestamp": "2024-05-02T14:00:03.200630464Z",
"severity": "ERROR",
"labels": {
"k8s-pod/pod-template-hash": "888f76864",
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq",
"k8s-pod/app": "lte-m-csv-parser"
},
"logName": "projects/hark-tech/logs/stderr",
"receiveTimestamp": "2024-05-02T14:00:07.234686375Z"
},
{
"textPayload": "2024/05/02 14:00:03 Error producing message: CORRUPT_MESSAGE: This message has failed its CRC checksum, exceeds the valid size, has a null key for a compacted topic, or is otherwise corrupt.",
"insertId": "zotmu5qre64a974f",
"resource": {
"type": "k8s_container",
"labels": {
"project_id": "hark-tech",
"namespace_name": "redpanda",
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"container_name": "lte-m-csv-parser",
"cluster_name": "dev",
"location": "europe-west1-b"
}
},
"timestamp": "2024-05-02T14:00:03.200635526Z",
"severity": "ERROR",
"labels": {
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq",
"k8s-pod/pod-template-hash": "888f76864",
"k8s-pod/app": "lte-m-csv-parser"
},
"logName": "projects/hark-tech/logs/stderr",
"receiveTimestamp": "2024-05-02T14:00:07.234686375Z"
},
{
"textPayload": "2024/05/02 14:00:03 Error producing message: CORRUPT_MESSAGE: This message has failed its CRC checksum, exceeds the valid size, has a null key for a compacted topic, or is otherwise corrupt.",
"insertId": "d2pr29l26695xmkb",
"resource": {
"type": "k8s_container",
"labels": {
"project_id": "hark-tech",
"namespace_name": "redpanda",
"container_name": "lte-m-csv-parser",
"cluster_name": "dev",
"location": "europe-west1-b",
"pod_name": "lte-m-csv-parser-888f76864-p89t5"
}
},
"timestamp": "2024-05-02T14:00:03.200678817Z",
"severity": "ERROR",
"labels": {
"k8s-pod/pod-template-hash": "888f76864",
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq",
"k8s-pod/app": "lte-m-csv-parser"
},
"logName": "projects/hark-tech/logs/stderr",
"receiveTimestamp": "2024-05-02T14:00:07.234686375Z"
},
{
"textPayload": "2024/05/02 14:00:03 Error producing message: CORRUPT_MESSAGE: This message has failed its CRC checksum, exceeds the valid size, has a null key for a compacted topic, or is otherwise corrupt.",
"insertId": "joj9hsdu7nne18c0",
"resource": {
"type": "k8s_container",
"labels": {
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"location": "europe-west1-b",
"container_name": "lte-m-csv-parser",
"cluster_name": "dev",
"namespace_name": "redpanda",
"project_id": "hark-tech"
}
},
"timestamp": "2024-05-02T14:00:03.200685505Z",
"severity": "ERROR",
"labels": {
"k8s-pod/pod-template-hash": "888f76864",
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq",
"k8s-pod/app": "lte-m-csv-parser"
},
"logName": "projects/hark-tech/logs/stderr",
"receiveTimestamp": "2024-05-02T14:00:07.234686375Z"
},
{
"textPayload": "2024/05/02 14:00:03 Error producing message: CORRUPT_MESSAGE: This message has failed its CRC checksum, exceeds the valid size, has a null key for a compacted topic, or is otherwise corrupt.",
"insertId": "rlbeucmq9hqpuqem",
"resource": {
"type": "k8s_container",
"labels": {
"location": "europe-west1-b",
"cluster_name": "dev",
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"container_name": "lte-m-csv-parser",
"namespace_name": "redpanda",
"project_id": "hark-tech"
}
},
"timestamp": "2024-05-02T14:00:03.200690984Z",
"severity": "ERROR",
"labels": {
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq",
"k8s-pod/pod-template-hash": "888f76864",
"k8s-pod/app": "lte-m-csv-parser"
},
"logName": "projects/hark-tech/logs/stderr",
"receiveTimestamp": "2024-05-02T14:00:07.234686375Z"
},
{
"textPayload": "2024/05/02 14:00:03 Error producing message: CORRUPT_MESSAGE: This message has failed its CRC checksum, exceeds the valid size, has a null key for a compacted topic, or is otherwise corrupt.",
"insertId": "t73peva1e827mfp8",
"resource": {
"type": "k8s_container",
"labels": {
"container_name": "lte-m-csv-parser",
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"cluster_name": "dev",
"namespace_name": "redpanda",
"location": "europe-west1-b",
"project_id": "hark-tech"
}
},
"timestamp": "2024-05-02T14:00:03.200696122Z",
"severity": "ERROR",
"labels": {
"k8s-pod/pod-template-hash": "888f76864",
"k8s-pod/app": "lte-m-csv-parser",
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq"
},
"logName": "projects/hark-tech/logs/stderr",
"receiveTimestamp": "2024-05-02T14:00:07.234686375Z"
},
{
"textPayload": "2024/05/02 14:00:03 Error producing message: CORRUPT_MESSAGE: This message has failed its CRC checksum, exceeds the valid size, has a null key for a compacted topic, or is otherwise corrupt.",
"insertId": "tel5ue7a8skkt3ge",
"resource": {
"type": "k8s_container",
"labels": {
"container_name": "lte-m-csv-parser",
"location": "europe-west1-b",
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"namespace_name": "redpanda",
"project_id": "hark-tech",
"cluster_name": "dev"
}
},
"timestamp": "2024-05-02T14:00:03.200700808Z",
"severity": "ERROR",
"labels": {
"k8s-pod/app": "lte-m-csv-parser",
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq",
"k8s-pod/pod-template-hash": "888f76864"
},
"logName": "projects/hark-tech/logs/stderr",
"receiveTimestamp": "2024-05-02T14:00:07.234686375Z"
},
{
"textPayload": "2024/05/02 14:00:03 Error producing message: CORRUPT_MESSAGE: This message has failed its CRC checksum, exceeds the valid size, has a null key for a compacted topic, or is otherwise corrupt.",
"insertId": "orn7z0fdoe8kirq6",
"resource": {
"type": "k8s_container",
"labels": {
"project_id": "hark-tech",
"container_name": "lte-m-csv-parser",
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"location": "europe-west1-b",
"cluster_name": "dev",
"namespace_name": "redpanda"
}
},
"timestamp": "2024-05-02T14:00:03.200706071Z",
"severity": "ERROR",
"labels": {
"k8s-pod/app": "lte-m-csv-parser",
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq",
"k8s-pod/pod-template-hash": "888f76864"
},
"logName": "projects/hark-tech/logs/stderr",
"receiveTimestamp": "2024-05-02T14:00:07.234686375Z"
},
{
"textPayload": "2024/05/02 14:00:03 Error producing message: CORRUPT_MESSAGE: This message has failed its CRC checksum, exceeds the valid size, has a null key for a compacted topic, or is otherwise corrupt.",
"insertId": "9vezz0hsd44yv29m",
"resource": {
"type": "k8s_container",
"labels": {
"namespace_name": "redpanda",
"container_name": "lte-m-csv-parser",
"project_id": "hark-tech",
"location": "europe-west1-b",
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"cluster_name": "dev"
}
},
"timestamp": "2024-05-02T14:00:03.200710862Z",
"severity": "ERROR",
"labels": {
"k8s-pod/pod-template-hash": "888f76864",
"k8s-pod/app": "lte-m-csv-parser",
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq"
},
"logName": "projects/hark-tech/logs/stderr",
"receiveTimestamp": "2024-05-02T14:00:07.234686375Z"
},
{
"textPayload": "2024/05/02 14:00:03 Error producing message: CORRUPT_MESSAGE: This message has failed its CRC checksum, exceeds the valid size, has a null key for a compacted topic, or is otherwise corrupt.",
"insertId": "pdv4g07t1tdvthbw",
"resource": {
"type": "k8s_container",
"labels": {
"project_id": "hark-tech",
"cluster_name": "dev",
"namespace_name": "redpanda",
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"container_name": "lte-m-csv-parser",
"location": "europe-west1-b"
}
},
"timestamp": "2024-05-02T14:00:03.200715958Z",
"severity": "ERROR",
"labels": {
"k8s-pod/app": "lte-m-csv-parser",
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq",
"k8s-pod/pod-template-hash": "888f76864"
},
"logName": "projects/hark-tech/logs/stderr",
"receiveTimestamp": "2024-05-02T14:00:07.234686375Z"
},
{
"textPayload": "2024/05/02 14:00:03 Error producing message: CORRUPT_MESSAGE: This message has failed its CRC checksum, exceeds the valid size, has a null key for a compacted topic, or is otherwise corrupt.",
"insertId": "anj2yxpve89ji3yp",
"resource": {
"type": "k8s_container",
"labels": {
"cluster_name": "dev",
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"container_name": "lte-m-csv-parser",
"project_id": "hark-tech",
"location": "europe-west1-b",
"namespace_name": "redpanda"
}
},
"timestamp": "2024-05-02T14:00:03.200721218Z",
"severity": "ERROR",
"labels": {
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq",
"k8s-pod/pod-template-hash": "888f76864",
"k8s-pod/app": "lte-m-csv-parser"
},
"logName": "projects/hark-tech/logs/stderr",
"receiveTimestamp": "2024-05-02T14:00:07.234686375Z"
},
{
"textPayload": "2024/05/02 14:00:03 Error producing message: CORRUPT_MESSAGE: This message has failed its CRC checksum, exceeds the valid size, has a null key for a compacted topic, or is otherwise corrupt.",
"insertId": "lx0q7a7fp7h1krg7",
"resource": {
"type": "k8s_container",
"labels": {
"location": "europe-west1-b",
"cluster_name": "dev",
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"namespace_name": "redpanda",
"project_id": "hark-tech",
"container_name": "lte-m-csv-parser"
}
},
"timestamp": "2024-05-02T14:00:03.200726262Z",
"severity": "ERROR",
"labels": {
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq",
"k8s-pod/pod-template-hash": "888f76864",
"k8s-pod/app": "lte-m-csv-parser"
},
"logName": "projects/hark-tech/logs/stderr",
"receiveTimestamp": "2024-05-02T14:00:07.234686375Z"
},
{
"textPayload": "2024/05/02 14:00:03 Error producing message: CORRUPT_MESSAGE: This message has failed its CRC checksum, exceeds the valid size, has a null key for a compacted topic, or is otherwise corrupt.",
"insertId": "1k6wqtw8jwgd803z",
"resource": {
"type": "k8s_container",
"labels": {
"cluster_name": "dev",
"location": "europe-west1-b",
"container_name": "lte-m-csv-parser",
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"project_id": "hark-tech",
"namespace_name": "redpanda"
}
},
"timestamp": "2024-05-02T14:00:03.200731600Z",
"severity": "ERROR",
"labels": {
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq",
"k8s-pod/pod-template-hash": "888f76864",
"k8s-pod/app": "lte-m-csv-parser"
},
"logName": "projects/hark-tech/logs/stderr",
"receiveTimestamp": "2024-05-02T14:00:07.234686375Z"
},
{
"textPayload": "2024/05/02 14:00:03 Error producing message: CORRUPT_MESSAGE: This message has failed its CRC checksum, exceeds the valid size, has a null key for a compacted topic, or is otherwise corrupt.",
"insertId": "7a1ftezk0n9tiky1",
"resource": {
"type": "k8s_container",
"labels": {
"cluster_name": "dev",
"location": "europe-west1-b",
"container_name": "lte-m-csv-parser",
"project_id": "hark-tech",
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"namespace_name": "redpanda"
}
},
"timestamp": "2024-05-02T14:00:03.200744982Z",
"severity": "ERROR",
"labels": {
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq",
"k8s-pod/app": "lte-m-csv-parser",
"k8s-pod/pod-template-hash": "888f76864"
},
"logName": "projects/hark-tech/logs/stderr",
"receiveTimestamp": "2024-05-02T14:00:07.234686375Z"
},
{
"textPayload": "2024/05/02 14:00:03 Error producing message: CORRUPT_MESSAGE: This message has failed its CRC checksum, exceeds the valid size, has a null key for a compacted topic, or is otherwise corrupt.",
"insertId": "2klo23y8xguj0skx",
"resource": {
"type": "k8s_container",
"labels": {
"cluster_name": "dev",
"project_id": "hark-tech",
"namespace_name": "redpanda",
"container_name": "lte-m-csv-parser",
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"location": "europe-west1-b"
}
},
"timestamp": "2024-05-02T14:00:03.200750718Z",
"severity": "ERROR",
"labels": {
"k8s-pod/pod-template-hash": "888f76864",
"k8s-pod/app": "lte-m-csv-parser",
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq"
},
"logName": "projects/hark-tech/logs/stderr",
"receiveTimestamp": "2024-05-02T14:00:07.234686375Z"
},
{
"textPayload": "2024/05/02 14:00:03 Error producing message: CORRUPT_MESSAGE: This message has failed its CRC checksum, exceeds the valid size, has a null key for a compacted topic, or is otherwise corrupt.",
"insertId": "u67gipxybuha14q0",
"resource": {
"type": "k8s_container",
"labels": {
"cluster_name": "dev",
"namespace_name": "redpanda",
"container_name": "lte-m-csv-parser",
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"project_id": "hark-tech",
"location": "europe-west1-b"
}
},
"timestamp": "2024-05-02T14:00:03.200803950Z",
"severity": "ERROR",
"labels": {
"k8s-pod/pod-template-hash": "888f76864",
"k8s-pod/app": "lte-m-csv-parser",
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq"
},
"logName": "projects/hark-tech/logs/stderr",
"receiveTimestamp": "2024-05-02T14:00:07.234686375Z"
},
{
"textPayload": "2024/05/02 14:00:03 Error producing message: CORRUPT_MESSAGE: This message has failed its CRC checksum, exceeds the valid size, has a null key for a compacted topic, or is otherwise corrupt.",
"insertId": "l5jbkt2bij077dc1",
"resource": {
"type": "k8s_container",
"labels": {
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"namespace_name": "redpanda",
"location": "europe-west1-b",
"cluster_name": "dev",
"project_id": "hark-tech",
"container_name": "lte-m-csv-parser"
}
},
"timestamp": "2024-05-02T14:00:03.200811961Z",
"severity": "ERROR",
"labels": {
"k8s-pod/pod-template-hash": "888f76864",
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq",
"k8s-pod/app": "lte-m-csv-parser"
},
"logName": "projects/hark-tech/logs/stderr",
"receiveTimestamp": "2024-05-02T14:00:07.234686375Z"
},
{
"textPayload": "2024/05/02 14:00:03 Error producing message: CORRUPT_MESSAGE: This message has failed its CRC checksum, exceeds the valid size, has a null key for a compacted topic, or is otherwise corrupt.",
"insertId": "41j9pjqcniojdmqi",
"resource": {
"type": "k8s_container",
"labels": {
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"project_id": "hark-tech",
"container_name": "lte-m-csv-parser",
"location": "europe-west1-b",
"cluster_name": "dev",
"namespace_name": "redpanda"
}
},
"timestamp": "2024-05-02T14:00:03.200817045Z",
"severity": "ERROR",
"labels": {
"k8s-pod/app": "lte-m-csv-parser",
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq",
"k8s-pod/pod-template-hash": "888f76864"
},
"logName": "projects/hark-tech/logs/stderr",
"receiveTimestamp": "2024-05-02T14:00:07.234686375Z"
},
{
"textPayload": "2024/05/02 14:00:03 Error producing message: CORRUPT_MESSAGE: This message has failed its CRC checksum, exceeds the valid size, has a null key for a compacted topic, or is otherwise corrupt.",
"insertId": "g1v9h1wnf7rpkhyo",
"resource": {
"type": "k8s_container",
"labels": {
"cluster_name": "dev",
"container_name": "lte-m-csv-parser",
"namespace_name": "redpanda",
"location": "europe-west1-b",
"project_id": "hark-tech",
"pod_name": "lte-m-csv-parser-888f76864-p89t5"
}
},
"timestamp": "2024-05-02T14:00:03.200822550Z",
"severity": "ERROR",
"labels": {
"k8s-pod/pod-template-hash": "888f76864",
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq",
"k8s-pod/app": "lte-m-csv-parser"
},
"logName": "projects/hark-tech/logs/stderr",
"receiveTimestamp": "2024-05-02T14:00:07.234686375Z"
},
{
"textPayload": "2024/05/02 14:00:03 Error producing message: CORRUPT_MESSAGE: This message has failed its CRC checksum, exceeds the valid size, has a null key for a compacted topic, or is otherwise corrupt.",
"insertId": "dwwiolb1gl37iwi5",
"resource": {
"type": "k8s_container",
"labels": {
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"cluster_name": "dev",
"namespace_name": "redpanda",
"project_id": "hark-tech",
"location": "europe-west1-b",
"container_name": "lte-m-csv-parser"
}
},
"timestamp": "2024-05-02T14:00:03.200827617Z",
"severity": "ERROR",
"labels": {
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq",
"k8s-pod/app": "lte-m-csv-parser",
"k8s-pod/pod-template-hash": "888f76864"
},
"logName": "projects/hark-tech/logs/stderr",
"receiveTimestamp": "2024-05-02T14:00:07.234686375Z"
},
{
"textPayload": "2024/05/02 14:00:03 Error producing message: CORRUPT_MESSAGE: This message has failed its CRC checksum, exceeds the valid size, has a null key for a compacted topic, or is otherwise corrupt.",
"insertId": "tyk2xbxpst5xiwkg",
"resource": {
"type": "k8s_container",
"labels": {
"project_id": "hark-tech",
"cluster_name": "dev",
"namespace_name": "redpanda",
"container_name": "lte-m-csv-parser",
"location": "europe-west1-b",
"pod_name": "lte-m-csv-parser-888f76864-p89t5"
}
},
"timestamp": "2024-05-02T14:00:03.200832168Z",
"severity": "ERROR",
"labels": {
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq",
"k8s-pod/pod-template-hash": "888f76864",
"k8s-pod/app": "lte-m-csv-parser"
},
"logName": "projects/hark-tech/logs/stderr",
"receiveTimestamp": "2024-05-02T14:00:07.234686375Z"
},
{
"textPayload": "2024/05/02 14:00:03 Error producing message: CORRUPT_MESSAGE: This message has failed its CRC checksum, exceeds the valid size, has a null key for a compacted topic, or is otherwise corrupt.",
"insertId": "28t5ewdopxkdf0sj",
"resource": {
"type": "k8s_container",
"labels": {
"container_name": "lte-m-csv-parser",
"project_id": "hark-tech",
"location": "europe-west1-b",
"cluster_name": "dev",
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"namespace_name": "redpanda"
}
},
"timestamp": "2024-05-02T14:00:03.200837051Z",
"severity": "ERROR",
"labels": {
"k8s-pod/pod-template-hash": "888f76864",
"k8s-pod/app": "lte-m-csv-parser",
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq"
},
"logName": "projects/hark-tech/logs/stderr",
"receiveTimestamp": "2024-05-02T14:00:07.234686375Z"
},
{
"textPayload": "2024/05/02 14:00:03 Error producing message: CORRUPT_MESSAGE: This message has failed its CRC checksum, exceeds the valid size, has a null key for a compacted topic, or is otherwise corrupt.",
"insertId": "6xcg4vuaalulk3ds",
"resource": {
"type": "k8s_container",
"labels": {
"cluster_name": "dev",
"location": "europe-west1-b",
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"container_name": "lte-m-csv-parser",
"namespace_name": "redpanda",
"project_id": "hark-tech"
}
},
"timestamp": "2024-05-02T14:00:03.200842280Z",
"severity": "ERROR",
"labels": {
"k8s-pod/pod-template-hash": "888f76864",
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq",
"k8s-pod/app": "lte-m-csv-parser"
},
"logName": "projects/hark-tech/logs/stderr",
"receiveTimestamp": "2024-05-02T14:00:07.234686375Z"
},
{
"textPayload": "2024/05/02 14:00:03 Error producing message: CORRUPT_MESSAGE: This message has failed its CRC checksum, exceeds the valid size, has a null key for a compacted topic, or is otherwise corrupt.",
"insertId": "fawakghjizj7aesv",
"resource": {
"type": "k8s_container",
"labels": {
"cluster_name": "dev",
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"project_id": "hark-tech",
"namespace_name": "redpanda",
"location": "europe-west1-b",
"container_name": "lte-m-csv-parser"
}
},
"timestamp": "2024-05-02T14:00:03.200848397Z",
"severity": "ERROR",
"labels": {
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq",
"k8s-pod/app": "lte-m-csv-parser",
"k8s-pod/pod-template-hash": "888f76864"
},
"logName": "projects/hark-tech/logs/stderr",
"receiveTimestamp": "2024-05-02T14:00:07.234686375Z"
},
{
"textPayload": "2024/05/02 14:00:03 Error producing message: CORRUPT_MESSAGE: This message has failed its CRC checksum, exceeds the valid size, has a null key for a compacted topic, or is otherwise corrupt.",
"insertId": "c03bjjlglr90jjp6",
"resource": {
"type": "k8s_container",
"labels": {
"namespace_name": "redpanda",
"cluster_name": "dev",
"container_name": "lte-m-csv-parser",
"project_id": "hark-tech",
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"location": "europe-west1-b"
}
},
"timestamp": "2024-05-02T14:00:03.200853423Z",
"severity": "ERROR",
"labels": {
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq",
"k8s-pod/app": "lte-m-csv-parser",
"k8s-pod/pod-template-hash": "888f76864"
},
"logName": "projects/hark-tech/logs/stderr",
"receiveTimestamp": "2024-05-02T14:00:07.234686375Z"
},
{
"textPayload": "2024/05/02 14:00:03 Error producing message: CORRUPT_MESSAGE: This message has failed its CRC checksum, exceeds the valid size, has a null key for a compacted topic, or is otherwise corrupt.",
"insertId": "m29yyk53rrwey4sp",
"resource": {
"type": "k8s_container",
"labels": {
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"container_name": "lte-m-csv-parser",
"location": "europe-west1-b",
"project_id": "hark-tech",
"namespace_name": "redpanda",
"cluster_name": "dev"
}
},
"timestamp": "2024-05-02T14:00:03.200858705Z",
"severity": "ERROR",
"labels": {
"k8s-pod/app": "lte-m-csv-parser",
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq",
"k8s-pod/pod-template-hash": "888f76864"
},
"logName": "projects/hark-tech/logs/stderr",
"receiveTimestamp": "2024-05-02T14:00:07.234686375Z"
},
{
"textPayload": "2024/05/02 14:00:03 Error producing message: CORRUPT_MESSAGE: This message has failed its CRC checksum, exceeds the valid size, has a null key for a compacted topic, or is otherwise corrupt.",
"insertId": "lt8hhrmmcppb2wa5",
"resource": {
"type": "k8s_container",
"labels": {
"namespace_name": "redpanda",
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"location": "europe-west1-b",
"container_name": "lte-m-csv-parser",
"cluster_name": "dev",
"project_id": "hark-tech"
}
},
"timestamp": "2024-05-02T14:00:03.200863834Z",
"severity": "ERROR",
"labels": {
"k8s-pod/pod-template-hash": "888f76864",
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq",
"k8s-pod/app": "lte-m-csv-parser"
},
"logName": "projects/hark-tech/logs/stderr",
"receiveTimestamp": "2024-05-02T14:00:07.234686375Z"
},
{
"textPayload": "2024/05/02 14:00:03 Error producing message: CORRUPT_MESSAGE: This message has failed its CRC checksum, exceeds the valid size, has a null key for a compacted topic, or is otherwise corrupt.",
"insertId": "ddqbjc7c52s2xssx",
"resource": {
"type": "k8s_container",
"labels": {
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"location": "europe-west1-b",
"namespace_name": "redpanda",
"cluster_name": "dev",
"project_id": "hark-tech",
"container_name": "lte-m-csv-parser"
}
},
"timestamp": "2024-05-02T14:00:03.200869056Z",
"severity": "ERROR",
"labels": {
"k8s-pod/pod-template-hash": "888f76864",
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq",
"k8s-pod/app": "lte-m-csv-parser"
},
"logName": "projects/hark-tech/logs/stderr",
"receiveTimestamp": "2024-05-02T14:00:07.234686375Z"
},
{
"textPayload": "2024/05/02 14:00:03 Error producing message: CORRUPT_MESSAGE: This message has failed its CRC checksum, exceeds the valid size, has a null key for a compacted topic, or is otherwise corrupt.",
"insertId": "gsdiomfo7554uhii",
"resource": {
"type": "k8s_container",
"labels": {
"project_id": "hark-tech",
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"cluster_name": "dev",
"location": "europe-west1-b",
"container_name": "lte-m-csv-parser",
"namespace_name": "redpanda"
}
},
"timestamp": "2024-05-02T14:00:03.200873945Z",
"severity": "ERROR",
"labels": {
"k8s-pod/pod-template-hash": "888f76864",
"k8s-pod/app": "lte-m-csv-parser",
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq"
},
"logName": "projects/hark-tech/logs/stderr",
"receiveTimestamp": "2024-05-02T14:00:07.234686375Z"
},
{
"textPayload": "2024/05/02 14:00:03 Error producing message: CORRUPT_MESSAGE: This message has failed its CRC checksum, exceeds the valid size, has a null key for a compacted topic, or is otherwise corrupt.",
"insertId": "5k3mcv08be7zz5ds",
"resource": {
"type": "k8s_container",
"labels": {
"container_name": "lte-m-csv-parser",
"namespace_name": "redpanda",
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"project_id": "hark-tech",
"cluster_name": "dev",
"location": "europe-west1-b"
}
},
"timestamp": "2024-05-02T14:00:03.200879103Z",
"severity": "ERROR",
"labels": {
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq",
"k8s-pod/pod-template-hash": "888f76864",
"k8s-pod/app": "lte-m-csv-parser"
},
"logName": "projects/hark-tech/logs/stderr",
"receiveTimestamp": "2024-05-02T14:00:07.234686375Z"
},
{
"textPayload": "2024/05/02 14:00:03 Error producing message: CORRUPT_MESSAGE: This message has failed its CRC checksum, exceeds the valid size, has a null key for a compacted topic, or is otherwise corrupt.",
"insertId": "4zaj9ew7lwyvqcxq",
"resource": {
"type": "k8s_container",
"labels": {
"project_id": "hark-tech",
"location": "europe-west1-b",
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"cluster_name": "dev",
"namespace_name": "redpanda",
"container_name": "lte-m-csv-parser"
}
},
"timestamp": "2024-05-02T14:00:03.200921188Z",
"severity": "ERROR",
"labels": {
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq",
"k8s-pod/pod-template-hash": "888f76864",
"k8s-pod/app": "lte-m-csv-parser"
},
"logName": "projects/hark-tech/logs/stderr",
"receiveTimestamp": "2024-05-02T14:00:07.234686375Z"
},
{
"textPayload": "2024/05/02 14:00:03 Error producing message: CORRUPT_MESSAGE: This message has failed its CRC checksum, exceeds the valid size, has a null key for a compacted topic, or is otherwise corrupt.",
"insertId": "lsjn8c35rng0s6q3",
"resource": {
"type": "k8s_container",
"labels": {
"namespace_name": "redpanda",
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"project_id": "hark-tech",
"location": "europe-west1-b",
"cluster_name": "dev",
"container_name": "lte-m-csv-parser"
}
},
"timestamp": "2024-05-02T14:00:03.200931190Z",
"severity": "ERROR",
"labels": {
"k8s-pod/app": "lte-m-csv-parser",
"k8s-pod/pod-template-hash": "888f76864",
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq"
},
"logName": "projects/hark-tech/logs/stderr",
"receiveTimestamp": "2024-05-02T14:00:07.234686375Z"
},
{
"textPayload": "2024/05/02 14:00:03 Error producing message: CORRUPT_MESSAGE: This message has failed its CRC checksum, exceeds the valid size, has a null key for a compacted topic, or is otherwise corrupt.",
"insertId": "jurzc3qrrl0usm1r",
"resource": {
"type": "k8s_container",
"labels": {
"cluster_name": "dev",
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"project_id": "hark-tech",
"container_name": "lte-m-csv-parser",
"location": "europe-west1-b",
"namespace_name": "redpanda"
}
},
"timestamp": "2024-05-02T14:00:03.200936073Z",
"severity": "ERROR",
"labels": {
"k8s-pod/pod-template-hash": "888f76864",
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq",
"k8s-pod/app": "lte-m-csv-parser"
},
"logName": "projects/hark-tech/logs/stderr",
"receiveTimestamp": "2024-05-02T14:00:07.234686375Z"
},
{
"textPayload": "2024/05/02 14:00:03 Error producing message: CORRUPT_MESSAGE: This message has failed its CRC checksum, exceeds the valid size, has a null key for a compacted topic, or is otherwise corrupt.",
"insertId": "6nqentmv089sklfx",
"resource": {
"type": "k8s_container",
"labels": {
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"location": "europe-west1-b",
"namespace_name": "redpanda",
"cluster_name": "dev",
"container_name": "lte-m-csv-parser",
"project_id": "hark-tech"
}
},
"timestamp": "2024-05-02T14:00:03.200986799Z",
"severity": "ERROR",
"labels": {
"k8s-pod/app": "lte-m-csv-parser",
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq",
"k8s-pod/pod-template-hash": "888f76864"
},
"logName": "projects/hark-tech/logs/stderr",
"receiveTimestamp": "2024-05-02T14:00:07.234686375Z"
},
{
"textPayload": "2024/05/02 14:00:03 Error producing message: CORRUPT_MESSAGE: This message has failed its CRC checksum, exceeds the valid size, has a null key for a compacted topic, or is otherwise corrupt.",
"insertId": "xq9drlcenllaifpw",
"resource": {
"type": "k8s_container",
"labels": {
"project_id": "hark-tech",
"location": "europe-west1-b",
"container_name": "lte-m-csv-parser",
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"cluster_name": "dev",
"namespace_name": "redpanda"
}
},
"timestamp": "2024-05-02T14:00:03.200994437Z",
"severity": "ERROR",
"labels": {
"k8s-pod/app": "lte-m-csv-parser",
"k8s-pod/pod-template-hash": "888f76864",
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq"
},
"logName": "projects/hark-tech/logs/stderr",
"receiveTimestamp": "2024-05-02T14:00:07.234686375Z"
},
{
"textPayload": "2024/05/02 14:00:03 Error producing message: CORRUPT_MESSAGE: This message has failed its CRC checksum, exceeds the valid size, has a null key for a compacted topic, or is otherwise corrupt.",
"insertId": "kbr5pw8eghank0g1",
"resource": {
"type": "k8s_container",
"labels": {
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"container_name": "lte-m-csv-parser",
"cluster_name": "dev",
"namespace_name": "redpanda",
"project_id": "hark-tech",
"location": "europe-west1-b"
}
},
"timestamp": "2024-05-02T14:00:03.201000046Z",
"severity": "ERROR",
"labels": {
"k8s-pod/pod-template-hash": "888f76864",
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq",
"k8s-pod/app": "lte-m-csv-parser"
},
"logName": "projects/hark-tech/logs/stderr",
"receiveTimestamp": "2024-05-02T14:00:07.234686375Z"
},
{
"textPayload": "2024/05/02 14:00:03 Error producing message: CORRUPT_MESSAGE: This message has failed its CRC checksum, exceeds the valid size, has a null key for a compacted topic, or is otherwise corrupt.",
"insertId": "9lfatmkitebgy296",
"resource": {
"type": "k8s_container",
"labels": {
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"cluster_name": "dev",
"namespace_name": "redpanda",
"project_id": "hark-tech",
"location": "europe-west1-b",
"container_name": "lte-m-csv-parser"
}
},
"timestamp": "2024-05-02T14:00:03.201004949Z",
"severity": "ERROR",
"labels": {
"k8s-pod/pod-template-hash": "888f76864",
"k8s-pod/app": "lte-m-csv-parser",
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq"
},
"logName": "projects/hark-tech/logs/stderr",
"receiveTimestamp": "2024-05-02T14:00:07.234686375Z"
},
{
"textPayload": "2024/05/02 14:00:03 Error producing message: CORRUPT_MESSAGE: This message has failed its CRC checksum, exceeds the valid size, has a null key for a compacted topic, or is otherwise corrupt.",
"insertId": "xn6uga04qnmhbiwc",
"resource": {
"type": "k8s_container",
"labels": {
"container_name": "lte-m-csv-parser",
"project_id": "hark-tech",
"location": "europe-west1-b",
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"namespace_name": "redpanda",
"cluster_name": "dev"
}
},
"timestamp": "2024-05-02T14:00:03.201020847Z",
"severity": "ERROR",
"labels": {
"k8s-pod/pod-template-hash": "888f76864",
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq",
"k8s-pod/app": "lte-m-csv-parser"
},
"logName": "projects/hark-tech/logs/stderr",
"receiveTimestamp": "2024-05-02T14:00:07.234686375Z"
},
{
"textPayload": "2024/05/02 14:00:03 Error producing message: CORRUPT_MESSAGE: This message has failed its CRC checksum, exceeds the valid size, has a null key for a compacted topic, or is otherwise corrupt.",
"insertId": "3f9cihyr043ixyva",
"resource": {
"type": "k8s_container",
"labels": {
"container_name": "lte-m-csv-parser",
"project_id": "hark-tech",
"location": "europe-west1-b",
"cluster_name": "dev",
"namespace_name": "redpanda",
"pod_name": "lte-m-csv-parser-888f76864-p89t5"
}
},
"timestamp": "2024-05-02T14:00:03.201025913Z",
"severity": "ERROR",
"labels": {
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq",
"k8s-pod/app": "lte-m-csv-parser",
"k8s-pod/pod-template-hash": "888f76864"
},
"logName": "projects/hark-tech/logs/stderr",
"receiveTimestamp": "2024-05-02T14:00:07.234686375Z"
},
{
"textPayload": "2024/05/02 14:00:03 Error producing message: CORRUPT_MESSAGE: This message has failed its CRC checksum, exceeds the valid size, has a null key for a compacted topic, or is otherwise corrupt.",
"insertId": "958rvhd6vvcrc4xn",
"resource": {
"type": "k8s_container",
"labels": {
"namespace_name": "redpanda",
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"cluster_name": "dev",
"container_name": "lte-m-csv-parser",
"location": "europe-west1-b",
"project_id": "hark-tech"
}
},
"timestamp": "2024-05-02T14:00:03.201030632Z",
"severity": "ERROR",
"labels": {
"k8s-pod/app": "lte-m-csv-parser",
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq",
"k8s-pod/pod-template-hash": "888f76864"
},
"logName": "projects/hark-tech/logs/stderr",
"receiveTimestamp": "2024-05-02T14:00:07.234686375Z"
},
{
"textPayload": "2024/05/02 14:00:03 Error producing message: CORRUPT_MESSAGE: This message has failed its CRC checksum, exceeds the valid size, has a null key for a compacted topic, or is otherwise corrupt.",
"insertId": "uu5ioa69s6vd1qth",
"resource": {
"type": "k8s_container",
"labels": {
"location": "europe-west1-b",
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"cluster_name": "dev",
"project_id": "hark-tech",
"namespace_name": "redpanda",
"container_name": "lte-m-csv-parser"
}
},
"timestamp": "2024-05-02T14:00:03.201035887Z",
"severity": "ERROR",
"labels": {
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq",
"k8s-pod/app": "lte-m-csv-parser",
"k8s-pod/pod-template-hash": "888f76864"
},
"logName": "projects/hark-tech/logs/stderr",
"receiveTimestamp": "2024-05-02T14:00:07.234686375Z"
},
{
"textPayload": "2024/05/02 14:00:03 Error producing message: CORRUPT_MESSAGE: This message has failed its CRC checksum, exceeds the valid size, has a null key for a compacted topic, or is otherwise corrupt.",
"insertId": "jpp9d0dj2m287zys",
"resource": {
"type": "k8s_container",
"labels": {
"project_id": "hark-tech",
"location": "europe-west1-b",
"cluster_name": "dev",
"container_name": "lte-m-csv-parser",
"namespace_name": "redpanda",
"pod_name": "lte-m-csv-parser-888f76864-p89t5"
}
},
"timestamp": "2024-05-02T14:00:03.201041178Z",
"severity": "ERROR",
"labels": {
"k8s-pod/pod-template-hash": "888f76864",
"k8s-pod/app": "lte-m-csv-parser",
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq"
},
"logName": "projects/hark-tech/logs/stderr",
"receiveTimestamp": "2024-05-02T14:00:07.234686375Z"
},
{
"textPayload": "2024/05/02 14:00:03 Error producing message: CORRUPT_MESSAGE: This message has failed its CRC checksum, exceeds the valid size, has a null key for a compacted topic, or is otherwise corrupt.",
"insertId": "wbl7ve1pxukutneu",
"resource": {
"type": "k8s_container",
"labels": {
"container_name": "lte-m-csv-parser",
"namespace_name": "redpanda",
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"location": "europe-west1-b",
"project_id": "hark-tech",
"cluster_name": "dev"
}
},
"timestamp": "2024-05-02T14:00:03.201046647Z",
"severity": "ERROR",
"labels": {
"k8s-pod/app": "lte-m-csv-parser",
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq",
"k8s-pod/pod-template-hash": "888f76864"
},
"logName": "projects/hark-tech/logs/stderr",
"receiveTimestamp": "2024-05-02T14:00:07.234686375Z"
},
{
"textPayload": "2024/05/02 14:00:03 Error producing message: CORRUPT_MESSAGE: This message has failed its CRC checksum, exceeds the valid size, has a null key for a compacted topic, or is otherwise corrupt.",
"insertId": "20i99k5nqa4dzv1t",
"resource": {
"type": "k8s_container",
"labels": {
"project_id": "hark-tech",
"location": "europe-west1-b",
"namespace_name": "redpanda",
"cluster_name": "dev",
"container_name": "lte-m-csv-parser",
"pod_name": "lte-m-csv-parser-888f76864-p89t5"
}
},
"timestamp": "2024-05-02T14:00:03.201052214Z",
"severity": "ERROR",
"labels": {
"k8s-pod/pod-template-hash": "888f76864",
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq",
"k8s-pod/app": "lte-m-csv-parser"
},
"logName": "projects/hark-tech/logs/stderr",
"receiveTimestamp": "2024-05-02T14:00:07.234686375Z"
},
{
"textPayload": "2024/05/02 14:00:03 Error producing message: CORRUPT_MESSAGE: This message has failed its CRC checksum, exceeds the valid size, has a null key for a compacted topic, or is otherwise corrupt.",
"insertId": "v7w5bgrgxj18gr17",
"resource": {
"type": "k8s_container",
"labels": {
"project_id": "hark-tech",
"location": "europe-west1-b",
"container_name": "lte-m-csv-parser",
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"cluster_name": "dev",
"namespace_name": "redpanda"
}
},
"timestamp": "2024-05-02T14:00:03.201057364Z",
"severity": "ERROR",
"labels": {
"k8s-pod/pod-template-hash": "888f76864",
"k8s-pod/app": "lte-m-csv-parser",
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq"
},
"logName": "projects/hark-tech/logs/stderr",
"receiveTimestamp": "2024-05-02T14:00:07.234686375Z"
},
{
"textPayload": "2024/05/02 14:00:03 Error producing message: CORRUPT_MESSAGE: This message has failed its CRC checksum, exceeds the valid size, has a null key for a compacted topic, or is otherwise corrupt.",
"insertId": "lwl9ny4m1lwn6u3p",
"resource": {
"type": "k8s_container",
"labels": {
"cluster_name": "dev",
"container_name": "lte-m-csv-parser",
"project_id": "hark-tech",
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"namespace_name": "redpanda",
"location": "europe-west1-b"
}
},
"timestamp": "2024-05-02T14:00:03.201062562Z",
"severity": "ERROR",
"labels": {
"k8s-pod/pod-template-hash": "888f76864",
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq",
"k8s-pod/app": "lte-m-csv-parser"
},
"logName": "projects/hark-tech/logs/stderr",
"receiveTimestamp": "2024-05-02T14:00:07.234686375Z"
},
{
"textPayload": "2024/05/02 14:00:03 Error producing message: CORRUPT_MESSAGE: This message has failed its CRC checksum, exceeds the valid size, has a null key for a compacted topic, or is otherwise corrupt.",
"insertId": "0q8opqbahi0sxuf6",
"resource": {
"type": "k8s_container",
"labels": {
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"project_id": "hark-tech",
"location": "europe-west1-b",
"namespace_name": "redpanda",
"cluster_name": "dev",
"container_name": "lte-m-csv-parser"
}
},
"timestamp": "2024-05-02T14:00:03.201074817Z",
"severity": "ERROR",
"labels": {
"k8s-pod/app": "lte-m-csv-parser",
"k8s-pod/pod-template-hash": "888f76864",
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq"
},
"logName": "projects/hark-tech/logs/stderr",
"receiveTimestamp": "2024-05-02T14:00:07.234686375Z"
},
{
"textPayload": "2024/05/02 14:00:03 Error producing message: CORRUPT_MESSAGE: This message has failed its CRC checksum, exceeds the valid size, has a null key for a compacted topic, or is otherwise corrupt.",
"insertId": "vif72chl6z47b8w2",
"resource": {
"type": "k8s_container",
"labels": {
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"container_name": "lte-m-csv-parser",
"namespace_name": "redpanda",
"project_id": "hark-tech",
"cluster_name": "dev",
"location": "europe-west1-b"
}
},
"timestamp": "2024-05-02T14:00:03.201088963Z",
"severity": "ERROR",
"labels": {
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq",
"k8s-pod/pod-template-hash": "888f76864",
"k8s-pod/app": "lte-m-csv-parser"
},
"logName": "projects/hark-tech/logs/stderr",
"receiveTimestamp": "2024-05-02T14:00:07.234686375Z"
},
{
"textPayload": "2024/05/02 14:00:03 Error producing message: CORRUPT_MESSAGE: This message has failed its CRC checksum, exceeds the valid size, has a null key for a compacted topic, or is otherwise corrupt.",
"insertId": "e9v2z5kf0hideauv",
"resource": {
"type": "k8s_container",
"labels": {
"location": "europe-west1-b",
"namespace_name": "redpanda",
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"cluster_name": "dev",
"container_name": "lte-m-csv-parser",
"project_id": "hark-tech"
}
},
"timestamp": "2024-05-02T14:00:03.201094475Z",
"severity": "ERROR",
"labels": {
"k8s-pod/app": "lte-m-csv-parser",
"k8s-pod/pod-template-hash": "888f76864",
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq"
},
"logName": "projects/hark-tech/logs/stderr",
"receiveTimestamp": "2024-05-02T14:00:07.234686375Z"
},
{
"textPayload": "2024/05/02 14:00:03 Error producing message: CORRUPT_MESSAGE: This message has failed its CRC checksum, exceeds the valid size, has a null key for a compacted topic, or is otherwise corrupt.",
"insertId": "pz5hleexr5hchn9s",
"resource": {
"type": "k8s_container",
"labels": {
"namespace_name": "redpanda",
"location": "europe-west1-b",
"project_id": "hark-tech",
"cluster_name": "dev",
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"container_name": "lte-m-csv-parser"
}
},
"timestamp": "2024-05-02T14:00:03.201099383Z",
"severity": "ERROR",
"labels": {
"k8s-pod/app": "lte-m-csv-parser",
"k8s-pod/pod-template-hash": "888f76864",
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq"
},
"logName": "projects/hark-tech/logs/stderr",
"receiveTimestamp": "2024-05-02T14:00:07.234686375Z"
},
{
"textPayload": "2024/05/02 14:00:03 Error producing message: CORRUPT_MESSAGE: This message has failed its CRC checksum, exceeds the valid size, has a null key for a compacted topic, or is otherwise corrupt.",
"insertId": "60u2rx12h5hk3p8i",
"resource": {
"type": "k8s_container",
"labels": {
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"location": "europe-west1-b",
"container_name": "lte-m-csv-parser",
"namespace_name": "redpanda",
"project_id": "hark-tech",
"cluster_name": "dev"
}
},
"timestamp": "2024-05-02T14:00:03.201104086Z",
"severity": "ERROR",
"labels": {
"k8s-pod/app": "lte-m-csv-parser",
"k8s-pod/pod-template-hash": "888f76864",
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq"
},
"logName": "projects/hark-tech/logs/stderr",
"receiveTimestamp": "2024-05-02T14:00:07.234686375Z"
},
{
"textPayload": "2024/05/02 14:00:03 Error producing message: CORRUPT_MESSAGE: This message has failed its CRC checksum, exceeds the valid size, has a null key for a compacted topic, or is otherwise corrupt.",
"insertId": "z61jx2xfikfdcghh",
"resource": {
"type": "k8s_container",
"labels": {
"cluster_name": "dev",
"location": "europe-west1-b",
"container_name": "lte-m-csv-parser",
"project_id": "hark-tech",
"namespace_name": "redpanda",
"pod_name": "lte-m-csv-parser-888f76864-p89t5"
}
},
"timestamp": "2024-05-02T14:00:03.201109261Z",
"severity": "ERROR",
"labels": {
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq",
"k8s-pod/app": "lte-m-csv-parser",
"k8s-pod/pod-template-hash": "888f76864"
},
"logName": "projects/hark-tech/logs/stderr",
"receiveTimestamp": "2024-05-02T14:00:07.234686375Z"
},
{
"textPayload": "2024/05/02 14:00:03 Error producing message: CORRUPT_MESSAGE: This message has failed its CRC checksum, exceeds the valid size, has a null key for a compacted topic, or is otherwise corrupt.",
"insertId": "tnbf8ggxq8c53h2l",
"resource": {
"type": "k8s_container",
"labels": {
"cluster_name": "dev",
"namespace_name": "redpanda",
"project_id": "hark-tech",
"location": "europe-west1-b",
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"container_name": "lte-m-csv-parser"
}
},
"timestamp": "2024-05-02T14:00:03.201191523Z",
"severity": "ERROR",
"labels": {
"k8s-pod/app": "lte-m-csv-parser",
"k8s-pod/pod-template-hash": "888f76864",
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq"
},
"logName": "projects/hark-tech/logs/stderr",
"receiveTimestamp": "2024-05-02T14:00:07.234686375Z"
},
{
"textPayload": "2024/05/02 14:00:03 Error producing message: CORRUPT_MESSAGE: This message has failed its CRC checksum, exceeds the valid size, has a null key for a compacted topic, or is otherwise corrupt.",
"insertId": "buzs4863ldvdxaix",
"resource": {
"type": "k8s_container",
"labels": {
"location": "europe-west1-b",
"namespace_name": "redpanda",
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"cluster_name": "dev",
"project_id": "hark-tech",
"container_name": "lte-m-csv-parser"
}
},
"timestamp": "2024-05-02T14:00:03.201200345Z",
"severity": "ERROR",
"labels": {
"k8s-pod/pod-template-hash": "888f76864",
"k8s-pod/app": "lte-m-csv-parser",
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq"
},
"logName": "projects/hark-tech/logs/stderr",
"receiveTimestamp": "2024-05-02T14:00:07.234686375Z"
},
{
"textPayload": "PRODUCER[DEBUG] produced; broker: 2, to: test_slett[0{err@-1,6(CORRUPT_MESSAGE: This message has failed its CRC checksum, exceeds the valid size, has a null key for a compacted topic, or is otherwise corrupt.)}]",
"insertId": "b81yo62m8cxxv61l",
"resource": {
"type": "k8s_container",
"labels": {
"cluster_name": "dev",
"container_name": "lte-m-csv-parser",
"project_id": "hark-tech",
"namespace_name": "redpanda",
"location": "europe-west1-b",
"pod_name": "lte-m-csv-parser-888f76864-p89t5"
}
},
"timestamp": "2024-05-02T14:00:03.201274257Z",
"severity": "INFO",
"labels": {
"k8s-pod/pod-template-hash": "888f76864",
"k8s-pod/app": "lte-m-csv-parser",
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq"
},
"logName": "projects/hark-tech/logs/stdout",
"receiveTimestamp": "2024-05-02T14:00:06.722845798Z"
},
{
"textPayload": "PRODUCER[DEBUG] wrote Produce v7; broker: 2, bytes_written: 1039, write_wait: 88.722µs, time_to_write: 33.74µs, err: <nil>",
"insertId": "iwv9vzba0hzy0fk4",
"resource": {
"type": "k8s_container",
"labels": {
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"namespace_name": "redpanda",
"container_name": "lte-m-csv-parser",
"project_id": "hark-tech",
"cluster_name": "dev",
"location": "europe-west1-b"
}
},
"timestamp": "2024-05-02T14:00:03.657036219Z",
"severity": "INFO",
"labels": {
"k8s-pod/app": "lte-m-csv-parser",
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq",
"k8s-pod/pod-template-hash": "888f76864"
},
"logName": "projects/hark-tech/logs/stdout",
"receiveTimestamp": "2024-05-02T14:00:06.722845798Z"
},
{
"textPayload": "PRODUCER[DEBUG] read Produce v7; broker: 2, bytes_read: 0, read_wait: 140.701µs, time_to_read: 397.911µs, err: EOF",
"insertId": "szxrottk16hgmtrs",
"resource": {
"type": "k8s_container",
"labels": {
"cluster_name": "dev",
"location": "europe-west1-b",
"container_name": "lte-m-csv-parser",
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"namespace_name": "redpanda",
"project_id": "hark-tech"
}
},
"timestamp": "2024-05-02T14:00:03.657607336Z",
"severity": "INFO",
"labels": {
"k8s-pod/app": "lte-m-csv-parser",
"k8s-pod/pod-template-hash": "888f76864",
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq"
},
"logName": "projects/hark-tech/logs/stdout",
"receiveTimestamp": "2024-05-02T14:00:06.722845798Z"
},
{
"textPayload": "PRODUCER[DEBUG] read from broker errored, killing connection; addr: redpanda-2.redpanda.redpanda.svc.cluster.local.:9093, broker: 2, successful_reads: 1, err: EOF",
"insertId": "xoerx0fxm4e6ygpf",
"resource": {
"type": "k8s_container",
"labels": {
"container_name": "lte-m-csv-parser",
"cluster_name": "dev",
"project_id": "hark-tech",
"location": "europe-west1-b",
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"namespace_name": "redpanda"
}
},
"timestamp": "2024-05-02T14:00:03.657770100Z",
"severity": "INFO",
"labels": {
"k8s-pod/app": "lte-m-csv-parser",
"k8s-pod/pod-template-hash": "888f76864",
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq"
},
"logName": "projects/hark-tech/logs/stdout",
"receiveTimestamp": "2024-05-02T14:00:06.722845798Z"
},
{
"textPayload": "PRODUCER[DEBUG] retry batches processed; wanted_metadata_update: false, triggering_metadata_update: false, should_backoff: false",
"insertId": "bu1lu5hghf2ja804",
"resource": {
"type": "k8s_container",
"labels": {
"cluster_name": "dev",
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"container_name": "lte-m-csv-parser",
"namespace_name": "redpanda",
"project_id": "hark-tech",
"location": "europe-west1-b"
}
},
"timestamp": "2024-05-02T14:00:03.658183716Z",
"severity": "INFO",
"labels": {
"k8s-pod/pod-template-hash": "888f76864",
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq",
"k8s-pod/app": "lte-m-csv-parser"
},
"logName": "projects/hark-tech/logs/stdout",
"receiveTimestamp": "2024-05-02T14:00:06.722845798Z"
},
{
"textPayload": "PRODUCER[INFO] metadata update triggered; why: opportunistic load during sink backoff",
"insertId": "zry3ah26tp6y2rol",
"resource": {
"type": "k8s_container",
"labels": {
"project_id": "hark-tech",
"namespace_name": "redpanda",
"container_name": "lte-m-csv-parser",
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"location": "europe-west1-b",
"cluster_name": "dev"
}
},
"timestamp": "2024-05-02T14:00:03.658352396Z",
"severity": "INFO",
"labels": {
"k8s-pod/app": "lte-m-csv-parser",
"k8s-pod/pod-template-hash": "888f76864",
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq"
},
"logName": "projects/hark-tech/logs/stdout",
"receiveTimestamp": "2024-05-02T14:00:06.722845798Z"
},
{
"textPayload": "PRODUCER[DEBUG] wrote Metadata v7; broker: 1, bytes_written: 34, write_wait: 23.527µs, time_to_write: 32.777µs, err: <nil>",
"insertId": "jbitke6sgu7h2wzf",
"resource": {
"type": "k8s_container",
"labels": {
"project_id": "hark-tech",
"container_name": "lte-m-csv-parser",
"namespace_name": "redpanda",
"location": "europe-west1-b",
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"cluster_name": "dev"
}
},
"timestamp": "2024-05-02T14:00:03.658737880Z",
"severity": "INFO",
"labels": {
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq",
"k8s-pod/app": "lte-m-csv-parser",
"k8s-pod/pod-template-hash": "888f76864"
},
"logName": "projects/hark-tech/logs/stdout",
"receiveTimestamp": "2024-05-02T14:00:06.722845798Z"
},
{
"textPayload": "PRODUCER[DEBUG] read Metadata v7; broker: 1, bytes_read: 301, read_wait: 145.989µs, time_to_read: 1.381232ms, err: <nil>",
"insertId": "r1qbzxp7f6g9s2hm",
"resource": {
"type": "k8s_container",
"labels": {
"project_id": "hark-tech",
"cluster_name": "dev",
"namespace_name": "redpanda",
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"location": "europe-west1-b",
"container_name": "lte-m-csv-parser"
}
},
"timestamp": "2024-05-02T14:00:03.660287974Z",
"severity": "INFO",
"labels": {
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq",
"k8s-pod/pod-template-hash": "888f76864",
"k8s-pod/app": "lte-m-csv-parser"
},
"logName": "projects/hark-tech/logs/stdout",
"receiveTimestamp": "2024-05-02T14:00:06.722845798Z"
},
{
"textPayload": "PRODUCER[DEBUG] metadata refresh has identical topic partition data; topic: test_slett, partition: 0, leader: 2, leader_epoch: 1",
"insertId": "uvqaolcfk6dmomf9",
"resource": {
"type": "k8s_container",
"labels": {
"cluster_name": "dev",
"project_id": "hark-tech",
"container_name": "lte-m-csv-parser",
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"namespace_name": "redpanda",
"location": "europe-west1-b"
}
},
"timestamp": "2024-05-02T14:00:03.660983907Z",
"severity": "INFO",
"labels": {
"k8s-pod/pod-template-hash": "888f76864",
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq",
"k8s-pod/app": "lte-m-csv-parser"
},
"logName": "projects/hark-tech/logs/stdout",
"receiveTimestamp": "2024-05-02T14:00:06.722845798Z"
},
{
"textPayload": "PRODUCER[DEBUG] opening connection to broker; addr: redpanda-2.redpanda.redpanda.svc.cluster.local.:9093, broker: 2",
"insertId": "5omjbm1lyhlvfp5h",
"resource": {
"type": "k8s_container",
"labels": {
"cluster_name": "dev",
"project_id": "hark-tech",
"container_name": "lte-m-csv-parser",
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"namespace_name": "redpanda",
"location": "europe-west1-b"
}
},
"timestamp": "2024-05-02T14:00:03.898569218Z",
"severity": "INFO",
"labels": {
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq",
"k8s-pod/pod-template-hash": "888f76864",
"k8s-pod/app": "lte-m-csv-parser"
},
"logName": "projects/hark-tech/logs/stdout",
"receiveTimestamp": "2024-05-02T14:00:06.722845798Z"
},
{
"textPayload": "PRODUCER[DEBUG] connection opened to broker; addr: redpanda-2.redpanda.redpanda.svc.cluster.local.:9093, broker: 2",
"insertId": "wacyxcnr4nuj5wp7",
"resource": {
"type": "k8s_container",
"labels": {
"location": "europe-west1-b",
"cluster_name": "dev",
"container_name": "lte-m-csv-parser",
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"namespace_name": "redpanda",
"project_id": "hark-tech"
}
},
"timestamp": "2024-05-02T14:00:03.898596873Z",
"severity": "INFO",
"labels": {
"k8s-pod/app": "lte-m-csv-parser",
"k8s-pod/pod-template-hash": "888f76864",
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq"
},
"logName": "projects/hark-tech/logs/stdout",
"receiveTimestamp": "2024-05-02T14:00:06.722845798Z"
},
{
"textPayload": "PRODUCER[DEBUG] connection initialized successfully; addr: redpanda-2.redpanda.redpanda.svc.cluster.local.:9093, broker: 2",
"insertId": "bdpouonfil728wkt",
"resource": {
"type": "k8s_container",
"labels": {
"location": "europe-west1-b",
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"project_id": "hark-tech",
"cluster_name": "dev",
"namespace_name": "redpanda",
"container_name": "lte-m-csv-parser"
}
},
"timestamp": "2024-05-02T14:00:03.898603221Z",
"severity": "INFO",
"labels": {
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq",
"k8s-pod/app": "lte-m-csv-parser",
"k8s-pod/pod-template-hash": "888f76864"
},
"logName": "projects/hark-tech/logs/stdout",
"receiveTimestamp": "2024-05-02T14:00:06.722845798Z"
},
{
"textPayload": "PRODUCER[DEBUG] wrote Produce v7; broker: 2, bytes_written: 1039, write_wait: 4.454894ms, time_to_write: 52.311µs, err: <nil>",
"insertId": "wn1w1kjirev5f7pp",
"resource": {
"type": "k8s_container",
"labels": {
"cluster_name": "dev",
"project_id": "hark-tech",
"container_name": "lte-m-csv-parser",
"location": "europe-west1-b",
"namespace_name": "redpanda",
"pod_name": "lte-m-csv-parser-888f76864-p89t5"
}
},
"timestamp": "2024-05-02T14:00:03.898608048Z",
"severity": "INFO",
"labels": {
"k8s-pod/pod-template-hash": "888f76864",
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq",
"k8s-pod/app": "lte-m-csv-parser"
},
"logName": "projects/hark-tech/logs/stdout",
"receiveTimestamp": "2024-05-02T14:00:06.722845798Z"
},
{
"textPayload": "PRODUCER[DEBUG] read Produce v7; broker: 2, bytes_read: 0, read_wait: 44.52µs, time_to_read: 3.217444ms, err: EOF",
"insertId": "q6f5raatiouubo8o",
"resource": {
"type": "k8s_container",
"labels": {
"cluster_name": "dev",
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"namespace_name": "redpanda",
"container_name": "lte-m-csv-parser",
"project_id": "hark-tech",
"location": "europe-west1-b"
}
},
"timestamp": "2024-05-02T14:00:03.902471578Z",
"severity": "INFO",
"labels": {
"k8s-pod/app": "lte-m-csv-parser",
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq",
"k8s-pod/pod-template-hash": "888f76864"
},
"logName": "projects/hark-tech/logs/stdout",
"receiveTimestamp": "2024-05-02T14:00:06.722845798Z"
},
{
"textPayload": "PRODUCER[WARN] read from broker errored, killing connection after 0 successful responses (is SASL missing?); addr: redpanda-2.redpanda.redpanda.svc.cluster.local.:9093, broker: 2, err: EOF",
"insertId": "0ri9fgwlkaxex3vt",
"resource": {
"type": "k8s_container",
"labels": {
"namespace_name": "redpanda",
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"cluster_name": "dev",
"location": "europe-west1-b",
"project_id": "hark-tech",
"container_name": "lte-m-csv-parser"
}
},
"timestamp": "2024-05-02T14:00:03.902493308Z",
"severity": "INFO",
"labels": {
"k8s-pod/pod-template-hash": "888f76864",
"k8s-pod/app": "lte-m-csv-parser",
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq"
},
"logName": "projects/hark-tech/logs/stdout",
"receiveTimestamp": "2024-05-02T14:00:06.722845798Z"
},
{
"textPayload": "PRODUCER[DEBUG] retry batches processed; wanted_metadata_update: false, triggering_metadata_update: false, should_backoff: false",
"insertId": "n27muf8yo8hrzao9",
"resource": {
"type": "k8s_container",
"labels": {
"container_name": "lte-m-csv-parser",
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"namespace_name": "redpanda",
"cluster_name": "dev",
"project_id": "hark-tech",
"location": "europe-west1-b"
}
},
"timestamp": "2024-05-02T14:00:03.902503542Z",
"severity": "INFO",
"labels": {
"k8s-pod/pod-template-hash": "888f76864",
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq",
"k8s-pod/app": "lte-m-csv-parser"
},
"logName": "projects/hark-tech/logs/stdout",
"receiveTimestamp": "2024-05-02T14:00:06.722845798Z"
},
{
"textPayload": "PRODUCER[DEBUG] opening connection to broker; addr: redpanda-2.redpanda.redpanda.svc.cluster.local.:9093, broker: 2",
"insertId": "jyfprf83r8sefnkj",
"resource": {
"type": "k8s_container",
"labels": {
"project_id": "hark-tech",
"namespace_name": "redpanda",
"container_name": "lte-m-csv-parser",
"cluster_name": "dev",
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"location": "europe-west1-b"
}
},
"timestamp": "2024-05-02T14:00:03.902518785Z",
"severity": "INFO",
"labels": {
"k8s-pod/pod-template-hash": "888f76864",
"k8s-pod/app": "lte-m-csv-parser",
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq"
},
"logName": "projects/hark-tech/logs/stdout",
"receiveTimestamp": "2024-05-02T14:00:06.722845798Z"
},
{
"textPayload": "PRODUCER[DEBUG] connection opened to broker; addr: redpanda-2.redpanda.redpanda.svc.cluster.local.:9093, broker: 2",
"insertId": "tj3d69hah8d4u89u",
"resource": {
"type": "k8s_container",
"labels": {
"container_name": "lte-m-csv-parser",
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"project_id": "hark-tech",
"cluster_name": "dev",
"location": "europe-west1-b",
"namespace_name": "redpanda"
}
},
"timestamp": "2024-05-02T14:00:03.905464396Z",
"severity": "INFO",
"labels": {
"k8s-pod/app": "lte-m-csv-parser",
"k8s-pod/pod-template-hash": "888f76864",
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq"
},
"logName": "projects/hark-tech/logs/stdout",
"receiveTimestamp": "2024-05-02T14:00:06.722845798Z"
},
{
"textPayload": "PRODUCER[DEBUG] connection initialized successfully; addr: redpanda-2.redpanda.redpanda.svc.cluster.local.:9093, broker: 2",
"insertId": "jfvz9qq1us28h234",
"resource": {
"type": "k8s_container",
"labels": {
"location": "europe-west1-b",
"project_id": "hark-tech",
"container_name": "lte-m-csv-parser",
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"cluster_name": "dev",
"namespace_name": "redpanda"
}
},
"timestamp": "2024-05-02T14:00:03.905483758Z",
"severity": "INFO",
"labels": {
"k8s-pod/pod-template-hash": "888f76864",
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq",
"k8s-pod/app": "lte-m-csv-parser"
},
"logName": "projects/hark-tech/logs/stdout",
"receiveTimestamp": "2024-05-02T14:00:06.722845798Z"
},
{
"textPayload": "PRODUCER[DEBUG] wrote Produce v7; broker: 2, bytes_written: 1039, write_wait: 4.6544ms, time_to_write: 28.472µs, err: <nil>",
"insertId": "idiclql1hidx0kkd",
"resource": {
"type": "k8s_container",
"labels": {
"cluster_name": "dev",
"location": "europe-west1-b",
"container_name": "lte-m-csv-parser",
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"namespace_name": "redpanda",
"project_id": "hark-tech"
}
},
"timestamp": "2024-05-02T14:00:03.905543058Z",
"severity": "INFO",
"labels": {
"k8s-pod/pod-template-hash": "888f76864",
"k8s-pod/app": "lte-m-csv-parser",
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq"
},
"logName": "projects/hark-tech/logs/stdout",
"receiveTimestamp": "2024-05-02T14:00:06.722845798Z"
},
{
"textPayload": "PRODUCER[DEBUG] read Produce v7; broker: 2, bytes_read: 0, read_wait: 47.439µs, time_to_read: 407.667µs, err: EOF",
"insertId": "4b3sbh4aoztql5bx",
"resource": {
"type": "k8s_container",
"labels": {
"cluster_name": "dev",
"namespace_name": "redpanda",
"project_id": "hark-tech",
"location": "europe-west1-b",
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"container_name": "lte-m-csv-parser"
}
},
"timestamp": "2024-05-02T14:00:03.906056679Z",
"severity": "INFO",
"labels": {
"k8s-pod/app": "lte-m-csv-parser",
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq",
"k8s-pod/pod-template-hash": "888f76864"
},
"logName": "projects/hark-tech/logs/stdout",
"receiveTimestamp": "2024-05-02T14:00:06.722845798Z"
},
{
"textPayload": "PRODUCER[WARN] read from broker errored, killing connection after 0 successful responses (is SASL missing?); addr: redpanda-2.redpanda.redpanda.svc.cluster.local.:9093, broker: 2, err: EOF",
"insertId": "728et1tbv3s7hcxh",
"resource": {
"type": "k8s_container",
"labels": {
"project_id": "hark-tech",
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"cluster_name": "dev",
"container_name": "lte-m-csv-parser",
"namespace_name": "redpanda",
"location": "europe-west1-b"
}
},
"timestamp": "2024-05-02T14:00:03.906224664Z",
"severity": "INFO",
"labels": {
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq",
"k8s-pod/app": "lte-m-csv-parser",
"k8s-pod/pod-template-hash": "888f76864"
},
"logName": "projects/hark-tech/logs/stdout",
"receiveTimestamp": "2024-05-02T14:00:06.722845798Z"
},
{
"textPayload": "PRODUCER[DEBUG] retry batches processed; wanted_metadata_update: false, triggering_metadata_update: false, should_backoff: false",
"insertId": "1j1wvxbduzkztg1r",
"resource": {
"type": "k8s_container",
"labels": {
"namespace_name": "redpanda",
"cluster_name": "dev",
"container_name": "lte-m-csv-parser",
"location": "europe-west1-b",
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"project_id": "hark-tech"
}
},
"timestamp": "2024-05-02T14:00:03.906374457Z",
"severity": "INFO",
"labels": {
"k8s-pod/app": "lte-m-csv-parser",
"k8s-pod/pod-template-hash": "888f76864",
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq"
},
"logName": "projects/hark-tech/logs/stdout",
"receiveTimestamp": "2024-05-02T14:00:06.722845798Z"
},
{
"textPayload": "PRODUCER[DEBUG] opening connection to broker; addr: redpanda-2.redpanda.redpanda.svc.cluster.local.:9093, broker: 2",
"insertId": "0r89mtk3rcquiszo",
"resource": {
"type": "k8s_container",
"labels": {
"project_id": "hark-tech",
"namespace_name": "redpanda",
"container_name": "lte-m-csv-parser",
"cluster_name": "dev",
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"location": "europe-west1-b"
}
},
"timestamp": "2024-05-02T14:00:04.412972732Z",
"severity": "INFO",
"labels": {
"k8s-pod/pod-template-hash": "888f76864",
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq",
"k8s-pod/app": "lte-m-csv-parser"
},
"logName": "projects/hark-tech/logs/stdout",
"receiveTimestamp": "2024-05-02T14:00:06.722845798Z"
},
{
"textPayload": "PRODUCER[DEBUG] connection opened to broker; addr: redpanda-2.redpanda.redpanda.svc.cluster.local.:9093, broker: 2",
"insertId": "w532191gzlgmgufw",
"resource": {
"type": "k8s_container",
"labels": {
"container_name": "lte-m-csv-parser",
"project_id": "hark-tech",
"location": "europe-west1-b",
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"namespace_name": "redpanda",
"cluster_name": "dev"
}
},
"timestamp": "2024-05-02T14:00:04.415693843Z",
"severity": "INFO",
"labels": {
"k8s-pod/pod-template-hash": "888f76864",
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq",
"k8s-pod/app": "lte-m-csv-parser"
},
"logName": "projects/hark-tech/logs/stdout",
"receiveTimestamp": "2024-05-02T14:00:06.722845798Z"
},
{
"textPayload": "PRODUCER[DEBUG] connection initialized successfully; addr: redpanda-2.redpanda.redpanda.svc.cluster.local.:9093, broker: 2",
"insertId": "f3h9twohb4ktgtzz",
"resource": {
"type": "k8s_container",
"labels": {
"namespace_name": "redpanda",
"cluster_name": "dev",
"project_id": "hark-tech",
"location": "europe-west1-b",
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"container_name": "lte-m-csv-parser"
}
},
"timestamp": "2024-05-02T14:00:04.415824803Z",
"severity": "INFO",
"labels": {
"k8s-pod/app": "lte-m-csv-parser",
"k8s-pod/pod-template-hash": "888f76864",
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq"
},
"logName": "projects/hark-tech/logs/stdout",
"receiveTimestamp": "2024-05-02T14:00:06.722845798Z"
},
{
"textPayload": "PRODUCER[DEBUG] wrote Produce v7; broker: 2, bytes_written: 1044, write_wait: 3.069908ms, time_to_write: 55.227µs, err: <nil>",
"insertId": "19r9qivio4g4upmt",
"resource": {
"type": "k8s_container",
"labels": {
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"container_name": "lte-m-csv-parser",
"namespace_name": "redpanda",
"location": "europe-west1-b",
"project_id": "hark-tech",
"cluster_name": "dev"
}
},
"timestamp": "2024-05-02T14:00:04.416061082Z",
"severity": "INFO",
"labels": {
"k8s-pod/pod-template-hash": "888f76864",
"k8s-pod/app": "lte-m-csv-parser",
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq"
},
"logName": "projects/hark-tech/logs/stdout",
"receiveTimestamp": "2024-05-02T14:00:06.722845798Z"
},
{
"textPayload": "PRODUCER[DEBUG] read Produce v7; broker: 2, bytes_read: 0, read_wait: 272.671µs, time_to_read: 573.925µs, err: EOF",
"insertId": "qsh424mi3o3yj70d",
"resource": {
"type": "k8s_container",
"labels": {
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"container_name": "lte-m-csv-parser",
"namespace_name": "redpanda",
"cluster_name": "dev",
"project_id": "hark-tech",
"location": "europe-west1-b"
}
},
"timestamp": "2024-05-02T14:00:04.417064075Z",
"severity": "INFO",
"labels": {
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq",
"k8s-pod/app": "lte-m-csv-parser",
"k8s-pod/pod-template-hash": "888f76864"
},
"logName": "projects/hark-tech/logs/stdout",
"receiveTimestamp": "2024-05-02T14:00:06.722845798Z"
},
{
"textPayload": "PRODUCER[WARN] read from broker errored, killing connection after 0 successful responses (is SASL missing?); addr: redpanda-2.redpanda.redpanda.svc.cluster.local.:9093, broker: 2, err: EOF",
"insertId": "wykgqw0kf96nceyp",
"resource": {
"type": "k8s_container",
"labels": {
"namespace_name": "redpanda",
"cluster_name": "dev",
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"location": "europe-west1-b",
"project_id": "hark-tech",
"container_name": "lte-m-csv-parser"
}
},
"timestamp": "2024-05-02T14:00:04.417083204Z",
"severity": "INFO",
"labels": {
"k8s-pod/pod-template-hash": "888f76864",
"k8s-pod/app": "lte-m-csv-parser",
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq"
},
"logName": "projects/hark-tech/logs/stdout",
"receiveTimestamp": "2024-05-02T14:00:06.722845798Z"
},
{
"textPayload": "PRODUCER[DEBUG] retry batches processed; wanted_metadata_update: false, triggering_metadata_update: false, should_backoff: false",
"insertId": "i9ulsu7vnrhlte8h",
"resource": {
"type": "k8s_container",
"labels": {
"location": "europe-west1-b",
"container_name": "lte-m-csv-parser",
"namespace_name": "redpanda",
"cluster_name": "dev",
"project_id": "hark-tech",
"pod_name": "lte-m-csv-parser-888f76864-p89t5"
}
},
"timestamp": "2024-05-02T14:00:04.417088554Z",
"severity": "INFO",
"labels": {
"k8s-pod/pod-template-hash": "888f76864",
"k8s-pod/app": "lte-m-csv-parser",
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq"
},
"logName": "projects/hark-tech/logs/stdout",
"receiveTimestamp": "2024-05-02T14:00:06.722845798Z"
},
{
"textPayload": "PRODUCER[DEBUG] opening connection to broker; addr: redpanda-2.redpanda.redpanda.svc.cluster.local.:9093, broker: 2",
"insertId": "tps7rsrxjmvh5fbc",
"resource": {
"type": "k8s_container",
"labels": {
"cluster_name": "dev",
"container_name": "lte-m-csv-parser",
"project_id": "hark-tech",
"location": "europe-west1-b",
"namespace_name": "redpanda",
"pod_name": "lte-m-csv-parser-888f76864-p89t5"
}
},
"timestamp": "2024-05-02T14:00:04.417093690Z",
"severity": "INFO",
"labels": {
"k8s-pod/pod-template-hash": "888f76864",
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq",
"k8s-pod/app": "lte-m-csv-parser"
},
"logName": "projects/hark-tech/logs/stdout",
"receiveTimestamp": "2024-05-02T14:00:06.722845798Z"
},
{
"textPayload": "PRODUCER[DEBUG] connection opened to broker; addr: redpanda-2.redpanda.redpanda.svc.cluster.local.:9093, broker: 2",
"insertId": "74hch95li6k1a3l1",
"resource": {
"type": "k8s_container",
"labels": {
"container_name": "lte-m-csv-parser",
"location": "europe-west1-b",
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"cluster_name": "dev",
"project_id": "hark-tech",
"namespace_name": "redpanda"
}
},
"timestamp": "2024-05-02T14:00:04.420880757Z",
"severity": "INFO",
"labels": {
"k8s-pod/app": "lte-m-csv-parser",
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq",
"k8s-pod/pod-template-hash": "888f76864"
},
"logName": "projects/hark-tech/logs/stdout",
"receiveTimestamp": "2024-05-02T14:00:06.722845798Z"
},
{
"textPayload": "PRODUCER[DEBUG] connection initialized successfully; addr: redpanda-2.redpanda.redpanda.svc.cluster.local.:9093, broker: 2",
"insertId": "jbnqjgc4gjbgzvga",
"resource": {
"type": "k8s_container",
"labels": {
"cluster_name": "dev",
"container_name": "lte-m-csv-parser",
"project_id": "hark-tech",
"location": "europe-west1-b",
"namespace_name": "redpanda",
"pod_name": "lte-m-csv-parser-888f76864-p89t5"
}
},
"timestamp": "2024-05-02T14:00:04.420894344Z",
"severity": "INFO",
"labels": {
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq",
"k8s-pod/app": "lte-m-csv-parser",
"k8s-pod/pod-template-hash": "888f76864"
},
"logName": "projects/hark-tech/logs/stdout",
"receiveTimestamp": "2024-05-02T14:00:06.722845798Z"
},
{
"textPayload": "PRODUCER[DEBUG] wrote Produce v7; broker: 2, bytes_written: 1044, write_wait: 3.822379ms, time_to_write: 26.708µs, err: <nil>",
"insertId": "cz38p6n5tzsvrz0z",
"resource": {
"type": "k8s_container",
"labels": {
"container_name": "lte-m-csv-parser",
"location": "europe-west1-b",
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"project_id": "hark-tech",
"namespace_name": "redpanda",
"cluster_name": "dev"
}
},
"timestamp": "2024-05-02T14:00:04.421017736Z",
"severity": "INFO",
"labels": {
"k8s-pod/app": "lte-m-csv-parser",
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq",
"k8s-pod/pod-template-hash": "888f76864"
},
"logName": "projects/hark-tech/logs/stdout",
"receiveTimestamp": "2024-05-02T14:00:06.722845798Z"
},
{
"textPayload": "PRODUCER[DEBUG] read Produce v7; broker: 2, bytes_read: 0, read_wait: 278.429µs, time_to_read: 614.962µs, err: EOF",
"insertId": "9u9lo983lxeukz2v",
"resource": {
"type": "k8s_container",
"labels": {
"cluster_name": "dev",
"project_id": "hark-tech",
"namespace_name": "redpanda",
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"location": "europe-west1-b",
"container_name": "lte-m-csv-parser"
}
},
"timestamp": "2024-05-02T14:00:04.421792873Z",
"severity": "INFO",
"labels": {
"k8s-pod/app": "lte-m-csv-parser",
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq",
"k8s-pod/pod-template-hash": "888f76864"
},
"logName": "projects/hark-tech/logs/stdout",
"receiveTimestamp": "2024-05-02T14:00:06.722845798Z"
},
{
"textPayload": "PRODUCER[WARN] read from broker errored, killing connection after 0 successful responses (is SASL missing?); addr: redpanda-2.redpanda.redpanda.svc.cluster.local.:9093, broker: 2, err: EOF",
"insertId": "s2i0oglmn8x4h1u1",
"resource": {
"type": "k8s_container",
"labels": {
"project_id": "hark-tech",
"location": "europe-west1-b",
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"cluster_name": "dev",
"namespace_name": "redpanda",
"container_name": "lte-m-csv-parser"
}
},
"timestamp": "2024-05-02T14:00:04.421800081Z",
"severity": "INFO",
"labels": {
"k8s-pod/pod-template-hash": "888f76864",
"k8s-pod/app": "lte-m-csv-parser",
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq"
},
"logName": "projects/hark-tech/logs/stdout",
"receiveTimestamp": "2024-05-02T14:00:06.722845798Z"
},
{
"textPayload": "PRODUCER[DEBUG] retry batches processed; wanted_metadata_update: false, triggering_metadata_update: false, should_backoff: false",
"insertId": "x3bwxmnn7r0h50df",
"resource": {
"type": "k8s_container",
"labels": {
"project_id": "hark-tech",
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"container_name": "lte-m-csv-parser",
"location": "europe-west1-b",
"namespace_name": "redpanda",
"cluster_name": "dev"
}
},
"timestamp": "2024-05-02T14:00:04.421996689Z",
"severity": "INFO",
"labels": {
"k8s-pod/pod-template-hash": "888f76864",
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq",
"k8s-pod/app": "lte-m-csv-parser"
},
"logName": "projects/hark-tech/logs/stdout",
"receiveTimestamp": "2024-05-02T14:00:06.722845798Z"
},
{
"textPayload": "2024/05/02 14:00:04 strconv.Atoi: parsing \"00\\xdb\\r\\x00\\x18lte/csv/7359992935166918[[0\": invalid syntax",
"insertId": "vxb0fn5xidgtyziz",
"resource": {
"type": "k8s_container",
"labels": {
"container_name": "lte-m-csv-parser",
"pod_name": "lte-m-csv-parser-888f76864-p89t5",
"project_id": "hark-tech",
"namespace_name": "redpanda",
"location": "europe-west1-b",
"cluster_name": "dev"
}
},
"timestamp": "2024-05-02T14:00:04.808334481Z",
"severity": "ERROR",
"labels": {
"k8s-pod/app": "lte-m-csv-parser",
"k8s-pod/pod-template-hash": "888f76864",
"compute.googleapis.com/resource_name": "gke-dev-dev-e2-4-1361cce2-zlcq"
},
"logName": "projects/hark-tech/logs/stderr",
"receiveTimestamp": "2024-05-02T14:00:07.234686375Z"
}
] |
Are you able to reliably recreate the batch that triggers this error? I'd like to repro this on my side, if possible. A CRC error is pretty fundamental so I'd have expected this to be raised earlier. |
Not easily. Suggestions on how I can get this batch? Log it this error hits? Is there a callback func or something that can handle this and log? |
If you're able to get some set of records to reproduce this even infrequently, I can go on that. There's no way to know what exactly was in one batch or the next, but if you see this error maybe 1/100 times on some given set of input, then I can likely go from there. |
Thank you for your help on this issue. So I used the callback func on the producer to print the message sent if an error occurred. Tried parsing it but didn't really see anything odd. Curious if anyone else does, this is the first of in total 130 similar log entries:
I thought it would write several messages in one batch ... I would guess it does under the hood, but still confusing that this returns like this - one single message. More logs (not all, too big)
|
I just tried writing that exact message to a local test-slett topic on Redpanda with the same producer settings, but I'm not getting an error. Are you able to reliably trigger the error with that input, or is there more to it (and maybe that's just one message failing in the middle)? |
Please let me know if you have some program that I can run to reproduce this; I'll close this issue for now otherwise. The only other issue that has a CORRUPT_MESSAGE error in it is #459, and the problem there was the user was mutating the record while it was being produced. |
We are running redpanda self-hosted with three brokers.
Our app consume from 1 topic, process messages, and produce to 3 topics. Consuming and processing takes no times, but producing back to topics works OK for a few messages, but then fails. It's possible I've gotten a bit confused here, but to me it looks like this specifically happens when writing to broker nr. 2.
We have a few other apps connected to the cluster, they all run fine. Some of them in go.
I am not sure what happens here, just reaching out to see if anyone got suggestions.
I tried to fiddle around with produce config, buffer sizes, etc. but no luck. Is my config wrong? Any ideas?
Snippets
Logs
The text was updated successfully, but these errors were encountered: