[Bug]: Invalid JSON string in nested fields - MongoDB ➡️ BigQuery batch

[eliaaslindblad]

Related Template(s)

MongoDB to BigQuery Batch Job

What happened?

Steps to reproduce:

Create a job with userOption set to FLATTEN and the data should include a nested object or array.

Example:

{
  "someData": "something",
  "nestedField": [
    {
      "id": "x",
      "title": "y",
      "type": "z",
      "isGlobal": false,
      "embeddedUrl": ""
    }
  ]
}

Expected result:

The documentation states that the nested field should become a JSON string in BigQuery.

Actual result:

Instead of a JSON string the data is in the format below that I don't know how to parse in BigQuery.

[Document{{id=x, title=y, type=z, isGlobal=false, embeddedUrl=}}]

Beam Version

Newer than 2.46.0

Relevant log output

No response