How can I stream JSON and not have elements truncated?

[dandv]

I'm working on an NLP application. I have a vector with embeddings, like this:

[
    {
        "text": "...",
        "values": [
            0,
            1,
            ...
            2047
        ]
    },
    {
        ...
    },
    ...
]

The problem is that the values array is most of the time returned incompletely, e.g. with only 1488 elements, even though batch.batchType was data. I want each root JSON array element to be left intact, i.e. the values array should always contain all 2048 values from the file.

The code I'm using is that from the JSON docs:

const batches = await loadInBatches(vectorWithEmbeddings, JSONLoader);
for await (const batch of batches) {
  // batch.data will contain a number of rows
  for (const arrayElement of batch.data) {
    // I need `arrayElement.values` to be intact here
  }

The size of each JSON array element is quite manageable: 2048 floats, plus some text of at most 500 characters.

What am I doing wrong?