From eb0742cded9b25ce5ee63f6036d37c26bde1fe8f Mon Sep 17 00:00:00 2001 From: jiangmichaellll <40044148+jiangmichaellll@users.noreply.github.com> Date: Tue, 9 Feb 2021 14:00:47 -0500 Subject: [PATCH] docs: Include mexmessageperbatch in the readme (#63) * update * update --- .readme-partials.yaml | 13 +++++++------ 1 file changed, 7 insertions(+), 6 deletions(-) diff --git a/.readme-partials.yaml b/.readme-partials.yaml index 08283d6b..ca423de1 100644 --- a/.readme-partials.yaml +++ b/.readme-partials.yaml @@ -47,12 +47,13 @@ custom_content: | The connector supports a number of options to configure the read: - | Option | Type | Required | Meaning | - | ------ | ---- | -------- | ------- | - | pubsublite.subscription | String | Y | Full subscription path that the connector will read from. | - | pubsublite.flowcontrol.byteoutstandingperpartition | Long | N | Max number of bytes per partition that will be cached in workers before Spark processes the messages. Default to 50000000 bytes. | - | pubsublite.flowcontrol.messageoutstandingperpartition | Long | N | Max number of messages per partition that will be cached in workers before Spark processes the messages. Default to Long.MAX_VALUE. | - | gcp.credentials.key | String | N | Service account JSON in base64. Default to [Application Default Credentials](https://cloud.google.com/docs/authentication/production#automatically). | + | Option | Type | Required | Default Value | Meaning | + | ------ | ---- | -------- | ------------- | ------- | + | pubsublite.subscription | String | Y | | Full subscription path that the connector will read from. | + | pubsublite.flowcontrol.byteoutstandingperpartition | Long | N | 50_000_000 | Max number of bytes per partition that will be cached in workers before Spark processes the messages. | + | pubsublite.flowcontrol.messageoutstandingperpartition | Long | N | Long.MAX | Max number of messages per partition that will be cached in workers before Spark processes the messages. | + | pubsublite.flowcontrol.maxmessagesperbatch | Long | N | Long.MAX | Max number of messages in micro batch. | + | gcp.credentials.key | String | N | [Application Default Credentials](https://cloud.google.com/docs/authentication/production#automatically) | Service account JSON in base64. | ### Data Schema