Skip to content

Latest commit

 

History

History
37 lines (24 loc) · 1.34 KB

Hbase.md

File metadata and controls

37 lines (24 loc) · 1.34 KB
Raw

HBase

Source plugin : HBase [Spark]

Description

Get data from HBase

Options

name type required default value
hbase.zookeeper.quorum string yes
catalog string yes
common-options string yes -

hbase.zookeeper.quorum [string]

The address of the zookeeper cluster, the format is: host01:2181,host02:2181,host03:2181

catalog [string]

The structure of the hbase table is defined by catalog , the name of the hbase table and its namespace , which columns are used as rowkey, and the correspondence between column family and columns can be defined by catalog hbase table catalog

common options [string]

Source plugin common parameters, please refer to Source Plugin for details

Example

  Hbase {
    hbase.zookeeper.quorum = "localhost:2181"
    catalog = "{\"table\":{\"namespace\":\"default\", \"name\":\"test\"},\"rowkey\":\"id\",\"columns\":{\"id\":{\"cf\":\"rowkey\", \"col\":\"id\", \"type\":\"string\"},\"a\":{\"cf\":\"f1\", \"col\":\"a\", \"type\":\"string\"},\"b\":{\"cf\":\"f1\", \"col\":\"b\", \"type\":\"string\"},\"c\":{\"cf\":\"f1\", \"col\":\"c\", \"type\":\"string\"}}}"
    result_table_name = "my_dataset"
  }