Pinot

Pinot is a real-time distributed OLAP datastore, built to deliver scalable real-time analytics with low latency. It can ingest from batch data sources (such as Hadoop HDFS, Amazon S3, Azure ADLS, Google Cloud Storage) as well as stream data sources (such as Apache Kafka).

This repo publishes the docker image and helm chart for Apache Pinot.

Description

Hypertrace uses Pinot as underlying OLAP engine for realtime streaming ingestion of the traces, index them and serve the time-series and analytics queries from the hypertrace UI/dashboard.

Hypertrace Architecture

Building Locally

To build Pinot image locally, run:

./gradlew dockerBuildImages

Note:

• docker-compose uses pinot-servicemanager image so you have to build it from that folder in case you are working on that one.
• To read more about installing and configuring helm chart refer BUILD.md.

Testing

You can test the image you built after modification by running docker-compose or helm setup.

docker-compose

Change the tag for pinot-servicemanager from :main to :test in docker-compose file like this.

  pinot:
    image: hypertrace/pinot-servicemanager:test
    container_name: pinot
    ...

and then run docker-compose up to test the setup.

Helm setup

Add image repository and tag in values.yaml file here like below and then run ./hypertrace.sh install again and you can test your image!

pinot:
  image:
    repository: "hypertrace/pinot"
    tagOverride: "test"

Docker Image Source:

• DockerHub > Pinot
• DockerHub > Pinot-servicemanager