Problems with data visualization / string conversion

[heinehenning]

Hi there,

I am trying to setup some connections with simple data visualization, but I am running into problems, when it comes to the visualization part.

I am using StreamPipes 0.91.0, started with docker-compose from installer/compose. The system is running inside WSL2 on my Windows 10 Notebook.

I created a MQTT connector and selected the option "Persist events" before starting the adapter. Messages are arriving, as can be seen in the details view on the specific adapter.

This is our original payload:

And this is the result after selecting measurements and timestamp:

When I try to build a visualization with the data explorer, the widget is not showing any data just the message "Found no data in the selected time range"

It would be great to get some hints where to start with the trouble shooting.
One thing I noticed is, when checking the help on the DataSource, all fields are marked as "Text"-Fields.

Could that be part of the problem?

If found a "Field Converter" for string conversion in the StreamPipes docs but this pipeline element is not available under my pipeline elements.

Thanks in advance for your help!

[heinehenning]

I still struggle to make this ↑ work.
My assumption is, that the pipeline can not really access the JSON object that is coming from the connector.

When I try to access the connector output with a JS-Eval-Processor, I can not manage to drill down to the actual value:

Data coming from the connector:

Configuration of JS-Eval-Processor:

Preview of Pipeliine:

Any Ideas how to access the actual values?

[tenthe]

Hello @heinehenning,
thank you very much for reporting this behavior. I will look into it and get back to you.

Cheers,
Philipp

[heinehenning]

Hi @tenthe,

thanks for checking in!

One more thing, that I have noticed:

I tried to rule out the issues with our data format and tried to pipe some random values from the JS-Eval-Processor to the data lake:

I am getting the followint error on the data lake. This error occured already with my previous tests.

[tenthe]

Hi @heinehenning,
I have tried to reproduce your problems.
I also had several problems with the nested json structure. @dominikriemer is currently working on it.
Once the changes are complete, I will try it again.

About your JavaScript function. I suspect the problem is with the data source.
I tried the same example with a different adapter and it worked in my instance. (I used the latest release 0.91.0 for the tests)
My guess is that the adapter's event schema is broken because of the nested structure issues.
Right now you can flatten the events in the schema editor by dragging the value property to the top level.

Cheers,
Philipp