Kafka input: metadata field "kafka_timestamp_unix" only displays down to seconds

[Elfspool]

In Kafka input, there is a metadata field named kafka_timestamp_unix and you have a unix timestamp in it. My problem is that the precision of that value is only down to seconds, but i need it to down to milliseconds. Is it possible to get the unix timestamp in a message down to milliseconds?

[mihaitodor]

It will require an enhancement here and here, maybe adding another metadata field called kafka_timestamp_unix_ms computed via UnixMilli(). It will be a bit redundant, though... Alternatively, maybe adding an advanced bool config flag called kafka_timestamp_meta_ms that defaults to false would be a better idea.

[Elfspool]

A bool config flag that can alternate between seconds and milliseconds would be rally nice feature. My case is problematic because we get customer data that changes frequently and a customer could have two messages in the same second and therefore, we cannot see which message is the latest for a specific customer. Seconds is a eternity in computing ;)

Really fast answer, so thanks for that mihaitodor. This i one of the reasons we like benthos at Lindex. fast response in the community.

[mihaitodor]

PRs are welcome :)