v1.0.0-beta2

Merge branch 'main' of github.com:mosajjal/dnsmonster

v1.0.0-beta1

What's Changed

• Bump EndBug/add-and-commit from 5 to 9 by @dependabot in #49
• Bump github/codeql-action from 1 to 2 by @dependabot in #50
• Bump actions/upload-artifact from 2 to 3 by @dependabot in #51
• Bump actions/setup-go from 2 to 3 by @dependabot in #52
• Bump docker/metadata-action from 3.3.0 to 4.3.0 by @dependabot in #53
• Bump docker/build-push-action from 2 to 4 by @dependabot in #54
• Bump actions/checkout from 2 to 3 by @dependabot in #55
• Bump docker/login-action from 1.10.0 to 2.1.0 by @dependabot in #56
• Bump docker/setup-buildx-action from 1 to 2 by @dependabot in #57
• Bump docker/setup-qemu-action from 1 to 2 by @dependabot in #58
• Bump actions/setup-go from 3 to 4 by @dependabot in #60
• Add in sample docker-compose for clickhouse by @mzealey in #64
• Rework to modern Materialized Views by @mzealey in #62
• Bump docker/metadata-action from 4.3.0 to 4.4.0 by @dependabot in #65
• Bump docker/metadata-action from 4.4.0 to 4.5.0 by @dependabot in #67
• Bump docker/login-action from 2.1.0 to 2.2.0 by @dependabot in #68
• Bump docker/metadata-action from 4.5.0 to 4.6.0 by @dependabot in #69
• Bump actions/checkout from 3 to 4 by @dependabot in #73
• Bump docker/login-action from 2.2.0 to 3.0.0 by @dependabot in #78
• Bump docker/build-push-action from 4 to 5 by @dependabot in #77
• Bump docker/setup-qemu-action from 2 to 3 by @dependabot in #76
• Bump docker/metadata-action from 4.6.0 to 5.0.0 by @dependabot in #74
• Bump docker/setup-buildx-action from 2 to 3 by @dependabot in #75
• Bump golang.org/x/net from 0.11.0 to 0.17.0 by @dependabot in #81
• Parquet output by @mosajjal in #80
• Bump docker/metadata-action from 5.0.0 to 5.2.0 by @dependabot in #85
• Bump docker/metadata-action from 5.2.0 to 5.3.0 by @dependabot in #86
• Bump actions/setup-go from 4 to 5 by @dependabot in #87

• move from docker-compose to docker compose in autobuild
• added parquet output
• added zinc output
• added Kafka SASL authentication
• added license information

New Contributors

• @dependabot made their first contribution in #49
• @mzealey made their first contribution in #64

Full Changelog: v0.9.9...v1.0.0-beta1

v0.9.9

BREAKING Changes:

• project structure changes for builds. dnsmonster command script now sits inside the cmd/dnsmonster folder as per standard
• packet time has changed to 64 bit precision (addresses #45 and #31). Unfortunately tables need to be recreated since Clickhouse doesn't allow type conversion on PRIMARY KEYS.
• file output now takes a directory path and handles rotation and auto-creates files as per template. the old file output is deprecated. In order to output to a raw file, use stdoutoutputtype and redirect to the destination file

Other notable changes:

• Go 1.20 support
• pcapng file support
• GOB output format for Kafka
• goreleaser rollout (alpha)

Full Changelog: v0.9.7...v0.9.9

v0.9.8-2

BREAKING Changes:

• project structure changes for builds. dnsmonster command script now sits inside the cmd/dnsmonster folder as per standard
• packet time has changed to 64 bit precision (addresses #45 and #31). Unfortunately tables need to be recreated since Clickhouse doesn't allow type conversion on PRIMARY KEYS.
• file output now takes a directory path and handles rotation and auto-creates files as per template. the old file output is deprecated. In order to output to a raw file, use stdoutoutputtype and redirect to the destination file

Other notable changes:

• Go 1.20 support
• pcapng file support
• GOB output format for Kafka
• goreleaser rollout (alpha)

Full Changelog: v0.9.7...v0.9.8

v0.9.8-1

BREAKING Changes:

• project structure changes for builds. dnsmonster command script now sits inside the cmd/dnsmonster folder as per standard
• packet time has changed to 64 bit precision (addresses #45 and #31). Unfortunately tables need to be recreated since Clickhouse doesn't allow type conversion on PRIMARY KEYS.
• file output now takes a directory path and handles rotation and auto-creates files as per template. the old file output is deprecated. In order to output to a raw file, use stdoutoutputtype and redirect to the destination file

Other notable changes:

• Go 1.20 support
• pcapng file support
• GOB output format for Kafka
• goreleaser rollout (alpha)

Full Changelog: v0.9.7...v0.9.8

v0.9.8

BREAKING Changes:

• project structure changes for builds. dnsmonster command script now sits inside the cmd/dnsmonster folder as per standard
• packet time has changed to 64 bit precision (addresses #45 and #31). Unfortunately tables need to be recreated since Clickhouse doesn't allow type conversion on PRIMARY KEYS.
• file output now takes a directory path and handles rotation and auto-creates files as per template. the old file output is deprecated. In order to output to a raw file, use stdoutoutputtype and redirect to the destination file

Other notable changes:

• Go 1.20 support
• pcapng file support
• GOB output format for Kafka
• goreleaser rollout (alpha)

Full Changelog: v0.9.7...v0.9.8

v0.9.7

Bug fixes and performance enhancements

Full Changelog: v0.9.6...v0.9.7

v0.9.6

What's Changed

• Fix non-dnstap metrics by @pchaseh in #33
• Prevent packetsCaptured counter from being filled with misleading values by @pchaseh in #34
• cleaner exit and errgroups by @mosajjal in #35

Full Changelog: v0.9.5...v0.9.6

v0.9.5

With the changes in this version, dnsmonster is closer to reach 1.x. Please open issues and discussions if there's any issues.

BREAKING:

• command-line arguments are now case-insensitive
• ini config file has changed to all lowercase (old .ini needs to be updated)
• new --filter input syntax allows a gzip'd and base64'd filter to be passed on as a command-line argument. IMPORTANT NOTE: this feature means command line arguments being sent to dnsmonster can potentially execute ANY BPF program on your machine. be careful!

if you compile dnsmonster with no libpcap support (-tags nolibpcap), you'll see the following at start:

dnsmonster has been compiled without libpcap support. tcpdump-style BPF filters are not directly supported.
to generate a filter, use tcpdump and unix ulitities like so: 
tcpdump -ddd "port 53 and not vlan 1024" | gzip -9 | base64 -w0 
then provide the output base64 as a filter to dnsmonster 

in above example, you can run a libpcap-less dnsmonster this way:

dnsmonster --devname=lo --stdoutoutputype=1 \
--filter H4sIAAAAAAAAA3WO0Q0AIQhD/5nCEaRW9PZf7EDU3M9FE+HZFkBhLXEUAvV3lsaOLpwLowZGCNpShMZSqsPv8XeuX0bZLlxKhZuDpgseynkHtP8B85Pvi9hTLKg+KjpGrk0ZONUO8kmHnU2DWeYYlNxNlRfV0U3mAQEAAA==

Other changes:

• dnsmonster is now available for each release in many platforms and is completely non-dependent on libpcap
• Go 1.19 and various dependency version bumps

v0.9.4

• BREAKING

  • Slightly modified tables for clickHouse. improves performance and reduces storage cost
  • Grafana dashboard needs to be updated with the new version in order to correctly leverage new table design and fix previous IPv6 issues (#25)

• Notable Changes

  • Added systemd service template
  • Updated dependencies
  • Added fast JSON parsing for Windows
  • Multiple ClickHouse endpoint support
  • Major performance gains in ClickHouse batching
  • Fix TLS verification skip on Elastic/opensearch output
  • Experimental PostgreSQL support
  • Documentation and in-code comments improvements