Replies: 2 comments 8 replies
-
|
Question, is it logging different date/time formats in the same log? e.g., |
Beta Was this translation helpful? Give feedback.
-
|
Thank you so much, that worked on this format I was wondering also if it is possible to generate the html report, I tried the Also if it is possible to ignore the messages at the beginning of the log like these (If not that's fine, we'll just clean the file before parsing it with GoAccess) The last question is if it is possible to have another format to work with I can provide more log samples if needed. Thanks again for your help! |
Beta Was this translation helpful? Give feedback.
-
|
Just to update you, I was able to generate the HTML dashboard by cleaning up the data. The other challenge that I see in some of the logs is when the log format pattern breaks in the middle, which I don't know if how it can be presented , if applicable. Appreciate any feedback on that. |
Beta Was this translation helpful? Give feedback.
-
|
Here is another example of the non formatted log entries that makes it challenging to generate |
Beta Was this translation helpful? Give feedback.
-
|
I wonder if its possible to have a Something sort of like: BTW on a side note @zaid-hc how / why do you have this strange date? 😄 - maybe some log parser gone wrong? :-)
|
Beta Was this translation helpful? Give feedback.
-
Glad that helped :)
It should output an html report if it outputs on the terminal. Are you getting an error?
Currently it ignores empty lines
Sure, are you getting an error so far? This worked for me: Outputs:
That's certainly a challenge as there's no support for multi-line logs. We may need to think this through if we want to add support to it. So far, as far as I know, web logs are single-line. Though, there's always a chance that this could change. For now, cleaning them up before feeding them to goaccess may help. |
Beta Was this translation helpful? Give feedback.
-
|
@zaid-hc as Gerardo pointed out - you have those lines with the different date / format? - is that just bad sharing / copy paste? (Hopefully not Vault doing that) Hey maybe open a new discussion with a couple of complete examples of converged logs that include the JSON entries (don't forget to link / mention this too). I think that the converged logs that are mixed with JSON may not be possible to parse via a single file / config or run but I may be wrong. I think the only part remaining on this ask is how do exclude / ignore particular lines that are expected like the boot up block / info (happens on each restart) as well as pretty much any line that doesn't match expected CLF format? - and after this issue is resolved right @zaid-hc ? |
Beta Was this translation helpful? Give feedback.
-
|
@allinurl Thanks for the update. The new code worked with Here is another example: appreciate your thoughts on that. As for the HTML report, no there is no problems and working as expected. @aphorise The above example is an actual vault log. As for your second point, I will try to find some extreme examples and file it under different discussion as you suggested. Overall, this is very helpful and planning to use it on daily basis to review logs. |
Beta Was this translation helpful? Give feedback.
-
I was wondering if it is possible to use GoAccess with Vault Operational logs?
Here is an article explaining how they work: https://support.hashicorp.com/hc/en-us/articles/360002046068-Where-are-My-Vault-Logs-and-How-do-I-Share-Them-with-HashiCorp-Support-
As explained here, there are 5 levels of errors : trace, debug, info, warn, and err
Sample:
Another sample from an EC2 Vault instance
Thanks
Beta Was this translation helpful? Give feedback.
All reactions