Request: Essentials Eco Log to MySQL database

[TomLewis]

Hey guys, absolutely stellar work your doing for keeping essentials going! Ive used Essentials since day 1 of running a server many years ago, 1 of the biggest annoyances I have come across is the absence if MySQL support, Not for users data, For logging! Trying to diagnose and search through my 50MB trade log is absolutely painful, we have tried parsing the text file with PHP, but the files just too big and it grows and grows, its not searchable or anything.
Please give us the Option to save Essentials Eco trade logs to MySQL, I could crack out a Web UI in an hour to have a fully searchable web UI for all Essentials economy.

There must be a reusable MySQL class pre-made out there ready to put into your project, then where you write to the trade.log replace this with writing to the database instead.

[drtshock]

I've been wanting to do what I said in #28 where we just make a new log file on each restart. Would be so much easier. Though MySQL would be a pretty easy alternative.

[TomLewis]

Both! MySQL gives us many more options, having a web ui to view all economy
transactions would be a big improvement, I'll throw up whatever I make onto
github too. Would be good to figure out if there's an eco issue by flagging
large transactions on the web ui, you could build all sorts of stats with a
mysql log!

On Wed, 26 Aug 2015 21:22 Trent Hensler notifications@github.com wrote:

I've been wanting to do what I said in #28
#28 where we just make a
new log file on each restart. Would be so much easier. Though MySQL would
be a pretty easy alternative.

—
Reply to this email directly or view it on GitHub
#167 (comment)
.

[TomLewis]

Any update on this?

[KyrneDev]

Please make this happen

[TomLewis]

@drtshock Any chance this could still happen? Im looking at an economy update just because managing a trade.log that is now 250mb in size is impossible, A proper database is needed to log this information! There's a lot of tutorials on how to implement MySQL into plugins available if that is the issue? We have passed a year now since I posted this ticket!

[TomLewis]

Can I get this reopened please? This was requested in 2015, its now 2018. My trade log is now... 101mb, I want to keep the data as at some point I plan on making a web UI as soon as its possible to track all trade log data into mysql. Thank you.

[mdcfe]

This was never closed.

There's nothing stopping you from writing a web UI that parses the existing trade log file and converting it to a different format to be accessed by a HTTP request from a web page.

[TomLewis]

I already did that, parsing a 101mb CSV file isn't the best way to do this, let alone store the data, there are plenty of MySQL library's out there, all it would be is importing one, and the wherever it saves to the trade log file have it also insert a row into the database.

[mdcfe]

I don't see logging as a valid reason to maintain a connection to a MySQL server within EssentialsX, when there are already many, many ways to make use of the existing trade log. I also don't see that we're going to add another dependency just for this purpose.

You could also manually parse the existing log and insert the entries into a table, and you could monitor the file for new entries (tail -f for example) and add them to a table. That way, your whole trade log is then in a MySQL database.

[TomLewis]

That's a good idea! So import them all first, and then monitor for changes of the file and just add those so I'm not having to import the entire file each time, is that right? I haven't used tail -f before, but from a quick look it seems as if it keeps an open connection, so it would have to run in its own tmux to keep tracking? This may be a bit extreme just to get a log into MySQL.

[mdcfe]

You don't have to run it in tmux specifically, but it's one example of a shell command that you could use to monitor files. A simple shell script is probably the least extreme way to automatically copy the trade log to a database.