aws-elb-logentries

Forwards AWS ELB logs from S3 to logentries via lambda

Result format:

2015-11-27T05:50:21.770857Z ip=1.2.123.456 t=0.018773 es=200 bs=200 ib=0 ob=245 m=GET /api/users/john_smith "node-superagent/0.18.2"

timestamp, ip, total time, ELB status, backend status, in bytes, out bytes, method, Path, User_Agent

Setup

1. Enable access log logging for your ELB in you AWS console.
2. Clone this repository 1.1 Edit the tokens.json config file. It is a map of filename prefixes and logentries target tokens. Therefore you can have all ELBs log into the same bucket but send each elb log with another token. The key is just the filename prefix.
3. (Optional) Edit the deploy.sh script and change the name of the lambda function.
4. Run bash deploy.sh create (Make sure you have aws-cli installed and your keys set up properly)
5. Go to the lambda console, edit the function configuration and connect the function to the "object created" event in your s3 bucket.

Update function

If you modified the tokens or the function code, run bash deploy.sh to update your function.

Testing

You can test the function on your local machine with python elb_to_logentries.py [-t logentries_token] mybucket path/to/access/log