Use Autoingestion.class instead of screen scraping.

[danieldickison]

The new Autoingestion Java program from Apple obviates the need to do scraping. appdailysales.py is still useful because it automates fetching multiple dates and unzipping with a nice interface for naming the output files etc.

This patch updates the script to use the Autoingestion program instead of screen scraping. Not sure if you would want to incorporate to master, but I think this is the way to go for the future.

[kirbyt]

Nice! It didn't occur to me to replace the screen scraping with the new Autoingestion. I'll take a look at your patch (may take me a few days to get to it) and pull it in if it doesn't break anything. I would love to get away from the while screen scraping mess!

Thanks,
-KIRBY

[philippb]

Nice take on apples autoingestion feature.
I'd be really interested to keep the screen scraping as the autoingestion is limited on the number of requests/time that you can do.
I use to download reports for multiple apps, as I understand this can make problems.

[resonant16]

All-in-all, Apple's autoingest is fairly worthless. I guess it's better than the aforementioned screen scraping, but common, the biggest company in the world can't make some thing a hair more sophisticated than a sleazy command line that get's you a text file of all things? Worthless! It's a sleazy solution to something that's not very good to begin with. At the very least they could have thrown us a CSV file or something we could compile some statistics from.

[danieldickison]

@resonant16, I'm not sure what you mean. Downloading CSV files is exactly what Autoingest does and, wrapped in a script like appdailysales, it's quite handy. Definitely beats screen scraping (though I wasn't aware of rate limiting issues that philippb mentioned).

[danzel]

Thanks for this, nice to have my appsales going again :)

subprocess.check_output was added in python v2.7. (pazz/alot#16)
The current ubuntu LTS (lucid) ships with python 2.6. Could this be updated to use something that is available in that old version?

I've installed python2.7 from https://launchpad.net/~fkrull/+archive/deadsnakes to get it going for now.