Error after finished extracting chunks. How to merge multiple JSON files to single GeoJSON file?

[yusufalma]

Dear Mr. Tanner,

Your code is very good to download data from ArcGIS REST server, but I found error after finished extracting chunks, as you can see in picture below:

How would you fix this problem? If I should merge multiple JSON files in folder "partials" by myself, how will I do that?

Regards,
Yusuf Alma

[tannerjt]

@yusufalma , I pushed out some updates that should take care of this. The problem was that when merging all the partial files into one, it was storing everything in memory AND THEN piping into a single file. This was causing backflow pressure and taking up memory. It should work fine now. I would also recommend adding a throttle (in milliseconds) to your services.txt file:

ie

http://maps.lacity.org/lahub/rest/services/Recreation_and_Parks_Department/MapServer/4|parks|1000

This will introduce a 1 second delay between requests

[yusufalma]

Dear Mr. Tanner,

Thank you for quick response. The program can merge multiple JSON now. However, yesterday I found another error after merging finished below:



What was happened and can it be solved? Again, thank you for attention and cooperation.

Regards,
Yusuf Alma

[tannerjt]

Looks like you need to install gdal . See instruction on main readme.md file.

[yusufalma]

Dear Mr. Tanner,

I have followed the instruction. Here is my Python, GDAL and node.js status:

What have I missed?

Regards,
Yusuf Alma