Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

输出的json不合法 #124

Open
ox1234 opened this issue Oct 14, 2022 · 6 comments
Open

输出的json不合法 #124

ox1234 opened this issue Oct 14, 2022 · 6 comments
Labels
bug Something isn't working

Comments

@ox1234
Copy link

ox1234 commented Oct 14, 2022

命令：crawlergo -c chrome-mac/Chromium.app/Contents/MacOS/Chromium -t 10 --output-json result.json https://ucenter.huolala.cn/
输出的json使用jq处理，json不合法：
image
具体在这里：
image
感觉是个bug
@Qianlitp Qianlitp added the bug Something isn't working label Dec 6, 2022
@Qianlitp
Copy link
Owner

Qianlitp commented Dec 6, 2022

收到 看起来写入内容的时候有点问题

@komomon
Copy link

komomon commented Mar 8, 2023

我也遇到了同样的问题，使用版本0.4.4
会在req_list字段中某个url的数据中突然插入，all_domain_list和sub_domain_list的字段数据，导致json识别报错，希望能尽快修复

@komomon
Copy link

komomon commented Mar 8, 2023

好像太大的json就会出现这个问题，我用的是最新版的crawlergo

@komomon
Copy link

komomon commented May 31, 2023

师傅这个问题还没解决吗，大概好像结果1.8M左右就会出现这个问题

@komomon
Copy link

komomon commented May 31, 2023

image

@kxcode
Copy link

kxcode commented May 15, 2024

大佬有计划解决吗？

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@kxcode @Qianlitp @ox1234 @komomon