Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow synchronous usage #57

Open
c33s opened this issue Mar 5, 2019 · 6 comments
Open

Allow synchronous usage #57

c33s opened this issue Mar 5, 2019 · 6 comments

Comments

@c33s
Copy link
Contributor

c33s commented Mar 5, 2019

the implementation of the parallel processing with on windows requires temporary file creation, where the files communicate over dynamic ports.
in a strict firewall environment (every process which want to connect has to be allowed on a specific port or port range first). currently it is not possible to handle this at all (will open a ticket at amphp).
the main problem is that the files have random names, so it is not possible to precreate firewall rules.

also see my other ticket at box-project/box#166

would love to see an --no-parallel flag, where your tool works synchronous without the use of amphp.

@dantleech
Copy link
Owner

dantleech commented Mar 5, 2019

I would also like to see an abstraction from Amphp (if only to have a Swoole implementation). So with that done, having a purely synchronous version should be easy.

@trowski
Copy link

trowski commented Mar 6, 2019

Can you please run composer update to ensure you're getting amphp/dns v0.9.14. That version removed the async hosts file loading which had the dependency on amphp/parallel, so at least that should eliminate the immediate problem for this library.

@c33s I'll soon address the issues you opened in amphp.

@c33s
Copy link
Contributor Author

c33s commented Mar 7, 2019

amphp/process#37
as soon as 1.1.1 is released you should update

@dantleech
Copy link
Owner

Can you confirm this update fixes the issue on Windows?

@c33s
Copy link
Contributor Author

c33s commented Mar 8, 2019

@dantleech only partly. on windows a helper process file is needed for amphp to work, with process 1.1.1 the name of this created exe file is always the same, so it is possible to create firewall rules for it (before the filename was random, so no fw rules could be created). so it is a huge improvement.

still it would be cool to use this tool without the need for creating firewall rules for helper processes. so this issue maybe should stay open.
but the team at amphp reacted really fast and in an awesome manner to the issue i opened, so i hope a full solution could be find in amphp so it simply works no matter if port access is blocked or not.

@c33s
Copy link
Contributor Author

c33s commented Oct 10, 2021

still requesting a synchron usage as it would help to unbreak this awesome tool on windows and also help on CI. having the colored output, no --display-bufsize=9999 and no need to limit the request speed as synchron access is simply slower. to fast crawling also easily triggers firewalls,

i have quite a good experience with the symfony process component (but i also use it synchron).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants