Scrape groups

[nevo-david]

Add group scraping
https://www.linkedin.com/groups/6519652/members/

Try to solve the infinite scroll problem

[Gulshanaggarwal]

Hey @nevo-david I would like to work on the issue. Although I haven't worked so much in scraping but a quick learner. If you guides a little bit then it will be easy. What's this infinite scroll problem in context of scraping groups can you explain?

[nevo-david]

Hi @Gulshanaggarwal,
Thank you so much for being a part of it!

In every Linkedin search, you have pagination (10/25 results per page).
But for the group area, there is a scrolling that shows more results every time you go down.

So you would need to scroll down multiple times to get all the prospects.

Let me know how else I can help :)
Do you want me to assign it to you? :)

[Gulshanaggarwal]

@nevo-david I just gone through Linkedin but for Group you have pagination already available there. You don't need to scroll again & again.
See the image below->

Is there something else I'm missing?

[nevo-david]

Yes, this is a group search, I am talking about a specific group :)
Just enter a group

[Gulshanaggarwal]

Hey @nevo-david but still I don't see the issue. Can you please share the screenshot?

[nevo-david]

For example, enter here
https://www.linkedin.com/groups/6519652/

And then
https://www.linkedin.com/groups/6519652/members/

[Gulshanaggarwal]

I got it @nevo-david. Thanks for the screenshot, actually I'm not part of any group that's the reason I couldn't see it. It means we have to scrape group users?

[linvo-io]

Yes!

…

On Sat, Oct 8, 2022 at 9:00 PM Gulshan aggarwal ***@***.***> wrote: I got it @nevo-david <https://github.com/nevo-david>. Thanks for the screenshot, actually I'm not part of any group that's the reason I couldn't see it. It means we have to scrape group users? — Reply to this email directly, view it on GitHub <#5 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ASA4VQ2BS2PGHEPX5EH5VN3WCF5BDANCNFSM6AAAAAARABVMHY> . You are receiving this because you are subscribed to this thread.Message ID: ***@***.***>

-- *Nevo David, Ceo & Founder at Linvo.io* ***@***.*** ***@***.***>*

[Gulshanaggarwal]

Hey @nevo-david I'm getting error when I run any script from package.json file.

see the image below->

[Gulshanaggarwal]

Hey @nevo-david I'm getting error when I run any script from package.json file.

see the image below->

Opearting System : Windows
Node Version : 16.13.2

[Gulshanaggarwal]

Hey @nevo-david finally I got the solution. I think this problem is especially with Windows users. I just added node at starting of each script and it worked for me. I think we should add it the contribution guidelines so that user don't face issue like these? What do you say?

[AlorenaP]

Hi, I am experiencing the same problem, from a windows machine. I have added "node" at the beginning of the url of each script in the package.json file and it didn't work, can anyone help me, I have tried several options and I can't find the solution.