Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[DOCS] Add URL examples for scraping services #21

Open
TheOtherBrian1 opened this issue Oct 10, 2022 · 3 comments
Open

[DOCS] Add URL examples for scraping services #21

TheOtherBrian1 opened this issue Oct 10, 2022 · 3 comments
Assignees
Labels
documentation Improvements or additions to documentation

Comments

@TheOtherBrian1
Copy link

TheOtherBrian1 commented Oct 10, 2022

Description

I have been trying to use Linvo's scraping library found in the linkedin.global.page.service.ts . Unfortunately, in the required parameters section it doesn't specify which URLs are acceptable for scraping.

interface RequiredData {
  page: number;
  url: string; //WHAT DOES THE URL LOOK LIKE
  remove_overlapping: boolean;
}

It would be very helpful to provide one or more of the following:

  • TypeScript URL checking
  • A descriptive URL related comment in the linkedin.global.page.service.ts file
  • A descriptive error message that outlines which webpages are appropriate
  • Documentation that specifies which webpages can be scraped

Right now, when I provide the following URL as an argument

https://www.linkedin.com/search/results/all/?keywords=DATA%20SCIENCE%20JOBS&origin=GLOBAL_SEARCH_HEADER&sid=Q~M

I receive the warning:

originalMessage: 'Cannot navigate to invalid URL'

Unfortunately, for less experienced users like myself, this error message is not informative enough to be actionable.

@TheOtherBrian1 TheOtherBrian1 added the documentation Improvements or additions to documentation label Oct 10, 2022
@TheOtherBrian1 TheOtherBrian1 changed the title [DOCS] <Add URL types to TypeScript> [DOCS] Add URL examples for scraping services Oct 10, 2022
@nevo-david
Copy link
Collaborator

Yes, it has to be with "https://www.linkedin.com/search/results/people/" can you add it to the docs?

@TheOtherBrian1
Copy link
Author

TheOtherBrian1 commented Oct 11, 2022

Yeah, I can add it. I can work on creating a tutorials/examples section

@nevo-david
Copy link
Collaborator

Awsome! Assigning it to you!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
documentation Improvements or additions to documentation
Projects
None yet
Development

No branches or pull requests

2 participants