Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Tap does not adhere to state file #35

Open
DanReia opened this issue Dec 7, 2022 · 0 comments
Open

Tap does not adhere to state file #35

DanReia opened this issue Dec 7, 2022 · 0 comments

Comments

@DanReia
Copy link

DanReia commented Dec 7, 2022

It appears that the tap does not adhere to the last bookmark in the state file, if the tap is run consecutively, the data is run from start_date until today (well less two days because of the GSC data delay) however on subsequent runs the tap will continue to run for the last date in the state file, causing duplicate data. For e.g running multiple times from 2022-12-01 to 2022-12-07:

  • Run 1: Runs for 2022-12-01 to 2022-12-05 due to data delay, writes 2022-12-05 to state file
  • Run 2: Runs for 2022-12-05 again
  • Run 3: Runs for 2022-12-05 again
  • and so on...
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant