Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to reload Projects rules #149

Open
daweiba opened this issue Mar 10, 2015 · 4 comments · May be fixed by #827
Open

How to reload Projects rules #149

daweiba opened this issue Mar 10, 2015 · 4 comments · May be fixed by #827

Comments

@daweiba
Copy link

daweiba commented Mar 10, 2015

When I change the Projects rules.
It often can't normal reload.

If I will load rules success , have to restart pyspider.

@binux
Copy link
Owner

binux commented Mar 10, 2015

Another user reported this issue, but I have no idea.

What version are you using?
How do you start pyspider?
What database are you using?
Could you paste the logs just before and after you change the scripts?

@daweiba
Copy link
Author

daweiba commented Mar 10, 2015

How to get the pyspider Version?

pyspider --help
Usage: pyspider [OPTIONS] COMMAND [ARGS]...

  A powerful spider system in python.

Options:
  -c, --config FILENAME    a json file with default values for subcommands.
                           {"webui": {"port":5001}}
  --debug                  debug mode
  --queue-maxsize INTEGER  maxsize of queue
  --taskdb TEXT            database url for taskdb, default: sqlite
  --projectdb TEXT         database url for projectdb, default: sqlite
  --resultdb TEXT          database url for resultdb, default: sqlite
  --amqp-url TEXT          amqp url for rabbitmq, default: built-in Queue
  --phantomjs-proxy TEXT   phantomjs proxy ip:port
  --data-path TEXT         data dir path
  --help                   Show this message and exit.

Commands:
  all
  bench
  fetcher
  processor
  result_worker
  scheduler
  webui

@binux
Copy link
Owner

binux commented Mar 10, 2015

If there is no --version option, it's an old version. It's better to upgrade first to see if it's fixed.

@daweiba
Copy link
Author

daweiba commented Mar 13, 2015

I update the pyspider ,but bug still there

~  pip install pyspider -U
Requirement already up-to-date: pyspider in /Library/Python/2.7/site-packages
...
...
...
Requirement already up-to-date: backports.ssl-match-hostname in /Library/Python/2.7/site-packages (from tornado>=3.2->pyspider)

➜  ~  pyspider --version
pyspider, version 0.3.3

database => mysql

Strat by

pyspider -c pyspider.json
cat pyspider.json 
{
  "taskdb": "mysql+taskdb://user:pass@localhost:3306/pyspider_taskdb",
  "projectdb": "mysql+projectdb://user:pass@localhost:3306/pyspider_projectdb",
  "resultdb": "mysql+resultdb://user_pass@localhost:3306/pyspider_resultdb"
}

@KaitoHH KaitoHH linked a pull request Aug 17, 2018 that will close this issue
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants