Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add commands for automatically modifying configs #12020

Open
wants to merge 25 commits into
base: v4
Choose a base branch
from

Commits on Dec 23, 2022

  1. Add commands for automatically modifying configs

    This continues work started in
    explosion/projects#147,
    which provides features for automatically manipulating pipelines and
    configs. The functions included are:
    
    - merge: combine components from two pipelines and handle listeners
    - use_transformer: use transformer as feature source
    - use_tok2vec: use CNN tok2vec as feature source
    - resume: make a version of a config for resuming training
    
    Currently these are all grouped under a new `spacy configure` command.
    That may not be the best place for them; in particular, `merge` may
    belong elsewhere, since it outputs a pipeline rather than a config.
    
    The current state of the PR is that the commands run, but there's only
    one small test, and docs haven't been written yet. Docs can be started
    but will depend somewhat on how the naming issues work out.
    polm committed Dec 23, 2022
    Configuration menu
    Copy the full SHA
    f40d8c4 View commit details
    Browse the repository at this point in the history
  2. Fix import

    polm committed Dec 23, 2022
    Configuration menu
    Copy the full SHA
    ab2773e View commit details
    Browse the repository at this point in the history

Commits on Dec 26, 2022

  1. Fix types

    polm committed Dec 26, 2022
    Configuration menu
    Copy the full SHA
    f3a928c View commit details
    Browse the repository at this point in the history

Commits on Dec 27, 2022

  1. Add use_transformer test

    polm committed Dec 27, 2022
    Configuration menu
    Copy the full SHA
    836fd87 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    dab7894 View commit details
    Browse the repository at this point in the history
  3. TODO REVERT Try turning off batching

    Maybe this will fix the CI issue?
    polm committed Dec 27, 2022
    Configuration menu
    Copy the full SHA
    be95ef5 View commit details
    Browse the repository at this point in the history
  4. Revert "TODO REVERT Try turning off batching"

    This reverts commit be95ef5.
    polm committed Dec 27, 2022
    Configuration menu
    Copy the full SHA
    a749d2d View commit details
    Browse the repository at this point in the history
  5. Test use_tok2vec, not use_transformer

    Adding the transformer component requires spacy-transformers, which
    isn't present in the normal test env.
    polm committed Dec 27, 2022
    Configuration menu
    Copy the full SHA
    10bbb01 View commit details
    Browse the repository at this point in the history
  6. Add test for merging pipelines

    polm committed Dec 27, 2022
    Configuration menu
    Copy the full SHA
    2791f0b View commit details
    Browse the repository at this point in the history

Commits on Jan 11, 2023

  1. Add docs for configure command

    This also change the `output_file` arg to match other commands.
    polm committed Jan 11, 2023
    Configuration menu
    Copy the full SHA
    f2bbab4 View commit details
    Browse the repository at this point in the history

Commits on Jan 12, 2023

  1. Use new-style tags in docs

    polm committed Jan 12, 2023
    Configuration menu
    Copy the full SHA
    10adbcb View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    d7192c4 View commit details
    Browse the repository at this point in the history
  3. Fix new-style header

    polm committed Jan 12, 2023
    Configuration menu
    Copy the full SHA
    4bad296 View commit details
    Browse the repository at this point in the history

Commits on Jan 13, 2023

  1. Cleanup

    This removes one old print statement and some old TODOs. Some TODOs are
    left as future work.
    polm committed Jan 13, 2023
    Configuration menu
    Copy the full SHA
    3fe723c View commit details
    Browse the repository at this point in the history

Commits on Jan 31, 2023

  1. Add types to _deep_get

    polm committed Jan 31, 2023
    Configuration menu
    Copy the full SHA
    9d3e3e6 View commit details
    Browse the repository at this point in the history
  2. Add types to everything

    polm committed Jan 31, 2023
    Configuration menu
    Copy the full SHA
    9d0ae24 View commit details
    Browse the repository at this point in the history

Commits on Feb 9, 2023

  1. Configuration menu
    Copy the full SHA
    03a0c2b View commit details
    Browse the repository at this point in the history

Commits on Feb 10, 2023

  1. Apply suggestions from code review

    Co-authored-by: Raphael Mitsch <r.mitsch@outlook.com>
    polm and rmitsch committed Feb 10, 2023
    Configuration menu
    Copy the full SHA
    a76fd0d View commit details
    Browse the repository at this point in the history
  2. Code reorganization

    polm committed Feb 10, 2023
    Configuration menu
    Copy the full SHA
    c0a3e9a View commit details
    Browse the repository at this point in the history
  3. Add links to docs in docstrings

    polm committed Feb 10, 2023
    Configuration menu
    Copy the full SHA
    2524d06 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    b9537ec View commit details
    Browse the repository at this point in the history

Commits on Feb 13, 2023

  1. Update from code review

    polm committed Feb 13, 2023
    Configuration menu
    Copy the full SHA
    4279c73 View commit details
    Browse the repository at this point in the history
  2. Change back to short names

    polm committed Feb 13, 2023
    Configuration menu
    Copy the full SHA
    81276f2 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    5019d76 View commit details
    Browse the repository at this point in the history
  4. Fix function name in tests

    polm committed Feb 13, 2023
    Configuration menu
    Copy the full SHA
    e668c2c View commit details
    Browse the repository at this point in the history