Startup time with plugins is large

[wpietri]

No description provided.

[brianwgoldman]

I did a really dumb timing thing to see which module might be at fault:

start = datetime.now()
importlib.import_module(module_name)
diff = datetime.now() - start

Even when shuffling the order of the loop, huggingface_client is almost always the slowest by about twice second place, which is discrim_eval, which is twice third place. These two both have large unique dependencies (transformers and [sklearn, statsmodels], respectively) that seems like plausible culprits.

There does seem to be some caching, as poetry install followed by poetry install --extras all_plugins makes the first run very slow (6 seconds) vs subsequent calls (2 seconds).