is bentoml not supporting requirements's -f option?

[DrizzlingCattus]

when i read bentoml docs, there is sentence for requirements's -f option like this.

Note that although this supports the use of remote Git URLs, any use of Pip package options like -i or -f is not supported. If you’d like to use those features, you can define your own requirements.txt file and pass it using the requirements_txt_file option by doing @bentoml.env(requirements_txt_file='./requirements.txt').

so, i add requirements_txt_file, but result is following

# requirements
-f https://developer.download.nvidia.com/compute/redist/nvidia-dali-cuda100/nvidia_dali_cuda100-0.28.0-1761993-py3-none-manylinux2014_x86_64.whl
nvidia-dali-cuda100
...

# trace messages
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/pkg_resources/_vendor/packaging/requirements.py", line 90, in __init__
    req = REQUIREMENT.parseString(requirement_string)
  File "/usr/local/lib/python3.8/dist-packages/pkg_resources/_vendor/pyparsing.py", line 1654, in parseString
    raise exc
  File "/usr/local/lib/python3.8/dist-packages/pkg_resources/_vendor/pyparsing.py", line 1644, in parseString
    loc, tokens = self._parse( instring, 0 )
  File "/usr/local/lib/python3.8/dist-packages/pkg_resources/_vendor/pyparsing.py", line 1402, in _parseNoCache
    loc,tokens = self.parseImpl( instring, preloc, doActions )
  File "/usr/local/lib/python3.8/dist-packages/pkg_resources/_vendor/pyparsing.py", line 3417, in parseImpl
    loc, exprtokens = e._parse( instring, loc, doActions )
  File "/usr/local/lib/python3.8/dist-packages/pkg_resources/_vendor/pyparsing.py", line 1402, in _parseNoCache
    loc,tokens = self.parseImpl( instring, preloc, doActions )
  File "/usr/local/lib/python3.8/dist-packages/pkg_resources/_vendor/pyparsing.py", line 3739, in parseImpl
    return self.expr._parse( instring, loc, doActions, callPreParse=False )
  File "/usr/local/lib/python3.8/dist-packages/pkg_resources/_vendor/pyparsing.py", line 1402, in _parseNoCache
    loc,tokens = self.parseImpl( instring, preloc, doActions )
  File "/usr/local/lib/python3.8/dist-packages/pkg_resources/_vendor/pyparsing.py", line 3400, in parseImpl
    loc, resultlist = self.exprs[0]._parse( instring, loc, doActions, callPreParse=False )
  File "/usr/local/lib/python3.8/dist-packages/pkg_resources/_vendor/pyparsing.py", line 1406, in _parseNoCache
    loc,tokens = self.parseImpl( instring, preloc, doActions )
  File "/usr/local/lib/python3.8/dist-packages/pkg_resources/_vendor/pyparsing.py", line 2711, in parseImpl
    raise ParseException(instring, loc, self.errmsg, self)
pkg_resources._vendor.pyparsing.ParseException: Expected W:(abcd...) (at char 0), (line:1, col:1)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/pkg_resources/__init__.py", line 3110, in __init__
    super(Requirement, self).__init__(requirement_string)
  File "/usr/local/lib/python3.8/dist-packages/pkg_resources/_vendor/packaging/requirements.py", line 92, in __init__
    raise InvalidRequirement(
pkg_resources.extern.packaging.requirements.InvalidRequirement: Invalid requirement, parse error at "'-f https'"

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "build_bentoservice.py", line 107, in <module>
    main()
  File "build_bentoservice.py", line 103, in main
    saved_path = bento_svc.save()
  File "/usr/local/lib/python3.8/dist-packages/bentoml/service/__init__.py", line 700, in save
    return yc.repository.upload(self, version, labels)
  File "/usr/local/lib/python3.8/dist-packages/bentoml/yatai/client/bento_repository_api.py", line 132, in upload
    save_to_dir(bento_service, tmpdir, version, silent=True)
  File "/usr/local/lib/python3.8/dist-packages/bentoml/saved_bundle/bundler.py", line 228, in save_to_dir
    _write_bento_content_to_dir(bento_service, path)
  File "/usr/local/lib/python3.8/dist-packages/bentoml/saved_bundle/bundler.py", line 95, in _write_bento_content_to_dir
    bento_service.env.save(path)
  File "/usr/local/lib/python3.8/dist-packages/bentoml/service/env.py", line 327, in save
    self.add_packages_from_requirements_txt_file(self._requirements_txt_file)
  File "/usr/local/lib/python3.8/dist-packages/bentoml/service/env.py", line 305, in add_packages_from_requirements_txt_file
    for req in parse_requirements(content):
  File "/usr/local/lib/python3.8/dist-packages/pkg_resources/__init__.py", line 3103, in parse_requirements
    yield Requirement(line)
  File "/usr/local/lib/python3.8/dist-packages/pkg_resources/__init__.py", line 3112, in __init__
    raise RequirementParseError(str(e))
pkg_resources.RequirementParseError: Invalid requirement, parse error at "'-f https'"

what can i do for it?

[parano]

Thanks for reporting this @DrizzlingCattus, this isse has already been fixed here and it will be available in the next release

[DrizzlingCattus]

@parano Thank you for answer. I should build and use the latest version.

[DrizzlingCattus]

@parano

latest(master) has problem with multiprocessing setting.

Traceback (most recent call last):
  File "build_bentoservice.py", line 18, in <module>
    from tools.craft_detector_bentoservice_gpu import CraftDetectorBentoService
  File "/app/tools/craft_detector_bentoservice_gpu.py", line 6, in <module>
    import bentoml
  File "/usr/local/lib/python3.8/dist-packages/bentoml/__init__.py", line 29, in <module>
    multiprocessing.set_start_method('fork')
  File "/usr/lib/python3.8/multiprocessing/context.py", line 243, in set_start_method
    raise RuntimeError('context has already been set')
RuntimeError: context has already been set

import psutil

if psutil.POSIX:
    # After Python 3.8, the default start method of multiprocessing for MacOS changed to
    # spawn, which would cause RecursionError when launching Gunicorn Application.
    # Ref:
    # https://docs.python.org/3/library/multiprocessing.html#contexts-and-start-methods
    #
    # Note: https://bugs.python.org/issue33725 claims that fork method may cause crashes
    # on MacOS.
    import multiprocessing

    multiprocessing.set_start_method('fork')

I think it should be wrapping with try ~ except. What do you think about this?

import multiprocessing

try:
    multiprocessing.set_start_method('fork')
except RuntimeError:
    ...

[DrizzlingCattus]

If you take the measures as above, everything works without problems. And if there is no problem, I would like to take that as a starting point for my bentoml contribution.