Skip to content

Commit

Permalink
add explanatory comment
Browse files Browse the repository at this point in the history
  • Loading branch information
sauyon committed Mar 14, 2023
1 parent 49dc7b6 commit f7dd4a2
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions src/bentoml/_internal/marshal/dispatcher.py
Expand Up @@ -354,6 +354,7 @@ async def controller(self):
a = self.optimizer.o_a
b = self.optimizer.o_b

# the estimated latency of the first request if we began processing now
latency_0 = w0 + a * n + b

if n > 1 and latency_0 >= self.max_latency_in_ms:
Expand Down

0 comments on commit f7dd4a2

Please sign in to comment.