Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add pricing information for gpt4o #2046

Closed
marcklingen opened this issue May 13, 2024 Discussed in #2045 · 0 comments · Fixed by #2047
Closed

add pricing information for gpt4o #2046

marcklingen opened this issue May 13, 2024 Discussed in #2045 · 0 comments · Fixed by #2047
Assignees

Comments

@marcklingen
Copy link
Member

Discussed in https://github.com/orgs/langfuse/discussions/2045

Originally posted by varenc May 13, 2024

Describe the feature or potential improvement

OpenAI released their gpt-4o model today and it's now immediately available to all API users. It make sense for Langfuse to include this as one of the official pre-filled models. The docs say to request official support via an issue like this.

Additional information

There's both a gpt-4o and a gpt-4o-2024-05-13 per the usual convention. Also I believe langfuse will need to update to the latest version 7.0 of tiktoken which was just updated with gpt-4o support.

Here's a screenshot of the working a model definition I create for myself:
image

But note: in the model's openai Tokenizer config I had to just claim the model was the older gpt-4-turbo. Setting { ..., "tokenizerModel":"gpt-4o-2024-05-13", ... } resulted in gpt-4o logs showing 0 tokens, hence the need for a tiktoken upgraded.

@marcklingen marcklingen self-assigned this May 13, 2024
marcklingen added a commit that referenced this issue May 13, 2024
marcklingen added a commit that referenced this issue May 13, 2024
add pricing information for gpt4o
Fixes #2046
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant