#

cl100kbase

Here are 4 public repositories matching this topic...

dmitry-brazhenko / SharpToken

SharpToken is a C# library for tokenizing natural language text. It's based on the tiktoken Python library and designed to be fast and accurate.

csharp tokenizer openai gpt gpt-3 gpt-4 cl100kbase

Updated May 17, 2024
C#

saschaschramm / chatgpt

Analysis of OpenAI's ChatGPT

chat analysis plugins openai language-model gpt-4 chatgpt text-davinci-002-render tiktoken text-davinci-002-render-sha gpt-35-turbo-0301 gpt-35-turbo chat-markup-language cl100kbase text-davinci-002-plugins gpt-4-0613 gpt-35-turbo-16k-0613 gpt-4-32k-0613 gpt-35-turbo-1106

Updated Jan 28, 2024
Jupyter Notebook

tryAGI / Tiktoken

This project implements token calculation for OpenAI's gpt-4 and gpt-3.5-turbo model, specifically using `cl100k_base` encoding.

encoding csharp tokens openai gpt4 chatgpt tiktoken gpt35turbo cl100kbase tiktoken-sharp p50kbase

Updated May 20, 2024
C#

danny50610 / bpe-tokeniser

PHP port for openai/tiktoken (most)

tokenizer gpt-4 tiktoken gpt35turbo cl100kbase

Updated May 18, 2024
PHP

Improve this page

Add a description, image, and links to the cl100kbase topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the cl100kbase topic, visit your repo's landing page and select "manage topics."