Skip to content
#

mappers

Here are 43 public repositories matching this topic...

This project implements a distributed K-means clustering algorithm using a custom-built MapReduce framework. It is designed to handle potentially large datasets by distributing the clustering workload across multiple processes or machines. Uses gRPC for the communication between mapper, reducer, master

  • Updated Apr 24, 2024
  • Python
smashed

SMASHED is a toolkit designed to apply transformations to samples in datasets, such as fields extraction, tokenization, prompting, batching, and more. Supports datasets from Huggingface, torchdata iterables, or simple lists of dictionaries.

  • Updated May 24, 2024
  • Python

Improve this page

Add a description, image, and links to the mappers topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the mappers topic, visit your repo's landing page and select "manage topics."

Learn more