Skip to content

Issues: IBM/unitxt

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

43 Open 61 Closed
43 Open 61 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Unitxt explore seems to be using an older version of unitxt
#786 opened May 1, 2024 by yoavkatz
@elronbandel
Fusion does not assign value to field "group" of every instance resulting in errors in metrics computation bug Something isn't working
#764 opened Apr 11, 2024 by elronbandel
@dafnapension
Demos sampling per instance is not consistent for shuffled stream bug Something isn't working
#759 opened Apr 10, 2024 by elronbandel
Suggestion: More informed approach to multi-linguality in Unitxt ease-of-use Readability, requires redundant work, unintuitive etc.
#758 opened Apr 10, 2024 by elronbandel
@elronbandel @dafnapension
DiverseLabelsSamples clarification
#740 opened Mar 31, 2024 by yoavkatz
@eladven @elronbandel
Metrics naming with overwrite args
#737 opened Mar 31, 2024 by arielge
Wrong type of values in regression tasks
#731 opened Mar 28, 2024 by pawelknes
@pawelknes
LoadFromIBMCos does not work if datafile has '/' in name
#708 opened Mar 25, 2024 by yoavkatz
Issue with the production of MMLU datasets
#702 opened Mar 21, 2024 by eliyahabba
Disable nan transformation in loaders.LoadCSV
#700 opened Mar 21, 2024 by benjaminsznajder
@elronbandel
1
Add new load from dictionary
#699 opened Mar 21, 2024 by yoavkatz
Suggestion: Add notion of SubTask
#694 opened Mar 20, 2024 by elronbandel
1
Add type checking for task definition.
#693 opened Mar 20, 2024 by yoavkatz
@yoavkatz @pawelknes
Add FunctionRecipe that utilze the standard recipe to create a function that can be used to parse data at inference.
#692 opened Mar 20, 2024 by elronbandel
Add to all type checking error messages the wrong type it got.
#691 opened Mar 20, 2024 by elronbandel
Add DynamicFormat that uses different SystemFormat based on size of demos list and existence of instruction.
#690 opened Mar 20, 2024 by elronbandel
new format and system prompt for MtBench
#673 opened Mar 17, 2024 by OfirArviv
1
@OfirArviv
Handling sensitive data sent to remote services
#646 opened Mar 11, 2024 by yoavkatz
1
Seed control in unitxt
#549 opened Feb 1, 2024 by yoavkatz
1
MultiReferenceTemplate fails to apply output_format.
#517 opened Jan 26, 2024 by jlqibm
possible full import needed in unitxt.dataset
#514 opened Jan 23, 2024 by sam-data-guy-iam
1
Modify the BertScore metric report to include the metric name
#472 opened Jan 14, 2024 by gitMichal
@assaftibm
MetricPipeline in not limited in n_resamples in tests
#447 opened Jan 3, 2024 by yoavkatz
rougeL returns 0 score on perfect prediction in some languages
#441 opened Jan 1, 2024 by yoavkatz
@gitMichal
1
matthews_correlation returning 0 on perfect correlation
#439 opened Jan 1, 2024 by yoavkatz
@dafnapension
11
ProTip! Follow long discussions with comments:>50.