Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Hi @elronbandel
I made 2 things:
1 - I fixed the bioasq card - we had an error there.
2 - the clapNQ - we point now to the HF for accessing the dataset
However, this main fails on clap_nq!
And I do not succeed to understand why
`from typing import Literal
from datasets import Dataset
from unitxt import load_dataset
def access_to_card(
dataset_name,
card_type: Literal["documents", "benchmark"],
split: Literal["train", "test"],
) -> Dataset:
if name == 'main':
for d_name in [
'bioasq',
'clap_nq'
]:
# Benchmark
for s in ['train',
'test'
]:
print(f"#Benchmark ({s}) for {d_name} : {len(access_to_card(d_name, 'benchmark', s))}")
# Documents:
print(f"#Documents for {d_name} : {len(access_to_card(d_name, 'documents', 'train'))}")
`