Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to calculate overall Precision, Recall and F1 with these values of 14 categories? #22

Open
murphylmf opened this issue Jan 23, 2022 · 4 comments

Comments

@murphylmf
Copy link

Hello. I'm appreciated at your excellent work in this paper. But when I'm trying to calculate precision, Recall and F1, I don't know how
do you calculate these values.

Can you tell me how do you calculate the overall precision, recall and F1 in Table 3 after calculating these values related to each of the 14 categories?
image
I get these values with the code at https://github.com/MIT-LCP/mimic-cxr/blob/master/txt/validation/compare_negbio_and_chexpert.ipynb
Looking forward to your reply!

@murphylmf
Copy link
Author

And by the way, do you calculate these value with the "mention" method at https://github.com/MIT-LCP/mimic-cxr/blob/master/txt/validation/compare_negbio_and_chexpert.ipynb
?

which means that any word related to a certain category is counted no matter it is positive, negative or uncertain?

@wlufy
Copy link

wlufy commented Aug 8, 2022

Hello, do you know how to calculate them now? Thank you!

@catfish132
Copy link

I have the same question, did anyone know it?

@Otiss-pang
Copy link

I also have the same problem, have you solven this problem?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants