Repository navigation
Best qaulity result without speed / performance concern #74
Description
What is the best for detection (both accuracy and good landmark )and recognition model if there is no speed concern ? It could be run slower but produce highest quality results.
Such as RetFace-50 very good but old one. little bit slower . Is SCRFD superior than the retinaFace ? Specially feeding the recognition models ?
Is there any past experience or theoretical information ?
Best
Activity
SthPhoenix commentedon Mar 12, 2022
From my observations
scrfd_10g_bnkpsis better in term of lower false positive detections rate and better recall, though it produces worse landmarks for faces rotated at 90 and more degrees. Retinaface gives inaccurate landmarks in those conditions too, but they are mostly closer to expected.Secondly
bnkpsmodel doesn't work well for large faces, it mostly misses them.gnkpsmodel was retrained to fix this issue, but it has a bit lower recall and landmarks quality.Thought I must admit faces missed by
gnkpsmodel are mostly useless for recognition, since they are of very low quality.If you are not concerned about false detections and speed - Retinaface is still most universal detector IMO.
As for recognition I am mostly using
glintr100as most accurate from published models.BUT, there is also Webface based model
w600k_r50from official package, which is almost twice faster thenglintr100and have better accuracy on some benchmarks as reported by authors. I have tested it for clustering and it seem to produce clusters almost identical as glintr100 model, but I can't tell you if it's really better or not.MyraBaba commentedon Mar 12, 2022
@SthPhoenix Thanks for the reply. So best for accurate recognition is retinaface landmarks (R50).
have you tried yolo5l ?
Best
SthPhoenix commentedon Mar 12, 2022
It'll work better in extreme cases, but in general scrfd models should work pretty the same.
I have cloned the repo weeks ago, but still can't get some time to test it. It seems promising though.
MyraBaba commentedon Mar 13, 2022
@SthPhoenix What is your preferred metrics for glintr100 threshold according to your experience ?
and the paper said yolo5 landmarks better than the retinaFace so is it means producing better accuracy ? paper
finally what is your practical preference for arcface or cosface ? or distance make you satisfied
SthPhoenix commentedon Mar 13, 2022
I'm using
(1. + np.dot(A, B)) / 2.as similarity metric, which gives score in 0.0-1.0 range.From my experience scores above 0.8 are exact matches.
0.78-0.8 might contain false positive, though for really similar people and quite rarely.
0.75-0.78 contains more false positives though still rarely.
Everything below 0.75 could contain many false positives.
Also take note that true positives might be anywhere in range 0.6-1.0, poor image quality or side images may greatly decrease score, as well as comparing lot of poor images might give you lots of false positives with high scores.
MyraBaba commentedon Mar 13, 2022
@SthPhoenix so you are using similarity metric instead of distance ?
SthPhoenix commentedon Mar 13, 2022
Yes, I found it more human readable and convenient for display.
MyraBaba commentedon Mar 13, 2022
@SthPhoenix
I am testing lfw for glintr100.onx. as you know many small images.
Is there any way to index as batches to increase speed. ? GPU utilization not more than %15 .
SthPhoenix commentedon Mar 13, 2022
You can tweak batch sizes in
deploy_trt.sh.Also you can set multiple workers, though you should tweak your lfw code to support multithreading.
MyraBaba commentedon Mar 14, 2022
@SthPhoenix
Funny thing that genderModel says Queen_Elizabeth_II is Male :)
have you tested ?
SthPhoenix commentedon Mar 14, 2022
I always knew she has some secrets )
I'm not using gender age detection anywhere, this model was added just for compatibility with original lib. In my tests it shown bad accuracy too.
MyraBaba commentedon Mar 25, 2022
SthPhoenix commentedon Mar 25, 2022
Could you please provide link to the model you are talking about?
MyraBaba commentedon Mar 25, 2022
SthPhoenix commentedon Mar 25, 2022
I've downloaded it, but still some more info is needed ) What dataset was used for training? Are there any performance metrics available?
I haven't seen any info about ir-152 based models in deepinsight repo.
MyraBaba commentedon Mar 26, 2022
MyraBaba commentedon Mar 26, 2022
@SthPhoenix is this one or glint100 is better according to your field practice
SthPhoenix commentedon Apr 3, 2022
@MyraBaba unfortunately I can't check your model in near future, but just from benchmarks perspective they seems to be pretty the same.
Though I must admit that for later models it seems that classical LFW, CFP, AgeDB, etc. benchmarks may be not enough representative.
Also in many use cases slight accuracy gains may be neglected by slower inference of IR-152 backbone.
BTW, I have tested yolov5-face models, it seems they give a bit better landmarks in hard cases, though I haven't performed any speed tests yet.
I think if I'll be able to run those models at speeds comparable with at least RetinaFace, I'll add them to this repo.
SthPhoenix commentedon May 6, 2022
@MyraBaba , I have added support for
yolov5-facemodels, you can check it )MyraBaba commentedon May 6, 2022
looking now :) @SthPhoenix
MyraBaba commentedon May 6, 2022
SthPhoenix commentedon May 7, 2022
It's covered to onnx and will be automatically downloaded when you switch detector to, for example,
yolov5s-facein deploy-trt.shMyraBaba commentedon Jun 11, 2022
@SthPhoenix
I am trying to add mqt an option for your project. Still on it.
Meanwhile I would love to hear your experience regarding to realtime face recognition from video feed .
detection faces 25/fps means 25 faces every second for one person. If there is 3 person it means 3x25 = 75 faces per second has to be feature extracted and search through db. But there is 3 person.
what would be the best performant solution to lower faces number to send to recognition server for process ?
lowering fps could cause the miss the desired face chip or on the detection process using the low feature (12) to understan if the still same person and not to send to recognition server ?
What would be your suggestion ? Consider there will be 10 camera and a lot of faces coming { ie : 3 person per camera and 25 fps = 750 faces per second to hand } . Meanwhile recognition server re-detect face for better alignment .
Would love to hear your opinion and suggestion
SthPhoenix commentedon Oct 28, 2022
Hi! I have no much experience in such scenario, as I have noted somewhere else you could try combining detection\feature extraction with some kind of tracker algo, like FastMOT. Also if you scenario expects people entering room\building it might be good idea to limit face size and\or tune detection area to exclude unwanted by-passers in background.
PS: Wow, this question was posted on Jun 11, totally missed it.