The attack on Thursday took place in Blaili district of the capital Sanaa where mainly Houthis or their supporters live.
Reports suggest that the attack was carried out by two suicide bombers, one of them blew his explosives up inside the mosque and another carried out a blast in the courtyard of the mosque.
According to eyewitnesses, the blasts created a scene of massacre at the mosque with scattered body parts and puddles of blood on the ground.
No group has immediately claimed responsibility for the attack but such attacks have been carried out by the Islamic State (IS) group in the past.
IS militant group, which controls swathes of land in Iraq and Syria, considers Shia Muslims to be heretics.