Bear in mind that even boards/coolers advertised as passive may require some airflow over them to keep them at a comfortable temperature - I assembled a mITX server with an Atom D510 board and with no fans in the case, I can't remember the temperatures but the heatsink got hot to touch, as did the ICH chip. And that's a very low TDP chip. A single quiet 120mm fan suspended next to the motherboard in the case brought everything down to little more than room temperature.
I'd consider using a positive pressure case with double filters as suggested above, a single intake fan might be enough for a low power system. And it wouldn't hurt to put a fan on the CPU heatsink as I'm guessing this is going to go somewhere pretty loud anyway.