Do your research, get recommendations, and inspect past projects and homes. It is a big purchase, and this is no time to skip the details.
Modular - is good in theory
Perhaps the main benefit of modular construction is that the overall approach makes sense. Build it in sections, control the process, minimise exposure to the weather. No different that if you were building an automobile, or a boat. Consider for a moment, that when you decide to buy that 43 foot Merritt. You'd expect it to be manufactured to tight specifications. Not slapped together quickly by two guys with a circular saw and a pickup truck (with no disrespect to pickup trucks).
Quality Variation
Just like cars and boats, home construction varies. And the same with modular home companies. Many companies build great homes, others sadly, build less than quality products. Like cars, they are not all the same. Visit homes the modular company has built recently. Call past customers. And take a tour of the plant. Quality companies want you to visit and see how they build homes.
Get Several Quotes
Talk to several modular home companies, talk to their sales representatives, and get quotes. Push hard, and don't be shy about letting them know they are talking to other companies. And that includes old style stick-built or panelized.