A new set of fluence-to-absorbed dose and fluence-to-effective dose conversion coefficients has been calculated for high-energy neutrons using a whole-body anatomical model, VIP-Man, developed from the high-resolution transversal color photographic images of the National Library of Medicine's Visible Human Project. Organ dose calculations were performed using the Monte Carlo code MCNPX for 20 monoenergetic neutron beams between 20 MeV and 10,000 MeV under 6 different irradiation geometries: anterior-posterior, posterior-anterior, left lateral, right lateral, isotropic, and rotational. For neutron Monte Carlo calculations, results based on an image-based whole-body model were not available in the literature. The absorbed dose results for 24 major organs of VIP-Man are presented in the form of tables and selected figures that compare with those based on simplified mathematical phantoms reported in the literature. VIP-Man yields up to 40% larger values of effective dose and many organ doses, thus suggesting that the results reported in the past may not be conservative.