The state and mass of H2 gas in star-forming galaxies: A new emerging view in the age of Herschel and ALMA