Wow, this sounds like a HEATED topic
Something I can't resist.
Though I don't have much to add from diving experience, I do know the following relevant facts from my general reading and engineering training, which may help to enlighten this debate.
1) Your body is always generating thermal energy. This energy must be dissipated into your environment if you are to survive. The three thermal processes that facilitate most of the heat removal are conduction, convection, and evaporation (sweating). You can not have heat flowing into your body from the environment for any significant period of time or you will quickly die.
2) When you feel cold or warm, it is not so much the ambient temperature you are sensing as the rate of heat loss from your body. When the heat loss rate is high you feel cold. When the heat loss rate is low you feel warm, or even hot.
3) The temperature difference between your body and its environment does contribute to heat loss, but it is not the only factor. The thermal resistance between you and your environment is the other big factor. Water has lower thermal resistance than air, so heat flows away from your body into water much faster than air. That is why you feel much colder in 70 degree water than in 70 degree air. Wetsuits have a high resistance to heat transfer, which is why we wear them, to reduce the heat transfer rate for any given temperature difference. The other big factor contributing to thermal resistance is convection (see 4)
4) Convective heat transfer (caused by either moving through the environment or the environment moving around us) is much higher than conductive heat transfer. We always feel colder when the wind is blowing than when the surrounding air is still. Similarly, our heat loss and sense of being cold in a moving water environment, i.e., rivers, waves and currents will always be greater than in still water of the same temperature.
3) In addition to temperature difference, motion, and thermal resistance of your surroundings, heat loss is a function of the rate at which your body is burning energy. When you are highly active, your body is generating more heat. It becomes harder for so much heat to be disipated into the environment. At some point, the only way for the heat transfer rate to keep up is for your body temperature to rise, thus increasing the temperature difference between the heat source and sink.
Good divers learn to expend as little energy as possible, in order to conserve breathing gas. They are less susceptible to overheating, and more susceptible to chills because they aren't generating as much heat to be removed.
4) Heat transfer occurs accross surface boundaries. Therefore, another significant factor in heat transfer and heat loss is the surface area between the heat source and the surroundings. An object with a large surface area dissipates heat into its environment faster. It is less likely to overheat and more likely to chill.
It is a physiological fact that a normal weight woman has more surface area than a man of the same normal weight.
I got this from a medical journal, not Playboy. It is no surprise then that women tend to feel colder than men in many environments, because on average they lose heat to their environment faster than men do.