Weight is very much a factor in your speed descending (as it is when ascending.) You are correct that the acceleration is independent of the rider's mass as demonstrated by Gallileo many years ago But the acceleration is only relevant to how quickly you achieve your top speed. Once your speed has stabilised you are not accelerating any more and this terminal velocity is determined by the velocity at which the resistance force matches your weight (assuming you're not pedaling any more.) There is a small component of the resistive force which is weight-dependent (from the friction in the tyres) but the massive majority of your resistance comes from air resistance, which is dependent only on your frontal area. And as you correctly pointed out yourself, "Wind drag may vary slightly between a heavy person and a light one but will be affected more by position on the bike." So the greater your mass, the greater your weight and consequently the faster you go before the wind resistance (a strong function of velocity) matches this weight.