Seems this discussion has been batted around in the past. Rolling resistance is a subjective measure, highly dependent upon the smoothness of the road surface, air pressure in the tire, and the weight of the rider. Fat tires really shine when the road surface gets rough, while narrow tires take off on smooth roads. It's the ability to deform around road imperfections, rather than having to bound over them, that gives the fatter tire much of its lower resistance. But that only applies if there are enough road imperfections to deform around. On very smooth roads, the advantage is to the thin tire.
Weight of the load matters, too. Heavier riders benefit from wider tires that don't deform as much to handle the load. Remember that the 19mm tires were made with skinny 150 pound riders in mind. 224 pounds might not go over so well.
Note that there are 28mm tubulars made for rough surface racing, such as cyclocross or Paris-Roubaix.
Simplest answer is to try the narrower tires and see how they feel. You can also crank up the pressure in your current tires if they will handle it - I ride my 22mm cotton Dugast tires at around 140psi. And changing to a sub 200 pound rider is going to make a huge difference in all aspects of cycling.