For club information go to
http://www.usfencing.org
and click on "info for members" then click "clubs and divisions" then click on new york. You want clubs in Hudson-Berkshire division
http://www.hudsonberkshire.com
There are a few clubs in the Albany area.
The other thing that might interest you is checking out Green Mountain Division (click vermont instead of NY).
http://www.vtfencing.org
There's fencing in Middlebury, Burlington, and Charlotte which aren't too far from Plattsburg. Mmmm, I just noticed that that's not too far as the crow flies, I don't see an easy way of crossing Lake Champlain.
I'd say that your best bet would probably be Salle Dom Szabli, a sabre-only club in the Clifton Park Mall in Clifton Park, NY. According to Mapquest that's about 26 minutes from Saratoga Springs. If you go tell Mitch that Brad Baker sent you.
-B :)