James Spencer (born 22 April 1936) is a British cross-country skier. He competed in the men's 30 kilometre event at the 1956 Winter Olympics.