Gembis played college football at the University of Michigan from 1927 to 1929 as a fullback and placekicker. Highlights of Gembis' playing career at Michigan included the following:
On November 3, 1928, Gembis ended Illinois' undefeated season, kicking a field goal for the game's only points in a 3–0 Michigan victory. This was the first field goal kicked in Michigan Stadium history.
On November 24, 1928, Gembis scored four points on a field goal and an extra point to lead Michigan to a 10–7 victory over Iowa.
On October 5, 1929, Gembis scored 11 points on a touchdown run, field goal, and two extra points in a 17–0 victory over Michigan State.
On November 9, 1929, Gembis' two extra points provided the winning margin in a 14–12 victory over Harvard.
On November 16, 1929, Gembis was credited with playing a "whale of a game," and his extra point kick gave Michigan a 7–6 victory over Minnesota.
The Detroit Free Press in November 1929 noted: "Gembis' presence in the blue line up has been invaluable. His place kicking has been an indispensable factor in the Wolverine attack. Without the service of his productive toe, it is extremely doubtful if Michigan's record would be studded with any major victories." Gembis received his bachelor of arts degree from Michigan in 1930. In 1930, Gembis played semi-professional football as a fullback and placekicker for the Ironton Tanks in Ironton, Ohio. The Cincinnati Enquirer in November 1930 wrote: "Dynamite Joe Gembis, Tank fullback, is without a doubt the finest line-smasher to ever show at Redland Field."
Football coach
Gembis spent one year as a football coach at Chesapeake High School in Ohio. His 1931 Chesapeake team compiled a 6–4–1 record. In July 1932, he was hired as the head coach at College of the City of Detroit. He remained in that position for 14 years. His 1934 team compiled a 7–1 record, and from 1934 to 1937 his teams went 23–7. However, the program declined after 1937, winning only six games from 1941 to 1945. He was fired in April 1946. Gembis compiled a career record of 42-51-8 at Wayne State.
Family and later years
Gembis was married to Florence Ruby Smith in June 1934. They had three children, Douglas, Ann, and Charles. In his later years, Gembis continued to work as an associate professor of health and physical education at Wayne State. He also operated the Hazawitka Summer Camp in Mayfield, Michigan. He died from a heart attack at the camp in July 1969 at age 61. Gembis was posthumously inducted into the Wayne State UniversityHall of Fame in 1980.