Williams was born in Wallasey, Cheshire, and raised in France. He started his football career in the youth system at Bordeaux, and played for the Bordeaux junior side which won the French under-18 championship. At the age of 18 he came to England with fellow French youngster Trésor Luntala for trials with Birmingham City, and both players signed on free transfers before the 1999–2000 season. Williams represented England at under-18 level. He made his first-team debut for Birmingham in August 2000, playing once in the League Cup and then three First Division matches, but his development was interrupted by the need for a hernia operation. Though he recovered sufficiently to resume playing reserve team football, scoring the goals which put the team into the semifinal of the Birmingham Senior Cup, a spate of injuries meant that those four games were all he played for Birmingham's first team before being released when his contract expired. He had a trial at Crewe Alexandra, on the recommendation of former assistant managerBrian Eastick, then Academy Director at Birmingham, but no contract ensued. He joined Conference side Scarborough for the 2003–04 season, but sustained a broken rib and punctured lung in only his second game, complications from which meant a prolonged stay in hospital and three months out of football. Returning in November 2003, he played a further ten league games, but was only an unused substitute in the club's FA Cup fourth round match against Premier League clubChelsea, despite scoring and hitting the post in the preceding league game. He then injured an ankle, and was released at the end of the season. He spent the 2005–06 season with Belgian Second Division club Excelsior Virton for whom he made three substitute appearances. In August 2006 he had a trial with Brighton & Hove Albion, scoring a goal in an 11–0 rout of French amateur side Racing Club Port du Havre, and making a promising substitute appearance in a 2–0 defeat against Le Havre AC, but manager Mark McGhee decided against signing him.