Bytyqi started his youth career with Burger BC 08 in 2006 spending three years there. In 2009, he moved to 1. FC Magdeburg where he played for the under-17 side during the 2013–14 season scoring a hat-trick in the Junior Championship U17 relegation play-offs against Eintracht Norderstedt U17 side in a 1–5 away victory of his side. After scoring 45 goals in the U17 team's season, he caught the attention of major clubs and ended up signing for SV Werder Bremen in July 2014. He started the season with under-19 side of SV Werder Bremen and scored the only goal in a 3–1 loss against Eintracht Braunschweig U-19. Then in the second game week he managed to score a hat-trick against Dynamo Dresden U-19 and his side won the match 5–2. He was a key player of the team playing 22 games as a starter in which he was substituted off on 9 occasions and scored 14 goals during the 2014–15 season.
His impressive form during the first season with under-19 side made him to gain entry also with SV Werder Bremen II where he debuted for the side in the Regionalliga Nord on 14 February 2015 against Hannover 96 II coming on as a substitute in 84th minute in place of Maximilian Eggestein. After another game as a substitute a week later against VfR Neumünster, he scored his first goal for the side in his third match as a substitute on 10 May 2015 against Lüneburger SK Hansa, thereby saving them from defeat. A week later he played his first match as a starter and managed to score a hat-trick in a 7–0 victory over FT Braunschweig and scored twice the next week against BV Cloppenburg to give his side the 0–2 away victory. It was his last match for the regular season of Regionalliga as his side finished in the top of the table. Bytyqi participated with the side in a two-legged tie for play-off promotion against Borussia Mönchengladbach II where he played the full 90-minutes match in the 1st leg in a 0–0 draw; In the second leg he played as a starter but was substituted off in the 73rd minute for Florian Bruns as SV Werder Bremen II won 0–2 after extra-time and gained promotion to 3. Liga. On 5 September 2015, Bytyqi made his professional debut in the 3. Liga against Preußen Münster coming on as a substitute in the 56th minute in place of Ousman Manneh. He was released by Werder Bremen at the end of the 2016–17 season. In his two seasons in 3. Liga with the reserves he made 42 appearances scoring twice and making three assists.
