Olivier earned his first provincial selection when he was included in the Blue Falcons side that played at the Under-18 Academy Week tournament in 2010. After high school, he fell in with the ' youth structures and made five appearances for the side in Group B of the 2011 Under-19 Provincial Championship, helping them reach the semi-finals of the competition. In 2012, he made three starts for the s in the 2012 Under-21 Provincial Championship, scoring two tries in their match against s in a 31–27 victory. He was included in the Falcons' senior squad for the 2013 Vodacom Cup and made his first class debut by starting their Round One 0–62 defeat to the in Nelspruit. He also started their next match – as they bounced back to beat the 27–22 in Kempton Park – and their Round Three match against the in Potchefstroom, which saw Olivier score his first senior try halfway through the first half in a 16–47 defeat. He appeared as a replacement in their remaining four matches of the competition as they finished in seventh position on the Northern Section log to miss out on a quarter final berth. His Currie Cup debut came in August 2013; this also happened in Nelspruit in a match against the as he came on as a late replacement in a 12–69 defeat. He made one more Currie Cup appearance in their match against the in Welkom, but spent the majority of the season playing for and captaining the s in the 2013 Under-21 Provincial Championship. He started all seven of their matches and scored eight tries; he scored in six of their matches and got two tries against both and the s to finish the season as the Falcons U21s' top scorer. He made six appearances in the 2014 Vodacom Cup as the Falcons won one match out of seven to finish in seventh position on the Northern Section and a further three appearances in the 2014 Currie Cup qualification competition, where teams competed for a spot in the 2014 Currie Cup Premier Division. The Falcons finished in sixth spot to remain in the 2014 Currie Cup First Division. Olivier made three appearances in the Currie Cup First Division, including his first Currie Cup start in their 36–27 victory over the, a match which also saw Olivier score his first try in the Currie Cup competition in the final ten minutes of the match. The Falcons finished fourth on the log to qualify for the semi-finals; Olivier was not involved in their 31–24 victory over a team that finished top of the log or the final, where the Falcons lost 21–23 to the Griffons in Welkom. Olivier made four starts for the Falcons in the 2015 Vodacom Cup competition and contributed tries in their matches against the, Namibian side and the to help the Falcons finish in fifth spot, narrowly missing out on a quarter final spot. He made five appearances for them in the 2015 Currie Cup qualification competition where they again fell short, finishing in third spot on the log despite Olivier tries in their matches against the and the. He started their 2015 Currie Cup First Division campaign in fine style, scoring two tries in their 48–27 victory over the in the first match of the competition.
