Oliver decided to stay close to home and committed to playing college football at the University of Georgia. After redshirting for a year, Oliver developed into a key reserve in his first two years playing, earning him preseason third-team All-SEC honors before his 3rd year. Oliver, thrust into a starting role broke out as one of the best corners in the SEC his junior year. In his first game as a starter, filling in for the injured DeMario Minter, Oliver shut down University of Florida star Chad Jackson, holding him to only 2 catches for 22 yards. Oliver was awarded with Georgia's Most Improved Defensive Player Award after the 2005 season. Oliver had his best game as a Bulldog on November 25, 2006, against Georgia Tech shutting down the 2nd overall pick in the 2007 NFL Draft, Calvin Johnson, though not without some help from Georgia Tech quarterbackReggie Ball. Oliver, whose primary role was to contain Johnson, ended up frustrating the All-American by holding him to only 13 yards and 2 receptions, batting away 3 balls intended for Johnson and intercepting another. Reggie Ball threw the pass into heavy traffic on the Yellow Jacketsfinal drive and Oliver came up with the interception sealing a 15-12 Bulldog victory. Oliver finished the day with 4 solo tackles, 3 of which were on third down plays in the red zone, and also forced a fumble. Oliver ended his three-season career at Georgia with 7 interceptions, 8 deflected passes, 94 tackles, 8.5 tackles for loss, 3 sacks, 5 forced fumbles, and 2 recovered fumbles.
Early departure
Oliver was ruled academically ineligible on May 17, 2007 and decided to apply for the 2007 supplemental draft held 2 months later on July 12, 2007. Oliver, who tested well in the Wonderlic Test, was seen as a player who lacked the motivation to succeed in school rather than not having the aptitude or intelligence.
Professional career
2007 Supplemental Draft
Despite not having as much time to train as other prospects who go through the normal draft process, Oliver was able to garner enough interest to be the consensus #1 player in the supplemental draft. The San Diego Chargers ended up bidding their 2008 4th rounder for the rights to select Oliver making him the 1st of only two players selected in 2007's supplemental draft. The other player was Maryland tackle Jared Gaither selected by the Baltimore Ravens one round after Oliver. In a statement concerning Oliver, Chargers General Manager, A. J. Smith said, "We had the opportunity to get a good football player today, and we took it. Paul Oliver is a very competitive, aggressive, confident player. He's not cautious about anything he does on the field. You know how we like depth. We'll add Paul to the mix as a Charger and time will tell." Despite timing poorly at his 2007 Pro Day, Oliver displayed good footwork and also did well in cornerback drills.
NFL career
Oliver played for the Chargers from 2007 to 2010. He then became a free agent and signed with the Saints, but was released after being injured during training camp. On September 21, 2011, Oliver returned to the Chargers for the 2011 season.
Death
Oliver died by suicide from a self-inflicted gunshot on September 24, 2013. He is survived by his wife, the former Chelsea Young, and two children. Police on the incident state that Oliver shot himself in front of his wife and his two young boys. It was later determined through analysis of Oliver's brain that he suffered from an advanced form of Chronic traumatic encephalopathy, or CTE, caused by repeated concussions he endured during his football playing career.