Pryse's father, Pryse Pryse and brother, Pryse Loveden had both served as MP for Cardigan Boroughs. On his brother's death in 1855, Edward Pryse declined to contest the seat and John Lloyd Davies was elected as a rare Conservative MP for the constituency at the ensuing by-election. Pryse entered the political fray in 1857 when he emerged as a Liberal opponent to John Lloyd Davies. Although Pryse had little political experience, his connection with the family based at Gogerddan was considered to be a considerable advantage. Shortly after his candidature was announced, Davies had withdrawn from the contest. Pryse came under scrutiny in 1868 amidst suggestions that he was neglecting his parliamentary duties. His absence from a key debate on the disestablishment of the Irish Church was cited as an example of this. Matters came to a head on 29 May when a Liberal conference was held at Aberaeron to consider the representation of both the borough constituency and the Cardiganshire county seat. An editorial in the Welshman complained that the meeting was instigated by the Liberation Society and that prominent Liberals, including Pryse were not invited. Consideration was given to inviting the sitting member for the county, Sir Thomas Lloyd, who wanted to avoid the financial burden of a contested election, to contest the borough seat in place of Pryse. A few days later, Pryse announced at a meeting in Aberystwyth that he would retire from Parliament at the next election. On 16 June he issued and address announcing his retirement from the Commons.
Later life
In later years, Pryse was out of touch with the radicalism of Cardiganshire Liberalism. However he remained president of the Cardiganshire Liberal Association at the time of his death in 1888. Pryse opposed Gladstone's proposals to disestablish the Irish Church. In 1886, he opposed Gladstone's Home Rule proposals and supported David Davies who stood as a Liberal Unionist candidate for Cardiganshire in 1886. Davies was narrowly defeated and it was a blow to the prestigeof the House of Gogerddan that the family had supported a losing candidate. Pryse did, however, invite the winning candidate, Bowen Rowlands, to his home shortly after the election, appointed him a JP for the county and "generally accepted the situation with the best grace possible". As Lord Lieutenant, Pryse appointed more Liberals as magistrates than generally happened in other counties. At the time of his death the Cambrian News stated that Pryse 'believed it was his right and the right of his class to rule." His death was regarded as the end of an era.
