In April 1686 James II appointed him Baron of the Exchequer, by the peremptory dismissal of Sir Standish Hartstonge, 1st Baronet. Rice was made a privy councillor in May along with Richard Talbot, 1st Earl of Tyrconnell, Thomas Nugent, Sir Richard Nagle, Justin MacCarthy, and Richard Hamilton. He first sat as a judge at the beginning of June, being dispensed from taking the Oath of Supremacy, and afterwards went to the Leinster circuit. The Court of Exchequer was the only Irish court from which a writ of error did not lie in England; as a result, it was crowded with suitors. Rice supported the resolve of Tyrconnell and his supporters to change the Caroline settlement. He opposed the suggestion of a commission of grace, by which money might be raised and the position of existing landowners might at the same time be respected. In August 1686, Rice said 'a commission would only serve to confirm those estates which ought not to be confirmed.' He declined to say what should be done to those whose titles were doubtful and declared that nothing could be done without a parliament. In November, Rice took steps to prevent the Court of Common Pleas, where John Keating presided, from interfering in disputes between revenue officers and merchants. In April 1687 he was made Chief Baron, displacing Henry Hene, and was knighted. After Tyrconnell succeeded Henry Hyde, 2nd Earl of Clarendon in the government, Protestants were dismissed from civil and military employment. The charters of nearly all the corporations, about one hundred in number, were brought into the exchequer by writs of quo warranto and declared void. The next step was the forfeiture of leases made by corporations. Rice declared that in this and other matters the Protestants should have the strict letter of the law. He was one of the privy councillors who on 8 March 1686–7 signed Tyrconnell's proclamation promising that "His Majesty's subjects of whatever persuasion should be protected in their just rights and properties due to them by law." The Corporation of Dublin was required to plead the validity of its charter at short notice, and this led to a clerical error in the pleadings. The Chief Baron refused leave to amend the irregularity, and declared the charter forfeited. Protestant mayors and sheriffs were generally expelled, and at Limerick Rice refused to hold the assizes until Tyrconnell's nominees were admitted. Rice himself became one of the forty-two burgesses under James's new charter. In August 1687, Rice was with Tyrconnell and Nagle at Chester, where he dined with the bishop Thomas Cartwright, and conferred with the king. Rice, accompanied by Chief-Justice Nugent, was sent to London early in 1688 to procure James's consent to Irish legislation. On 25 April, Clarendon noted in his diary that the two Irish judges that day began their homeward journey ‘with very little satisfaction, for I am told the king did not approve the proposals they brought him for calling a parliament.’
After James II's flight, Tyrconnell sent Rice to France with William Stewart, 1st Viscount Mountjoy, and they left Dublin on 10 January 1689. Mountjoy's instructions were to say that any attempt on Ireland would be hopeless, but he was sent to the Bastille as soon as he reached Paris. Rice urged an immediate invasion, and returned to Ireland with James in the following March. He became a commissioner of the Jacobite treasury, and was in Limerick during the first siege of the town in 1690. After William III's repulse there in August 1690, he went again to France, and returned with Tyrconnell. They brought some money, and landed at Galway in January 1691. However, following the Battle of the Boyne in July 1690, it had become clear that the Jacobite cause was ruined. A patent which would have made Rice a baron was found in Dublin, waiting to be signed by the now-exiled James II. The Crown adjudged Rice to be within the Articles of Limerick, and he remained in Ireland in possession of his estate. He does not seem to have returned to his practice as a barrister, but on 22 February 1703 he appeared without a gown at the bar of the Irish House of Commons, and on the 28 at that of the Lords, to argue against the Act to prevent the further growth of popery, and in favour of the articles of Limerick. He was accompanied by Sir Toby Butler, James's Solicitor General for Ireland, who made a memorable speech denouncing the Popery Act as being "against the laws of God and man". Rice died on 16 February 1715, aged 78.