On his marriage, Coutts was taken into partnership by his wife's uncle, George Campbell, head of the Whig bank in the Strand who counted John Stuart, 3rd Earl of Bute as a customer. Upon Campbell's death in 1761, James took his brother Thomas into partnership with him. Lord Bute, as privy purse to George III, placed the royal account at Coutts' bank. In 1762, Coutts received an allotment of £76,000. On 27 February 1762 by-election, as a supporter of Lord Bute, Coutts was elected to replace George Lind as the Scottish representative for Edinburgh in the Parliament of Great Britain. Coutts supported the Grenville Administration, Bute's successor, on Wilkes and general warrants. On 19 March 1764, when speaking on a motion to regulate Scottish banks, his language in the House was sometimes "strange and incoherent". In response, his friends sent him an anonymous letter, a draft of which is preserved in the papers of Caleb Whitefoord.
"I am going to offer you my advice on a delicate point, I mean speaking in the House... It was with great concern that I saw you rise up to speak several times during the last session—the first time you spoke it was in some degree necessary—Would to Heaven you had stopped there, for indeed my dear Sir you are by no means qualified for speaking... If you regard your own peace and quiet, if you regard your political interest, if you regard the opinion of many eminent and worthy persons you will give up all thought of speaking in the House... The fair character you bore with everybody and your very becoming deportment in business and in every other situation of life made me feel the most sensible concern to see you appear so unlike yourself."
"After the letter, Coutts continued to attend the House and its committees, but there is no record of any further speech by him." In 1768, he was succeeded by the Whig member Sir Lawrence Dundas.
Later life
In 1774, on the expiration of their 12 years partnership agreement, his brother Thomas took steps to protect the bank's credit from James' perceived "irresponsible actions." Lord Bute, Stuart Mackenzie, Sir John Pringle and family friends signed a declaration that James was "an improper person to be connected with such a business" and he was forced to accept a financial settlement which he bitterly protested. In June 1775, however, he was forced to cut ties with the bank. Coutts went abroad in July 1775 and, again, in November 1776. Between 1777 and 1778, he became so violent in Turin that he kept under military guard. His keepers sent home aboard a ship but he died, while in confinement, at Gibraltar on 15 February 1778.
Coutts died on 15 February 1778 at Gibraltar on his forced way back to England.
Descendants
Through his only child Frances, he was a grandfather of Sir John James Stuart, 5th Baronet of Allanbank, who married twice, but had no children by either marriage, therefore, the baronetcy ended with his death in 1849.