He was the eldest son of Sir James Fergusson, 4th Baronet, fourth baronet, and his wife Jean Dalrymple, daughter of Sir David Dalrymple, baronet (Lord Hailes). He was educated at Harrow, and became an advocate in 1822, practising at the Scottish bar until his father's death. He was a member of the Speculative Society, and at its meetings read two essays, one on the Origin and Progress of Criminal Jurisprudence, and the other on the History of Painting.[1]
Fergusson was an active promoter of almost every scheme of usefulness throughout Scotland.
The county of Ayr, in which his seat was, was especially indebted to his active aid in its agricultural, charitable, and religious institutions. He was the originator of the Ayrshire Educational Association, and, at his own expense, built many schools and churches in Scotland.
He and his father received compensation in 1836 for the 198 enslaved people emancipated in 1834-1838 on the estate in Jamaica that they co-owned with Sir David Hunter-Blair, 3rd Baronet.[3] His great-great-great grandson, Alex Renton, writes that there is no record of Sir Charles building any churches or schools in Jamaica. [4]
He was returned to the general assembly of the church of Scotland, as a lay representative for Ayr.[1] He did much towards extending the usefulness and efficiency of the church, and in the sittings of its legislative body his counsels had great weight. A decided conservative in his political principles, both in church and state, Fergusson was yet strongly averse to the strife and turmoil of political life, and was remarkably tolerant in his sentiments. Although repeatedly urged by his friends, he could never be induced to seek election for his native county. To the last he was an able and zealous supporter of the cause of protection. Himself a colonial proprietor, he severely condemned the free trade legislation of Sir Robert Peel, which he believed must have an injurious effect upon the British colonies.[1]
In 1837, Fergusson succeeded to the estates of his grandfather, Lord Hailes, in East and Mid Lothian, and in 1838 to those of his father in Ayrshire, on which he constantly lived. He inherited Newhailes, and the Lordship and Barony of Hailes in 1839, on the death of his aunt, Miss Christian Dalrymple (when he also assumed the additional surname of Dalrymple).[6]
He died at Inveresk 18 March 1849.[1] The grave lies in the extreme north-west corner of the first Victorian extension, west of the original churchyard.