Robert Gouger, a religious Dissenter and associate of Edward Gibbon Wakefield, was an early advocate for the establishment of the new colony in South Australia. From distributing Wakefield's A letter from Sydney to financing the South Australian Association, and persistent advocacy of the experimental colony, Gouger's role was critical. His appointment as Colonial Secretary was acknowledgment of this. Gouger's wife Harriet died in the new colony on 14 March 1837, followed by their baby son two days later.

Gouger became embroiled in the disagreements between Governor Hindmarsh and Colonel Light, which led to his suspension by Hindmarsh and return to England in 1837. Absolved of any wrong doing he returned to South Australia and his position as Colonial Secretary in 1839 with his new wife, Sarah. In 1841 Gouger relinquished the role of Secretary for the less strenuous position of Colonial Treasurer. However, in failing health he returned to England in 1844 where he died in 1846.