Charles Noel Somerset (September 12 1709 - October 28, 1756) was the younger son of Henry Somerset, 2nd Duke of Beaufort, and Rachel Noel . Because his brother had no issue, on February 24 1745/1746, on his brother's death, he succeeded him and became 4th Duke of Beaufort.

On May 1 1740, he married to Elizabeth Berkeley, sister of Norborne Berkeley, (1st) Lord Bottetourt , who died on April 8 1799, with whom he had one son and three daughters:

1. Henry Somerset, 5th Duke of Beaufort his heir and successor; and
2. Lady Anne Somerset, who was born on March 11 1740/1741, died on May 18 1763 and was married to Charles Compton, 7th Earl of Northampton on September 13 1759, with whom she had one child, a daughter;
3. Lady Mary Isabella Somerset, who died on September 2 1831 and was married to Charles Manners, 4th Duke of Rutland on December 26 1775 or 1755, with whom she had three sons and two daughters; and
4. Lady Henrietta Somerset, who was born before 1754, died on July 24 1770 and was married to Sir Watkin Williams-Wynn, 4th Baronet as his first wife on April 6 1769, with whom she had no issue.