James Brown (11 September 1766 – 7 April 1835) was a United States Senator from Louisiana for the years 1813-1817 and 1819-1823.

He was the brother of John Brown of Virginia and Kentucky (1757-1837), cousin of John Breckinridge, James Breckinridge, and Francis Preston, uncle of James Brown Clay, a Senator from Louisiana.

Born near Staunton, Virginia, Brown attended Washington College (later Washington and Lee University) in Lexington, Virginia, and ]]William and Mary College]], [[Williamsburg, Virginia. He studied law, was admitted to the bar and commenced practice in Frankfort, Kentucky. Brown commanded a company of sharpshooters in an expedition against the Indians in 1789.

He served as secretary to the Governor in 1792. Soon after the cession of the Territory of Louisiana, Brown moved to New Orleans and was appointed as secretary of the Territory in 1804. Brown subsequently became United States district attorney for the Territory.

Brown was elected as a Democratic Republican to the United States Senate on December 1, 1812, to fill the vacancy caused by the resignation of John N. Destrehan , and served from February 5, 1813, to March 3, 1817. He was an unsuccessful candidate for reelection, but again elected to the United States Senate in 1819, as an Adams-Clay Republican. He served from March 4, 1819, until December 10, 1823, when he resigned. During his tenure, Brown was the chairman, Committee on Foreign Relations (Sixteenth Congress).

Brown was appointed United States Minister to France 1823-1829.

Brown returned to the United States and settled in Philadelphia, Pennsylvania, where he died.