Ernest Eugene Barnes Jr. was born July 15, 1938, in a poor section ("the bottom") of Durham, North Carolina. His father, Ernest Barnes Sr., worked as a shipping clerk at Liggett Myers Tobacco Company and his mother, Fannie Mae Geer, was employed as a domestic for Frank Fuller Jr., a wealthy Southern attorney who would guide Barnes into the world of art.