Ruth Imogen Stout was the fifth child of Quaker parents John Wallace Stout and Lucetta Elizabeth Todhunter Stout. Her younger brother Rex Stout, an author, was famous for the Nero Wolfe detective stories.
Stout moved to New York when she was 18 and was employed at various times as a nurse, bookkeeper, secretary, business manager, and factory worker. She coordinated lectures and debates and she also owned a small tea shop in Greenwich Village. She worked for a fake mind-reading act.
In 1923, she accompanied fellow Quakers to Russia to assist in famine relief. She met and married Alfred Rossiter in June 1929. In March 1930, the couple moved to Poverty Hollow at Redding Ridge, on the outskirts of Redding, Connecticut.
Ruth continued to use her maiden name as her pen name and Rossiter as her official name. Fred, a Columbia-trained psychologist, followed his passion for wood turning and subsequently became known for his wooden bowls. Ruth decided to try her luck at gardening, and in the spring of 1930, she planted her first garden