Listed in 1850 as a laborer (37, PA) with his wife Elizabeth (45, ENG) and children Sam'l (13), Ann Jane (9), George B. (6) and Alfred H. (3) all born in Philadelphia Co.
In 1860 their surname appears to be listed as Lewbeugh or Lewbraugh, but is most certainly the Scarbraughs. James (49, PA) is listed as a farmer with Elizabeth (55, ENG) and their children, Samuel (22, PA), Anna (18, PA), George (16, PA) and Alfred (13, PA). Living with them are James (11, PA) and Wm R. Kershaw (7, PA).
In 1870 they apparently moved back to Philadelphia, where he is listed as a laborer (58, PA) with just Elizabeth (60, ENG) and William Kershaw (18, PA) who was working in a cotton mill. They must have subsequently returned to Knox Co, OH, before his death.