The hymn “By Simple Faith” was written by Edgar P. Stites. The hymn first appared in an 1881 hymnal. Prehaps it was inspired by Ephesians 2:8-9, “By grace are ye saved through faith; and that…