"When the fire got through the roof, that was pretty much the end of it," McBee said.
J.W. Stevens, pastor of the church, said there have never been any problems with crime at the church about five miles south of Berkeley Springs.
"I just can't fathom anyone wanting to do this to any church. But we're not staggered. We're just trying to take it in stride and continue to serve the Lord," said Stevens, who has a congregation of about 30 people.
Officials declined to comment why they think it was arson. No one had been in the church since the regular service on Sunday, McBee said.
Investigators have interviewed several people, said Sgt. Deke Walker of the West Virginia State Police, one of four agencies investigating the blaze.
Besides state police, other investigating agenices include the state Fire Marshal's office, the federal Bureau of Alcohol, Tobacco and Firearms and the Morgan County Sheriff's Department, McBee said.
The ATF automatically responds to church fires since a rash of fires struck predominantly black churches in the South over the last two years, according to Walker.
The Holiness Church of Jesus Christ is a predominantly white church.
About 35 firefighters from the Berkeley Springs Volunteer Fire Department and the South Morgan Volunteer Fire Co. worked for four hours to put out the fire, officials said.
The Holiness Church of Jesus Christ leased the church for about eight years from the Bethel Cemetery Association, which maintains the cemetery that surrounds the church. Parts of the church date back to the 1800s, said McBee.
Tuesday night, about 20 members of the church's congregation met at Stevens' home for regular services. Stevens said he plans to temporarily hold services at his home about a mile south of the church.