In 1843, the Free Baptist Church became the first church of any kind to be organized in Aroostook County. In 1880, this lot was purchased from John Allen for $400 for the purpose of constructing a church building for the Free Baptists. The building was erected that year by Frank and Aubrey Smith with the exception of the steeple, bell, and clock.
In the spring of 1881, funding was raised for the steeple and bell. The bell weighed 1000 pounds and cost $280, the equivalent of $6,245 today. The bell rang on the hour and chimed the time of day. The clock was purchased for the church by John Allen.

The steeple, bell and clock were installed in October of 1882.
In 1890, First Baptist Church constructed a meeting place on the corner of Second and Church Streets. In 1915, Free Baptist and First Baptist combined and became the United Baptist Church of Presque Isle.
In the early 1950s, a faction of Baptists separated from the United Baptist Church, purchased the old First Baptist Church on the corner of Church and Second Streets, and became Bethany Baptist Church. Since the church was no longer “united”, a vote was held in 1970 to change the name of this church to State Street Baptist.
The steeple was removed in October of 2004 due to dry rot and lightning damage. This building is the second oldest standing public building and church in Presque Isle.