This was once an armory for the New York State National Guard. It was bought by the Town of Smithtown for $1, with the condition it only be used for municipal purposes. There is controversy in the community as to what should be done with this site. Meanwhile, it sits unused. The library district has an interest in the site, but it seems they want to knock the building down to construct a new building.

In 2003 the YMCA expressed interest in using the site for expansion. Today the building and grounds sits abandoned.

Abstract from NY TIMES June 20, 2004
Smithtown Town Board, after a dozen years of indecision, votes 3 to 2 to solicit bids to tear down old Nesconset Armory; Assemblyman Michael Fitzpatrick and State Sen John Flanagan want the armory, which was sold by New York State National Guard with stipulation that it would be used for park and recreational purposes, to be converted into recreation center; board wants to give site to Smithtown Library for new facility.