Sherrill is a city in Oneida County, New York, United States. With a population of 3,077, it is the state's least populous city. Sherrill is at t…Sherrill is a city in Oneida County, New York, United States. With a population of 3,077, it is the state's least populous city. Sherrill is at the western end of the Town of Vernon on Route 5. Sherrill is referred to as The Silver City.