The Incorporated Village of Port Jefferson is located in the town of Brookhaven in Suffolk County, New York on the North Shore of Long Island. As of the United States 2000 census, the village population was 7,837. The small town is home to several unique restaurants and shops, and has a growing tourism industry.