Steve, we are in central Texas, and one of the few apples we can grow are Fuji, because they can withstand our heat. We pick in late August (a whopping crop of about 8 apples, but the two trees are really young).
I have the awful feeling that a Fuji isn't adapted to northern Maine. Your growing season is shorter, and your first frost is earlier. When we bought our two trees from a fruit tree nursery, the tag said "zones 5-9" and requires a pollinator such as crab apple (a universal pollinator), or Braeburn or Cortland.
If you haven't planted it, take it back to Tractor Supply and get an apple tree that is more adapted to your area. Here is a link to the U. of Maine that has suggested varieties:
http://umaine.edu/fruit/growing-fruit-trees-in-maine/selecting-varieties/