it takes a while for milk to go away completely... and the longer you nurse for the longer it seems to take for many women.
A good suggestion for you to help decrease the milk quicker, Put FRESH cabbage leaves in your bra and wear them until they get wilty, then replace them with others. One leaf on each breast cupping the breast. there is a chemical reaction between the cabbage and the milk that dries it up faster.
Different women have different reactions to breast size when weaned... alot has to do with the hormones from pregnancy not breastfeeding alone. Even if you don't nurse, your breasts will often sag or shrink more... It is possible that they could get smaller but its not something I would be able to determine , that one of those wait and see things...
Good luck !