Subjectively for some people buts ‘lots’ as a percentage is not very many. Fairphone are looking for customers that are concerned primarily about Fairtrade, user friendly modularity secondly.
I doubt a small phone is popular enough and that Fairphone have the financial backing to make more than one model. With the degree of modularity they are investing in would be technically far more difficult than the options that companies as affluent Samsung can afford.
If the modularity was forsaken then a smaller phone would be possible but I doubt Fairphone would want to backtrack on that aspect.
But yes smaller would suit me