Ain holchin b'mamon achar haRov

The gemara in Bava Metziya (22b) asks if we hold that "yeiush shelo m'da'as lo havei yeiush", that a lost item is not considered abandoned until the owner is aware of its loss and gives up hope of finding it, how is it permissible to eat dates that have blown off the orchard trees without the owner's awareness - even if one assumes that all fruit that falls off trees is implicitly abandoned because the owners know it will be eaten by insects before being recovered by them, perhaps the owner is a minor who is incapable of relinquishing ownership? The gemara answers that we are not "machzik" an orchard as having trees owned by minors unless we know otherwise; Rashi explains that this is based on "rov", because the majority of trees are not owned by minors. I was wondering how the gemara can use the principle of rov to resolve this issue - since this is a monetary case, the rule is "ain holchin b'mamon achar harov", one cannot rely on the principle of majority to resolve questions of monetary ownership? More to come on this....