Season likely plays a factor too. There are many plants that more or less look identical (to the untrained eye) until they either bloom or grow large enough.

true. it is also pretty bad at IDing things that are half-formed, eg a bud that hasn't bloomed yet, presumably because most photos in the dataset are of the blooming version.