Cornflowers, lily-of-the-valley, jam and other elements of collections you need to complete the quest will be scored only in case you collect all of them, but don`t exchange. In case you exchange the items before, the quest won`t be finished and you need to collect the items once again. Please, check also the quest requirements - if you need to collect or find the element, the elements found before are not scored in the quest.