Go back to Aerie, and start farming the feathers from there. (click the item, then the mats)

P.S. Have you beaten Malme Ultimate? Does he, and all the next bosses only drop Sirius equipment?