Woody Allen wanted nothing to do with the hugely important wardrobe for Blue Jasmine