Preheat the oven to 180°C (350°F). Line a 12-cup muffin tin with paper liners.
In a bowl, whisk together all-purpose flour, almond flour, baking powder, baking soda, salt, and cardamom. Set aside.
Warm milk with saffron and butter in a small saucepan over medium heat until the butter melts and the milk just begins to bubble at the edges. Remove from heat immediately.
In a large bowl, whisk yogurt and sugar until smooth. Add vanilla.
Alternate adding the dry mix and the warm milk mixture to the yogurt, beginning and ending with dry ingredients. Fold gently until just combined. Do not overmix.
Divide batter evenly among liners, filling each about two-thirds full.
Bake 18–20 minutes, until a toothpick inserted in the center comes out clean.
Cool in the pan 5 minutes, then transfer to a wire rack to cool completely. Chill before soaking if working ahead.