First, make the syrups. In a small saucepan, combine all of the ingredients for the earl grey syrup and cook over medium low heat until the sugar has dissolved. Increase temp to medium heat and stir occasionally until syrup begins to boil. Immediately turn off heat and let the tea steep for about 8 minutes, then pour syrup through a sieve into a bowl, rinse out the pan, and pour the tea-less syrup back into the pan and cook on medium heat for 8-10 more minutes or until liquid is a bit more syrupy. Remove from heat and pour into a heat-proof bowl to cool. Repeat all of this for the lavender syrup: combine all ingredients in the same small sauce pan, bring to a boil, turn off heat, let lavender steep for about 10-12 minutes, then pour liquid through a sieve into a bowl, then pour back into the pan without the lavender and continue to cook until syrupy and thicker, then remove and let cool.
Then, make the cupcakes. Preheat the oven to 350° Fahrenheit and line two cupcake trays with paper liners then set aside. Heat the milk in a mug in the microwave for one minute, then steep one earl grey teabag in it for 5 minutes. While the tea is steeping, in a large bowl, beat together the eggs, oil and sugar until lighter and creamy. Add in the ground earl grey, earl grey syrup, vanilla, and ground lavender (or lavender syrup). Once the milk-tea is steeped, pour in and beat together until combined. Add in the flour, almond flour, baking powder, and salt and beat until combined. Pour batter into the lined cupcake pans (each should be about 2/3 -3/4 full). Bake for 17-18 minutes (longer and the cupcakes will be dry) - until a toothpick inserted in the center of the cupcake comes out clean. Let cupcakes cool completely before frosting.
While the cupcakes are cooling, make the buttercream frosting! In a large bowl, using an electric mixer, beat together the butter and 1 cup of the powdered sugar until smooth and creamy. Add in 1 cup of the powdered sugar at a time until completely combined. Then add in the earl grey and lavender syrup, vanilla, ground earl grey, and purple coloring (optional), and beat together until smooth. Taste frosting and adjust any of the flavors as needed (lavender goes a long way so I recommend not adding more!). Scoop frosting into a piping bag and pipe onto cupcakes, then serve!