In a medium bowl, add the can of sweetened condensed milk (If you are using the same can to measure out the milk as I did, DO NOT throw the can away, make sure to keep it).
Fill the empty can with whole milk twice ( Or use 2 1/3 cups ) and add to a small pot. (You should have 2 can-fulls of whole milk in the pot.) Add the dried lavender to the milk and simmer on low heat for 3 to 5 minutes. Continue to stir the milk so it does not stick to the bottom of the pot. Then remove from heat and allow to cool.
While the milk is cooling, prepare the custard by adding the eggs and vanilla to a medium bowl and using a hand mixer (or a blender), whisk until well combined. Add the sweetened condensed milk, dash of salt and the cooled milk and combine well.
Using a fine strainer, slowly pour the custard mixture over the caramel in the loaf pan to remove the lavender and discard whatever is left in the strainer.
Place the crème caramel pan in the middle of a large baking dish. Carefully add boiling water to the baking dish to cover the sides of the pan halfway.
Bake for 45 minutes by placing the pan in the middle rack of the oven, You can tell when it is ready when the sides are lightly golden in color and by touching the center with your finger, it should be dry to the touch with a jiggly consistency.
Carefully remove the baking dish from the oven, then remove the crème caramel pan from the water bath, and cool at room temperature. Refrigerate for a minimum of 3 hours or overnight.
At the time of serving, carefully run a thin sharp knife around the edges of the pan. Invert the serving plate on top of the pan and flip it over the plate. Serve cold.