You have not pruned the bush severely enough. You must cut your lavender plant back by 2 thirds each year after the flowers are past their best. Use hedge shears or a whipper-snipper for large areas of lavender plants.