In a bowl, toss the potatoes with oil, garlic, bay leaves, oregano, salt and pepper. Squeeze lemon juice onto the potatoes, then place the rind halves on top. (Can pre-cook potatoes in microwave for about 5 minutes) (May need to add more olive oil)
Preheat grill. Place potatoes in a small roasting pan or double thickness tin foil pans that have been sprayed with Pam, add the potatoes. Place on grill. Cook until tender, 20 - 30 minutes, stirring so all pieces cook evenly.
Remove from heat. Remove lemon rind and bay leaves. Add butter and dill and incorporate evenly. Salt and pepper to taste.
Note: Instead of fresh herbs, you can use 1 tsp dried.