In a small saucepan, combine the lemon zest and oil. Set over medium-low heat and cook until the lemon zest bubbles steadily for about 30 seconds. Remove from the heat and let cool briefly, about 3 minutes. Stir in the herbs and let sit at least 20 minutes before using.
Position a rack in the center of the oven and heat the oven to 475°F Line a heavy-duty rimmed baking sheet with parchment. In a medium bowl, toss the potatoes with the infused olive oil, the salt, and a few grinds of pepper.
Turn the potatoes out onto the baking sheet and arrange the pieces so that they are evenly spaced and lying on a cut side. If the pieces cover the baking sheet sparsely, arrange them toward the edges of the baking sheet for the best browning. Pick out and discard the pieces of lemon zest. Roast the potatoes until browned on bottom, 10 to 15 minutes. Flip and continue to roast until tender, 5 minutes.
Return the potatoes to the bowl in which you tossed them with the oil, or put them in a clean serving bowl. If they seem a bit dry, drizzle them with a little more olive oil. Season to taste with salt and pepper.