When you're editing a page in the site editor, a contextual 'Edit template' suggestion appears when you open the command palette. Clicking this enables you to edit the template associated with the current page.

This 'Edit template' command also appears outside of the fullscreen editor if you search, and clicking it will do nothing:

It probably makes sense to only surface this command in edit view, when you're editing a page.

cc @noisysocks