This is a bit related to #12 and #36, except that it's the other way around.

I have a repo (https://github.com/gregsdennis/json-everything), and the labeler always fails on PRs submitted by others (example).

I expect that since the PR is in the primary repo, not the fork, it's should be getting my token (which works on all of my PRs) and running the action with that.