Thanks everyone, I got out today and spent some time swapping parts between 2 rifles to pinpoint the issue.
The problem follows the bolt carrier but not the bolt so it must be the gas key. I tested it as suggested and can see no sign of a leak but must have an issue none the less.
So now for the next step, I look for a smithy to fix it. How much should I expect to pay to have the key removed and restaked?