I have seen non-M4 uppers with M4 barrels and vice versa have issues like your reporting.