Panda: Communication constraints violation (always with real robot)

This issue appears when we do not fulfill the 1 ms deadline for a couple of samples in a row. Is our controller too slow? The issue should be related with the controller's implementation since I checked the roundtrip with the robot and is normal (max 0.3 ms) and also the example controllers from franka_ros work without this issue.