NaN in SAC training

[mnsmuts]

After 92k steps an agent training to copy a demonstration starts to report:
WARNING:mlagents_envs:An agent had a NaN observation in the environment
and show this in tensorboard:

Environment has 1 agent with 47 observations and 1 stacked vector, space type is continuous and action space is 4.

mlagents v13, windows 10, config file designed to imitate only:

I have not seen this before, could it be something to do with the upgrade to v13?

[chriselion]

@mnsmuts
If there is a NaN in your observations, you should definitely try to find out where it's coming from and fix it. I just added some better NaN checks on the C# side (#3221), so if you apply those changes, you should get the callstack for where the observations are being added.

[mnsmuts]

Great thanks

[github-actions]

This thread has been automatically locked since there has not been any recent activity after it was closed. Please open a new issue for related bugs.