fix time manager tests in the CI

Attempt to have less errors in the CI for the time manager module.

If it still fails, I can complicate the code to add some synchronization in the test program.