ptp issue

[AlexeySaff]

Hi guys, from time to time having an issue when time jumps a lot when using ptp4l and EXA. In ptp4l logs I see

Feb 06 09:33:42 hostname ptp4l[1052]: [740205.195] rms 10 max 24 freq -217 +/- 0 delay 223 +/- 2
Feb 06 09:34:46 hostname ptp4l[1052]: [740269.239] rms 13 max 33 freq -218 +/- 0 delay 223 +/- 2
Feb 06 09:35:50 hostname ptp4l[1052]: [740333.284] rms 13 max 35 freq -217 +/- 1 delay 224 +/- 3
Feb 06 09:36:54 hostname ptp4l[1052]: [740397.331] rms 14 max 38 freq -218 +/- 0 delay 226 +/- 3
Feb 06 09:36:58 hostname ptp4l[1052]: [740401.332] clockcheck: clock jumped forward or running faster than expected!
Feb 06 09:36:58 hostname ptp4l[1052]: [740401.332] port 1 (ex-c0-p1): SLAVE to UNCALIBRATED on SYNCHRONIZATION_FAULT
Feb 06 09:37:01 hostname ptp4l[1052]: [740404.595] port 1 (ex-c0-p1): UNCALIBRATED to SLAVE on MASTER_CLOCK_SELECTED
Feb 06 09:37:04 hostname ptp4l[1052]: [740406.783] clockcheck: clock jumped backward or running slower than expected!
Feb 06 09:37:04 hostname ptp4l[1052]: [740406.784] port 1 (ex-c0-p1): SLAVE to UNCALIBRATED on SYNCHRONIZATION_FAULT
Feb 06 09:37:06 hostname ptp4l[1052]: [740409.485] port 1 (ex-c0-p1): UNCALIBRATED to SLAVE on MASTER_CLOCK_SELECTED
Feb 06 09:37:58 hostname ptp4l[1052]: [740461.376] rms 4801810734 max 17179869180 freq -229 +/- 772040 delay 224 +/- 2
Feb 06 09:39:02 hostname ptp4l[1052]: [740525.423] rms 9 max 25 freq -218 +/- 1 delay 225 +/- 2
Feb 06 09:40:06 hostname ptp4l[1052]: [740589.466] rms 12 max 32 freq -218 +/- 1 delay 222 +/- 2
Feb 06 09:41:10 hostname ptp4l[1052]: [740653.534] rms 11 max 28 freq -219 +/- 0 delay 223 +/- 2
Feb 06 09:42:14 hostname ptp4l[1052]: [740717.579] rms 13 max 35 freq -219 +/- 0 delay 226 +/- 2
Feb 06 09:43:19 hostname ptp4l[1052]: [740781.626] rms 9 max 23 freq -219 +/- 0 delay 222 +/- 1

But in /var/log/messages is::

Feb 6 09:36:54 hostname ptp4l[1052]: [740397.331] rms 14 max 38 freq -218 +/- 0 delay 226 +/- 3
Feb 6 09:36:58 hostname kernel: exanic 0000:01:00.0: Rollover timer fired at an unexpected time: counter 0xc10c172 hwtime 0xffffffff
Feb 6 09:36:58 hostname kernel: exanic 0000:01:00.0: Rollover timer fired at an unexpected time: counter 0xc10c173 hwtime 0x809a49cf
Feb 6 09:36:58 hostname ptp4l[1052]: [740401.332] clockcheck: clock jumped forward or running faster than expected!
Feb 6 09:36:58 hostname ptp4l[1052]: [740401.332] port 1 (ex-c0-p1): SLAVE to UNCALIBRATED on SYNCHRONIZATION_FAULT
Feb 6 09:36:59 hostname phc2sys[1055]: [740401.720] port 5488de.fffe.d9fabc-1 changed state
Feb 6 09:36:59 hostname phc2sys[1055]: [740401.720] reconfiguring after port state change
Feb 6 09:36:59 hostname phc2sys[1055]: [740401.720] source clock not ready, waiting...
Feb 6 09:37:01 hostname systemd[1]: Started Session 33230 of User qbops.
Feb 6 09:37:01 hostname systemd[1]: Started Session 33231 of User qbops.
Feb 6 09:37:01 hostname ptp4l[1052]: [740404.595] port 1 (ex-c0-p1): UNCALIBRATED to SLAVE on MASTER_CLOCK_SELECTED
Feb 6 09:37:01 hostname systemd[1]: Started Session 33232 of User qbops.
Feb 6 09:37:02 hostname systemd[1]: session-33232.scope: Deactivated successfully.
Feb 6 09:37:02 hostname phc2sys[1055]: [740404.721] port 5488de.fffe.d9fabc-1 changed state
Feb 6 09:37:02 hostname phc2sys[1055]: [740404.721] reconfiguring after port state change
Feb 6 09:37:02 hostname phc2sys[1055]: [740404.721] selecting ex-c0-p1 as domain source clock
Feb 6 09:37:02 hostname phc2sys[1055]: [740404.721] selecting CLOCK_REALTIME for synchronization
Feb 6 09:37:02 hostname systemd[1]: session-33230.scope: Deactivated successfully.
Feb 6 09:37:04 hostname ptp4l[1052]: [740406.783] clockcheck: clock jumped backward or running slower than expected!
Feb 6 09:37:04 hostname ptp4l[1052]: [740406.784] port 1 (ex-c0-p1): SLAVE to UNCALIBRATED on SYNCHRONIZATION_FAULT
Feb 6 09:37:05 hostname phc2sys[1055]: [740407.721] port 5488de.fffe.d9fabc-1 changed state
Feb 6 09:37:05 hostname phc2sys[1055]: [740407.721] reconfiguring after port state change
Feb 6 09:37:05 hostname phc2sys[1055]: [740407.721] source clock not ready, waiting...
Feb 6 09:37:06 hostname ptp4l[1052]: [740409.485] port 1 (ex-c0-p1): UNCALIBRATED to SLAVE on MASTER_CLOCK_SELECTED
Feb 6 09:37:07 hostname phc2sys[1055]: [740409.721] port 5488de.fffe.d9fabc-1 changed state
Feb 6 09:37:07 hostname phc2sys[1055]: [740409.721] reconfiguring after port state change
Feb 6 09:37:07 hostname phc2sys[1055]: [740409.722] selecting ex-c0-p1 as domain source clock
Feb 6 09:37:07 hostname phc2sys[1055]: [740409.722] selecting CLOCK_REALTIME for synchronization

In that case I can't understand what is the reason for that, but seems like a problem on EXA card is causing ptp4l to move clock? anyone had the same problems before?

[AlexeySaff]

Now I'm wondering is exanix X25 timer is 64 bit or 32? It seems that EXANIC_CAP_HW_TIME_HI capability is only available for HPT card, but
/* This timer should fire each half rollover period of the ExaNIC clock

• on cards which do not have a 64 bit clock
• Lock is not needed because we stop the timer during critical sections */
  static enum hrtimer_restart exanic_ptp_soft_hrtimer_callback(

so it should be 64 bit or 32?