Overbridge creating latency for all other devices

While my Digitone plugin is recording with virtually no latency, whenever the plugin is running it introduces roughly 45 ms of delay for all other synced devices (I’m in Ableton). Does anyone else experience this or have an explanation.

Thank you!