Scheduling speed
The following is intended for informational purposes only, and may not be incorporated into any contract. No purchasing decisions should be made based on the following materials. Unity is not committing to deliver any functionality, features or code. The development, timing and release of all products, functionality and features are at the sole discretion of Unity, and are subject to change.
If you have accepted to use functional cookies and logged in using your Unity ID at the top right of the page, then sharing feedback is as simple as clicking a card below, selecting a topic’s importance, adding your point of view, and submitting. If you prefer not to accept functional cookies or log in, you will be prompted to enter an email address and validate it, so we know how to reach out when the topic evolves. For more information read the Feedback and privacy terms.
What? The scheduling time (i.e., the time it takes for a model to begin inference), was previously too complex and lengthy, which affected the inference time. With this improvement, we removed the memory leaks and garbage collected, and overall delivered a ~2x improvement in scheduling time.
Why?
Some users reported delays in starting model inferences, which can be noticeable as a delay to the end user. Any time saved in the inference workflow is time back into the game and results in a smoother user experience.