Maybe not for speed, but do you think this approach could be well suited for environments where you have complex tasks that require knowledge on my different multidisciplinary fronts?
Aka Complex system building task creates many different fast models with different initializations in different directions and then aggregates?
I’m not sure how this would be applicable in those other scenarios you’ve mentioned; anything is possible. There may be other uses for this novel decoding method. But being touted as being X percent faster than transformers in a useful way isn’t one of them.
Maybe not for speed, but do you think this approach could be well suited for environments where you have complex tasks that require knowledge on my different multidisciplinary fronts?
Aka Complex system building task creates many different fast models with different initializations in different directions and then aggregates?
I’m not sure how this would be applicable in those other scenarios you’ve mentioned; anything is possible. There may be other uses for this novel decoding method. But being touted as being X percent faster than transformers in a useful way isn’t one of them.