mirror of
https://github.com/zebrajr/ollama.git
synced 2025-12-06 00:19:51 +01:00
1c093e97af
We currently short circuit generation of the cache mask and just generate an empty tensor of the correct size. However, in some cases, this can also skip a cast operation. This can result in the worst case graph being not fully worst case. We don't actually need the fast path for mask generation, so it's better to just use the normal code path. |
||
|---|---|---|
| .. | ||
| cache.go | ||
| causal_test.go | ||
| causal.go | ||
| encoder.go | ||
| wrapper.go | ||