Files
rk-llama.cpp/ggml/src
hipudding 9961d244f2 CANN: Resolve soft_max precision issue (#15730)
Previously, the slope tensor was set to fp16 to improve efficiency.
While this worked correctly in FA, it caused precision issues in soft_max.
This change applies different data types for different operators
to balance both accuracy and performance.
2025-09-02 17:12:37 +08:00
..
2025-08-05 22:10:36 +03:00
2025-08-05 22:10:36 +03:00
2025-08-05 22:10:36 +03:00
2025-08-05 22:10:36 +03:00
2025-08-22 15:33:15 +02:00