Hacker News new | past | comments | ask | show | jobs | submit login

That is only true if the using the new softmax changes the dynamic range of the values. We are using floating point not fixed point. So if before our values went from 1 to 5000 and now they go from 0.0002 to 1 we still have the same dynamic range and so still need the same resolution.



The quantized versions are not floats but ints.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: