r/deeplearning
Posted by u/Ok_Pudding50
Understanding the Scaled Dot-Product mathematically and visually...
Research 70 points
5 comments
2 weeks ago
Understanding the Scaled Dot-Product Attention in LLMs and preventing the ”Vanishing Gradient” problem....
External link:
https://i.redd.it/4jtje9y0u1ng1.pngMore from r/deeplearning
r/deeplearning · u/ssrjg
Recent
I ported Karpathy's microgpt to Julia in 99 lines - no dependencies, manual backprop, ~1600× faster than CPython and ~4x faster than Rust.
Karpathy dropped \microgpt\ a few weeks ago and a 200-line pure Python GPT built on scalar autograd. Beautiful project....
Research
222 13 2 weeks ago
r/deeplearning · u/Tough_Ad_6598
I made a Python library processing geospatial data for GNNs with PyTorch Geometric
I'd like to introduce City2Graph, a Python library that converts geospatial data into tensors for GNNs in PyTorch...
Research
145 15 1 month ago
r/deeplearning · u/Ok-Statement-32...
mnist cnn from scratch in js
Source: Demo:
Research
112 2 2 months ago