Genius Makers
Cade Metz
The inside story of the mavericks who brought AI from the fringes of academia to the forefront of modern technology, reshaping our world.
Progress 50%
Reading Lists
What I'm reading now, books I've finished, papers I've explored, and patents I've authored.
"I would rather read the best 100 books over and over again until I absorb them rather than read all the books"
Currently Reading
The 5 Types of Wealth
Sahil Bloom
A guide to creating a life of meaning, fulfillment, and impact by building wealth across five dimensions: time, social, mental, physical, and financial.
Progress 35%
Books I've Read
White Papers I've Read
Machine Learning
Attention Is All You Need
Vaswani et al.
The landmark paper introducing the Transformer architecture that revolutionized NLP and became the foundation for modern LLMs.
Key Takeaways
- • Self-attention mechanisms can replace recurrence entirely
- • Multi-head attention allows the model to attend to different representation subspaces
- • Positional encodings are essential for sequence understanding without recurrence
Patents I'm Part Of
published US 2021/0173867 A1
Method and System for Interactive Search Indexing
Inventors: Madhusudhan Kakurala
Filed: Dec 3, 2020 · Published: Jun 10, 2021
A method and system for interactive search indexing that enables efficient indexing and retrieval of data in distributed computing environments. The system provides real-time search capabilities with optimized index structures for improved query performance.