<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0"><channel><title><![CDATA[Aryan]]></title><description><![CDATA[Building AI & ML solutions with impact — explore my projects, blogs, and ideas shaping the future of technology.]]></description><link>https://www.aryanupadhyay.com/blog</link><generator>RSS for Node</generator><lastBuildDate>Thu, 13 Aug 2026 06:47:43 GMT</lastBuildDate><atom:link href="https://www.aryanupadhyay.tech/blog-feed.xml" rel="self" type="application/rss+xml"/><item><title><![CDATA[Transformer Inference Explained: A Step-by-Step Guide to Autoregressive Decoding]]></title><description><![CDATA[A detailed, step-by-step explanation of how Transformer inference works, covering encoder outputs, autoregressive decoding, masked self-attention, cross-attention, and token-by-token generation with clear mathematical intuition.]]></description><link>https://www.aryanupadhyay.tech/post/transformer-inference-step-by-step</link><guid isPermaLink="false">697da4e12b413b3ab9da59fd</guid><category><![CDATA[Transformer]]></category><pubDate>Thu, 19 Mar 2026 05:37:42 GMT</pubDate><enclosure url="https://static.wixstatic.com/media/468fc1_1de7b22e9f0a4887832c407c74b55ec3~mv2.jpg/v1/fit/w_1000,h_559,al_c,q_80/file.png" length="0" type="image/png"/><dc:creator>Aryan</dc:creator></item><item><title><![CDATA[The Transformer Decoder Explained: Architecture, Math &#38; Operations]]></title><description><![CDATA[A complete, step-by-step explanation of the Transformer decoder architecture, covering masked self-attention, cross-attention, feed-forward networks, and the final softmax output using an English-to-Hindi translation example.]]></description><link>https://www.aryanupadhyay.tech/post/transformer-decoder-architecture-deep-dive</link><guid isPermaLink="false">697b7250facc7df23b58e341</guid><category><![CDATA[Transformer]]></category><pubDate>Sun, 15 Mar 2026 06:03:11 GMT</pubDate><enclosure url="https://static.wixstatic.com/media/468fc1_41606c387e684d5c96a6eb26a28270db~mv2.jpg/v1/fit/w_1000,h_559,al_c,q_80/file.png" length="0" type="image/png"/><dc:creator>Aryan</dc:creator></item><item><title><![CDATA[Cross Attention in Transformers Explained: Self vs Cross Attention Step by Step]]></title><description><![CDATA[Cross attention is a key mechanism in transformer encoder–decoder models that allows the decoder to focus on relevant parts of the input sequence. This guide explains cross attention step by step, compares it with self-attention, and shows how output representations are formed using input context.]]></description><link>https://www.aryanupadhyay.tech/post/cross-attention-in-transformers-explained</link><guid isPermaLink="false">697b69b5c1bd63f263ff710a</guid><category><![CDATA[Transformer]]></category><pubDate>Thu, 12 Mar 2026 01:52:18 GMT</pubDate><enclosure url="https://static.wixstatic.com/media/468fc1_170439afdef8469ab80feedca3c5c2fe~mv2.jpg/v1/fit/w_1000,h_559,al_c,q_80/file.png" length="0" type="image/png"/><dc:creator>Aryan</dc:creator></item><item><title><![CDATA[Masked Self Attention Explained: Why Transformers Are Autoregressive Only at Inference]]></title><description><![CDATA[Transformer decoders behave autoregressively during inference but allow parallel computation during training. This post explains why naive parallel self-attention causes data leakage and how masked self-attention solves this problem while preserving autoregressive behavior.]]></description><link>https://www.aryanupadhyay.tech/post/masked-self-attention-transformer-autoregressive</link><guid isPermaLink="false">697ac96930ffdbbf2ba1528e</guid><category><![CDATA[Transformer]]></category><pubDate>Tue, 10 Mar 2026 02:55:08 GMT</pubDate><enclosure url="https://static.wixstatic.com/media/468fc1_83698fdd85f84b389202acbf13f64afb~mv2.jpg/v1/fit/w_1000,h_559,al_c,q_80/file.png" length="0" type="image/png"/><dc:creator>Aryan</dc:creator></item><item><title><![CDATA[Transformer Encoder Architecture Explained Step by Step (With Intuition)]]></title><description><![CDATA[A clear, step-by-step explanation of the Transformer encoder architecture, covering tokenization, positional encoding, self-attention, feed-forward networks, residual connections, and why multiple encoder blocks are used.]]></description><link>https://www.aryanupadhyay.tech/post/transformer-encoder-architecture-explained</link><guid isPermaLink="false">6978a2744d2d07064e19e760</guid><category><![CDATA[Transformer]]></category><pubDate>Sun, 08 Mar 2026 01:38:58 GMT</pubDate><enclosure url="https://static.wixstatic.com/media/468fc1_effe96872bb14fba902cfabbdc967a48~mv2.jpg/v1/fit/w_1000,h_559,al_c,q_80/file.png" length="0" type="image/png"/><dc:creator>Aryan</dc:creator></item><item><title><![CDATA[Layer Normalization Explained: Why Transformers Prefer It Over Batch Norm]]></title><description><![CDATA[Layer Normalisation is a core component of modern Transformer architectures. This article explains normalization fundamentals, internal covariate shift, why batch normalization fails in self-attention, and how layer normalization works mathematically inside Transformers—step by step with clear examples.]]></description><link>https://www.aryanupadhyay.tech/post/layer-normalisation-in-transformers</link><guid isPermaLink="false">69777336d87a588901624782</guid><category><![CDATA[Deep Learning]]></category><pubDate>Fri, 06 Mar 2026 03:06:53 GMT</pubDate><enclosure url="https://static.wixstatic.com/media/468fc1_3e0868dd97174b0db8f8c91e455000eb~mv2.jpg/v1/fit/w_1000,h_559,al_c,q_80/file.png" length="0" type="image/png"/><dc:creator>Aryan</dc:creator></item><item><title><![CDATA[Positional Encoding in Transformers Explained from First Principles]]></title><description><![CDATA[Self-attention models lack an inherent sense of word order. This article explains positional encoding in Transformers from first principles, showing how sine–cosine functions encode absolute and relative positions efficiently and enable sequence understanding.]]></description><link>https://www.aryanupadhyay.tech/post/positional-encoding-in-transformers-explained-from-first-principles</link><guid isPermaLink="false">697632829c4baa18ad9781f0</guid><category><![CDATA[Deep Learning]]></category><pubDate>Wed, 04 Mar 2026 04:42:50 GMT</pubDate><enclosure url="https://static.wixstatic.com/media/468fc1_2f8f848091fe47548100b7831ccec297~mv2.jpg/v1/fit/w_1000,h_1000,al_c,q_80/file.png" length="0" type="image/png"/><dc:creator>Aryan</dc:creator></item><item><title><![CDATA[Multi-Head Attention in Transformers Explained: Concepts, Math &#38; Mechanics]]></title><description><![CDATA[Multi-head attention addresses a key limitation of self-attention by enabling Transformers to capture multiple semantic perspectives simultaneously. This article explains the intuition, working mechanism, dimensional flow, and original Transformer implementation of multi-head attention using clear examples and mathematical reasoning.]]></description><link>https://www.aryanupadhyay.tech/post/multi-head-attention-in-transformers-explained-concepts-math-mechanics</link><guid isPermaLink="false">6974a041e389f5384b709a45</guid><category><![CDATA[Deep Learning]]></category><pubDate>Mon, 02 Mar 2026 04:16:38 GMT</pubDate><enclosure url="https://static.wixstatic.com/media/468fc1_7688628a18674ea09b7a59624fafbec7~mv2.jpg/v1/fit/w_1000,h_1000,al_c,q_80/file.png" length="0" type="image/png"/><dc:creator>Aryan</dc:creator></item><item><title><![CDATA[Why Is Self-Attention Called “Self”? Understanding Attention Mechanisms from Encoder–Decoder to Transformers]]></title><description><![CDATA[This blog explains why self-attention qualifies as an attention mechanism and why the term “self” is used. By revisiting encoder–decoder attention, Luong attention, and alignment scores, we build a clear intuition for how self-attention works within a single sequence.]]></description><link>https://www.aryanupadhyay.tech/post/why-is-self-attention-called-self-understanding-attention-mechanisms-from-encoder-decoder-to-tran</link><guid isPermaLink="false">697394ccaa29322cefcc1385</guid><category><![CDATA[Deep Learning]]></category><pubDate>Sat, 28 Feb 2026 04:59:14 GMT</pubDate><enclosure url="https://static.wixstatic.com/media/468fc1_026eec6127bd499692f5be624d32e997~mv2.jpg/v1/fit/w_1000,h_1000,al_c,q_80/file.png" length="0" type="image/png"/><dc:creator>Aryan</dc:creator></item><item><title><![CDATA[The Evolution of Object Detection: Fast R-CNN and Faster R-CNN Explained]]></title><description><![CDATA[A complete technical breakdown of Fast R-CNN and Faster R-CNN, covering RoI Pooling, quantization effects, Region Proposal Networks, anchor boxes, IoU labeling, multi-task loss, and why replacing Selective Search with RPN transformed object detection into a fully end-to-end trainable two-stage architecture.]]></description><link>https://www.aryanupadhyay.tech/post/evolution-fast-and-faster-rcnn-object-detection</link><guid isPermaLink="false">69a154ecfa78e209eb8a8a90</guid><category><![CDATA[Computer Vision]]></category><pubDate>Fri, 27 Feb 2026 08:40:44 GMT</pubDate><enclosure url="https://static.wixstatic.com/media/468fc1_101e0ec2f863457eb369f70f3696a1dd~mv2.jpg/v1/fit/w_1000,h_559,al_c,q_80/file.png" length="0" type="image/png"/><dc:creator>Aryan</dc:creator></item><item><title><![CDATA[Visualizing Self-Attention: A Geometric Intuition &#38; The Math Behind the Magic]]></title><description><![CDATA[This post explains self-attention using geometric intuition. By visualizing embeddings, dot products, scaling, and weighted vector sums, we see how contextual embeddings shift based on surrounding words and capture meaning relative to context.]]></description><link>https://www.aryanupadhyay.tech/post/visualizing-self-attention-a-geometric-intuition-the-math-behind-the-magic</link><guid isPermaLink="false">6973912016ee2e0564598964</guid><category><![CDATA[Deep Learning]]></category><pubDate>Thu, 26 Feb 2026 08:13:17 GMT</pubDate><enclosure url="https://static.wixstatic.com/media/468fc1_f9fa02e65dbf4fc78f22582affcc27a7~mv2.jpg/v1/fit/w_1000,h_1000,al_c,q_80/file.png" length="0" type="image/png"/><dc:creator>Aryan</dc:creator></item><item><title><![CDATA[R-CNN Explained: A Comprehensive Guide to Object Detection Architecture]]></title><description><![CDATA[Unlock the mechanics of Object Detection with our deep dive into R-CNN. Moving beyond simple image classification, this guide explores how machines localize objects using Bounding Boxes, Selective Search, and Support Vector Machines. Whether you are calculating IoU or understanding the transition from sliding windows to smart proposals, this article covers the complete R-CNN architecture and evaluation metrics.]]></description><link>https://www.aryanupadhyay.tech/post/rcnn-object-detection-guide</link><guid isPermaLink="false">699d5fa29509a0da66f938fc</guid><category><![CDATA[Computer Vision]]></category><pubDate>Tue, 24 Feb 2026 08:44:35 GMT</pubDate><enclosure url="https://static.wixstatic.com/media/468fc1_08956b1f6ec549fb92332dc335acff4d~mv2.jpg/v1/fit/w_1000,h_559,al_c,q_80/file.png" length="0" type="image/png"/><dc:creator>Aryan</dc:creator></item><item><title><![CDATA[Scaled Dot-Product Attention Explained: Why We Divide by √dₖ in Transformers]]></title><description><![CDATA[Scaled dot-product attention is a core component of Transformer models, but why do we divide by √dₖ before applying softmax? This article explains the variance growth problem in high-dimensional dot products, the role of scaling in stabilizing softmax, and the mathematical intuition that makes attention training reliable and effective.]]></description><link>https://www.aryanupadhyay.tech/post/scaled-dot-product-attention-explained-why-we-divide-by-d%E2%82%96-in-transformers</link><guid isPermaLink="false">69733a0c073d167beebadf36</guid><category><![CDATA[Deep Learning]]></category><pubDate>Sat, 21 Feb 2026 11:19:46 GMT</pubDate><enclosure url="https://static.wixstatic.com/media/468fc1_cd612eb9c24d4578a2aaaf5fb095f4ae~mv2.jpg/v1/fit/w_847,h_462,al_c,q_80/file.png" length="0" type="image/png"/><dc:creator>Aryan</dc:creator></item><item><title><![CDATA[Self-Attention in Transformers Explained from First Principles (With Intuition &#38; Math)]]></title><description><![CDATA[Self-attention is the core idea behind Transformer models, yet it is often explained as a black box.
In this article, we build self-attention from first principles—starting with simple word interactions, moving through dot products and softmax, and finally introducing query, key, and value vectors with learnable parameters. The goal is to develop a clear, intuitive, and mathematically grounded understanding of how contextual embeddings are generated in Transformers.]]></description><link>https://www.aryanupadhyay.tech/post/self-attention-in-transformers-explained-from-first-principles-with-intuition-math</link><guid isPermaLink="false">69722759affc20191ac0c0d0</guid><category><![CDATA[Deep Learning]]></category><pubDate>Thu, 19 Feb 2026 12:50:51 GMT</pubDate><enclosure url="https://static.wixstatic.com/media/468fc1_12e0b8bdd4e14383afb776206d9f8cc1~mv2.jpg/v1/fit/w_1000,h_1000,al_c,q_80/file.png" length="0" type="image/png"/><dc:creator>Aryan</dc:creator></item><item><title><![CDATA[Bahdanau vs. Luong Attention: Architecture, Math, and Differences Explained]]></title><description><![CDATA[Attention mechanisms revolutionized NLP, but how do they differ? We deconstruct the architecture of Bahdanau (Additive) and Luong (Multiplicative) attention. From calculating alignment weights to updating context vectors, dive into the step-by-step math. Understand why Luong's dot product approach often outperforms Bahdanau's neural network method and how decoder states drive the prediction process.]]></description><link>https://www.aryanupadhyay.tech/post/bahdanau-vs-luong-attention-architecture-math-and-differences-explained</link><guid isPermaLink="false">696cf711322ac077fef85729</guid><category><![CDATA[Computer Vision]]></category><category><![CDATA[Deep Learning]]></category><category><![CDATA[Neural Networks]]></category><pubDate>Mon, 16 Feb 2026 04:19:28 GMT</pubDate><enclosure url="https://static.wixstatic.com/media/468fc1_857eb3716c0845a09e6633c9a51bd296~mv2.jpg/v1/fit/w_1000,h_1000,al_c,q_80/file.png" length="0" type="image/png"/><dc:creator>Aryan</dc:creator></item><item><title><![CDATA[Introduction to Transformers: The Neural Network Architecture Revolutionizing AI]]></title><description><![CDATA[Transformers are the foundation of modern AI systems like ChatGPT, BERT, and Vision Transformers. This article explains what Transformers are, how self-attention works, their historical evolution, impact on NLP and generative AI, advantages, limitations, and future directions—all explained clearly from first principles.]]></description><link>https://www.aryanupadhyay.tech/post/introduction-to-transformers-the-neural-network-architecture-revolutionizing-ai</link><guid isPermaLink="false">696ca3623e23fce293785ad6</guid><category><![CDATA[Computer Vision]]></category><category><![CDATA[Deep Learning]]></category><category><![CDATA[Neural Networks]]></category><pubDate>Sat, 14 Feb 2026 09:30:51 GMT</pubDate><enclosure url="https://static.wixstatic.com/media/468fc1_2f0c9ca4cb7c4d3793e65ba39480dab1~mv2.jpg/v1/fit/w_1000,h_1000,al_c,q_80/file.png" length="0" type="image/png"/><dc:creator>Aryan</dc:creator></item><item><title><![CDATA[Attention Mechanism Explained: Why Seq2Seq Models Need Dynamic Context]]></title><description><![CDATA[The attention mechanism solves the core limitation of traditional encoder–decoder models by dynamically focusing on relevant input tokens at each decoding step. This article explains why attention is needed, how alignment scores and context vectors work, and why attention dramatically improves translation quality for long sequences.]]></description><link>https://www.aryanupadhyay.tech/post/attention-mechanism-explained-why-seq2seq-models-need-dynamic-context</link><guid isPermaLink="false">696624e79c3c03a0a5e3341b</guid><category><![CDATA[Deep Learning]]></category><category><![CDATA[Neural Networks]]></category><pubDate>Thu, 12 Feb 2026 10:03:36 GMT</pubDate><enclosure url="https://static.wixstatic.com/media/468fc1_0a52b62b3d2f4a1fa314b51dcf2ccc93~mv2.jpg/v1/fit/w_1000,h_1000,al_c,q_80/file.png" length="0" type="image/png"/><dc:creator>Aryan</dc:creator></item><item><title><![CDATA[Encoder–Decoder (Seq2Seq) Architecture Explained: Training, Backpropagation, and Prediction in NLP]]></title><description><![CDATA[Sequence-to-sequence models form the foundation of modern neural machine translation. In this article, I explain the encoder–decoder architecture from first principles, covering variable-length sequences, training with teacher forcing, backpropagation through time, prediction flow, and key improvements such as embeddings and deep LSTMs—using intuitive explanations and clear diagrams.]]></description><link>https://www.aryanupadhyay.tech/post/encoder-decoder-seq2seq-architecture-explained-training-backpropagation-and-prediction-in-nlp</link><guid isPermaLink="false">695a0e4abd1cfb4bde7ae394</guid><category><![CDATA[Deep Learning]]></category><category><![CDATA[Neural Networks]]></category><pubDate>Tue, 10 Feb 2026 07:32:05 GMT</pubDate><enclosure url="https://static.wixstatic.com/media/468fc1_40bf2936ffb049abbd0bb71c8a107991~mv2.jpg/v1/fit/w_1000,h_1000,al_c,q_80/file.png" length="0" type="image/png"/><dc:creator>Aryan</dc:creator></item><item><title><![CDATA[From RNNs to GPT: The Epic History and Evolution of Large Language Models (LLMs)]]></title><description><![CDATA[Discover the fascinating journey of Artificial Intelligence from simple Sequence-to-Sequence tasks to the rise of Large Language Models. This guide traces the evolution from Recurrent Neural Networks (RNNs) and the Encoder-Decoder architecture to the revolutionary Attention Mechanism, Transformers, and the era of Transfer Learning that gave birth to BERT and GPT.]]></description><link>https://www.aryanupadhyay.tech/post/from-rnns-to-gpt-the-epic-history-and-evolution-of-large-language-models-llms</link><guid isPermaLink="false">6959fb67bd1cfb4bde7abb5c</guid><category><![CDATA[Deep Learning]]></category><category><![CDATA[Neural Networks]]></category><pubDate>Sun, 08 Feb 2026 07:19:27 GMT</pubDate><enclosure url="https://static.wixstatic.com/media/468fc1_039b364aa6ef4d9dbefcbec839039ae1~mv2.jpg/v1/fit/w_1000,h_1000,al_c,q_80/file.png" length="0" type="image/png"/><dc:creator>Aryan</dc:creator></item><item><title><![CDATA[What is a GRU? Gated Recurrent Units Explained (Architecture &#38; Math)]]></title><description><![CDATA[Gated Recurrent Units (GRUs) are an efficient alternative to LSTMs for sequential data modeling. This in-depth guide explains why GRUs exist, how their reset and update gates control memory, and walks through detailed numerical examples and intuitive analogies to help you truly understand how GRUs work internally.]]></description><link>https://www.aryanupadhyay.tech/post/what-is-a-gru-gated-recurrent-unit</link><guid isPermaLink="false">6985edad2afb5c3741be2c6c</guid><category><![CDATA[RNN]]></category><pubDate>Fri, 06 Feb 2026 13:45:31 GMT</pubDate><enclosure url="https://static.wixstatic.com/media/468fc1_bf4e2912d68440f0aefa13f75f4c2e22~mv2.jpg/v1/fit/w_1000,h_559,al_c,q_80/file.png" length="0" type="image/png"/><dc:creator>Aryan</dc:creator></item></channel></rss>