Shivam Gupta

Projects

NMT Transformers from scratch

Built an encoder decoder tranformers for English to French experimenting with different attention heads

View link

Grapes Farm data using S1 & S2 satellite sensors

Analyzed grape farms using spectral angle mapping: first segmenting fields with SAM (Segment Anything), then computing the spectral angle of each pixel against known grape reference points to classify whether an area was a grape farm or not. Beyond the technical work, I traveled across Mumbai, Bengaluru, and Pune to study how horticulture crop trading actually happens on the ground—demoing the solution to farmers and traders, and learning firsthand about the challenges of agricultural markets.

View link

Daily articles (about 150)

Curated and shared the best essays from Pmarca, Paul Graham, Ben Kuhn, Sam Altman, and selected books - delivered weekly over Notion to ~20 friends for 5 months. The experiment tested a hypothesis: that consistently pushing high-quality ideas straight to WhatsApp could shift how people think and reason.

View link

Mechanistic Interpretability

Studied residual stream activations across layers and explored emergence of dominant directions using refusal features in Gemma-2B and Meta LLaMa-7B Model, using both base and instruction fine tuned models

View link

Decentralized Stablecoins

Borrowers lock up collateral to mint stablecoins, while savers earn interest on their deposits. Adjustable knobs : borrower APR and saver rate ,dynamically balance supply and demand: higher saver rates attract deposits, while lower borrowing rates boost lending. If collateral value falls too far, liquidation kicks in to protect the system.

View link

Over-Collaterized lending dApp

Over-collateralized lending dApp with two tokens: CORN (collateral) and ETH (borrowable). Users deposit CORN as collateral and can borrow ETH against it, but only within a safe limit. If their collateral ratio drops below 110%, the position is flagged for liquidation : protecting the system while keeping lending secure.

View link

Prediction Market on Ethereum( Sepolia)

Prediction market on Ethereum where people can trade simple Yes/No shares. Prices move with demand, effectively reflecting the crowd’s probability of an outcome, and when the result is known, winners get paid. The core engine runs on an AMM for instant trading, liquidity providers earn a share of fees, and an oracle is used to settle the final result.

View link

Variational Learning for Hyperelastic Modelilng

Implemented Bayesian Variational Learning algorithm with sparsity-promoting spike-slab priors (to reduce computation) to obtain the best-fitting hyper elasticity model from force & displacement data (generatedartificially) using Gibbs Sampling

View link

Video-Vision Tranformers

Implemented Pytorch version of ViVIT to classify MedMNIST dataset, sampling 3D frames using Tubelet Embedding Sampling method, dissecting video into spatial and temporal tokens, and inputting this as embedding to Transformer

View link