HRMS (Human Resource Management System)
UI/UX Design | Figma
A user-friendly HRMS interface designed to streamline employee management and HR-related workflows.
FigmaUI/UXResponsive Design
View Details
Portfolio
Selected Projects
A collection of design, engineering, and research work spanning human-centered interfaces, low-resource Nepali NLP, and language model development.
Tech Manthan Company Website
UI/UX Design | Figma
The UI/UX design for Tech Manthan's official website, focused on usability, responsiveness, and visual consistency.
FigmaUI/UXResponsive Design
View Details
Nepali Summarization Benchmark
Multi-Model Fine-tuning | In Progress
A unified benchmark for fine-tuning and evaluating Qwen, LLaMA, Mistral, and Gemma on Nepali abstractive summarization data.
PyTorchQLoRAHuggingFace+1
View Details
Nepali GPT-2
Pretraining to Instruction Finetuning
A 124M-parameter GPT-2 pretrained on a large Nepali corpus and fine-tuned for abstractive summarization, with a FastAPI inference server.
PyTorchHuggingFaceSentencePiece+1
View Details
Research
Exploring language and learning
My research focuses on building better language models and evaluation methods for Nepali, a low-resource language.
Subword Tokenization Optimization for Nepali Language
International Conference on Modern Mathematical Methods and HPC in Science & Technology
Mathura, India
Engineered SentencePiece tokenizers using BPE, Unigram, and WordPiece across three vocabulary sizes. Benchmarked nine GPT-2 configurations with perplexity and ROUGE scores to identify an optimal low-resource Nepali strategy.
SentencePieceBPEROUGEGPT-2
Towards Nepali-language LLMs: GPT training using Nepali BPE tokenizer
National Conference on Computer, Electrical, Electronics & Communication Engineering
Bhaktapur, Nepal
Pretrained a 124M-parameter GPT-2 on a 10.75GB Nepali corpus using FlashAttention, GPT-3-style learning-rate scheduling, and batch scaling across scraped Nepali news data.
GPT-2FlashAttentionBPELLMs