Portrait of Md Jisan Hossen

Md Jisan Hossen

AI Undergraduate Researcher

Nanjing University of Information Science & Technology (NUIST), China

B.Sc. in Artificial Intelligence · Expected Graduation: July 2027

Multimodal AI · LLM/NLP · Computer Vision · Deep Learning

About

I am an Artificial Intelligence undergraduate at Nanjing University of Information Science & Technology (NUIST), China, building practical deep learning systems and exploring multimodal AI, large language models, natural language processing, and computer vision. My work sits between research engineering — reproducible experiments, fair evaluation protocols, quantitative analysis — and applied AI that ships as a tool other people can run.

Most of my day-to-day work is in PyTorch: designing and fine-tuning architectures (CNNs, transformers, LSTMs), building retrieval-augmented generation and agent pipelines with LangChain and FAISS, and writing the evaluation code that decides whether a model actually works. Several of my projects are delivered as complete research packages with automated figure generation, test suites, continuous integration, and full technical write-ups.

I am seeking AI/ML research internships and opportunities toward graduate study (Master's) in multimodal AI, LLMs, and computer vision.

Research Interests

Multimodal AI

Vision–language models, multimodal representation learning, and evaluation of generative world models.

LLM / NLP

Language models, retrieval-augmented generation (RAG), agents, and semantic understanding.

Computer Vision

Image and video understanding, recognition systems, and medical imaging.

Deep Learning

Model development, comparative architecture study, and reproducible evaluation.

Publications & Research Projects

Peer-reviewed publications: none yet. The research-grade projects below are self-directed studies; several are being written up as manuscripts.

wmdrift — Diagnostics for Video World Models

long-horizon failures of autoregressive video world models — camera drift, temporal jitter, fading spatial memory, quality decay — are described qualitatively, not measured, so runs cannot be compared.

inference-only metrics combining ORB visual odometry with Umeyama Sim(3) alignment, detrended optical-flow spectral analysis, loop-closure LPIPS, and Laplacian-variance quality trends with optional CLIP alignment. Validated against known ground-truth poses on synthetic fixtures; 24-test suite; runs on CPU.

PythonOpenCVPyTorchLPIPSCLIP

ARIA — Resilient LLM-Controlled Drone Autopilot

autonomous drones must survive actuator failure, accept natural-language commands, respect social constraints, and manage energy — usually solved in isolation.

four cooperating agents around a shared 6-DOF quadrotor model — self-healing control (PPO), an LLM pilot (Mistral-7B via llama.cpp), ethical guardrails (CLIP), and a digital twin forecasting energy and wind 60 s ahead (Kalman filter). One command regenerates every figure, telemetry log, and report; 19 unit tests; CI on GitHub Actions.

PyTorchstable-baselines3llama-cpp-pythonCLIPfilterpy

FER_2026 — Facial Expression Recognition: A Controlled 7-Model Study

it is unclear how much deep architectures buy over classical baselines when the evaluation protocol is not held constant.

a strictly identical protocol — same balanced CK+ corpus (2,450 images), same stratified split, same training loop — across KNN, SVM, a from-scratch CNN, VGG16, MobileNetV2, ResNet50, and EfficientNetB0. Results so far: ResNet50 100%, custom CNN 96.3%, EfficientNetB0 93.9%, SVM 73.1%, KNN 49.8% test accuracy.

PyTorchtorchvisionscikit-learnGradio

Deep Learning for LTI System Identification (Z-Transform)

can discrete-time filter identification be cast as learning over Z-transform pole-zero geometry, bridging classical DSP and deep learning?

pole-zero maps rendered as 64×64 images paired with 128-dim frequency-response vectors, comparing PoleZeroCNN, FreqMLP, and late-fusion FusionNet on 5-class filter classification — 99.7–100% accuracy on 750 held-out samples, with a complete 1,257-line LaTeX paper and 19 auto-generated figures.

PyTorchSciPyscikit-learnLaTeX

Projects

AI_Agent — Autonomous Research Agent (ReAct + RAG)

A LangChain ReAct agent (gpt-4o-mini) that routes between FAISS-backed RAG over uploaded documents (MiniLM embeddings) and live web search, with multi-turn memory and a fully exposed reasoning trace, served through FastAPI and Streamlit.

LangChainFAISSOpenAI APIFastAPIStreamlit

DuplicateIQ — Semantic Duplicate Question Detection

A self-hosted service that detects duplicate questions by meaning rather than by matching words: Sentence-BERT (all-MiniLM-L6-v2) embeddings searched through a FAISS cosine index behind FastAPI, with a precision-first threshold and an automatic TF-IDF fallback.

Sentence-BERTFAISSFastAPIpytest

TCGA-BRCA Medical AI — MRI-Based Breast-Cancer Subtype Prediction

Deep-learning analysis of DCE-MRI for breast-cancer subtype prediction, built around the TCGA-BRCA cohort with a reproducible preprocessing and evaluation pipeline.

PyTorchMedical imagingDCE-MRI

atmosense-climate-ai — LSTM Climate Forecasting

LSTM-based forecasting on ERA5 reanalysis data, with a reproducible data pipeline and quantitative evaluation of forecast skill.

PyTorchLSTMERA5

Smart Elevator — Vision-Aided Dispatch System

A YOLOv5 vision-aided elevator dispatch system that uses object detection to inform scheduling decisions.

YOLOv5OpenCVPyTorch

Converge — AI Media Toolchain

An AI media toolchain integrating Real-ESRGAN super-resolution and Demucs source separation behind a unified interface.

Real-ESRGANDemucsPyTorch

Education

Bachelor of Science in Artificial Intelligence

Nanjing University of Information Science & Technology (NUIST) — Nanjing, China

Expected July 2027

  • Coursework delivered as full research packages — e.g., deep-learning system identification (Digital Image Processing) with a complete LaTeX paper, reproducible pipeline, and 19 auto-generated figures.
  • Independent research engineering: world-model diagnostics (wmdrift), multi-agent autonomy (ARIA), and controlled vision studies (FER_2026).

Skills

Programming
Python · Java · SQL
Deep Learning
PyTorch · TensorFlow · Keras
Machine Learning
scikit-learn · NumPy · Pandas
Computer Vision
OpenCV · CNNs · image processing
LLM / NLP
Transformers · embeddings · RAG · agents (LangChain, FAISS, Sentence-BERT)
Tools
Git · Linux · Docker · Jupyter · Zotero
AI Tools
ClaudeCode · KiloCode · Cline · OpenCode

Contact

I am open to AI/ML internships, research assistant positions, and conversations about Master's opportunities in multimodal AI, LLMs, and computer vision.