Portrait of Md Jisan Hossen

AI Undergraduate Researcher · NUIST, China

Md Jisan Hossen

Multimodal AI · Generative World Models · LLM/NLP · Computer Vision

Nanjing University of Information Science & Technology (NUIST), China

B.Sc. in Artificial Intelligence · Expected Graduation: July 2027

Robotics Science and Engineering Machine Vision for Embodied Intelligence

About

I am an Artificial Intelligence undergraduate at Nanjing University of Information Science & Technology (NUIST), China, where I design, train, and rigorously evaluate deep learning systems. My interests span multimodal AI, generative world models, large language models, computer vision, and reproducible machine learning research.

I work at the intersection of research engineering and applied AI: I build reproducible experiments, fair evaluation protocols, and quantitative analyses, then ship the result as a tool that other people can actually run. My day-to-day work is in PyTorch — designing and fine-tuning architectures (CNNs, transformers, LSTMs), building retrieval-augmented generation and agent pipelines with LangChain and FAISS, and writing the evaluation code that decides whether a model truly works.

My research is under submission: two first-author manuscripts on adaptive temporal granularity for causal video generation have been submitted to international journals — one to Multimedia Tools and Applications (MTA) and one to Computer Vision and Image Understanding (CVIU). Both works are also released as open preprints on Zenodo (Jev-Routed v2 DOI 10.5281/zenodo.23984346, v1 DOI 10.5281/zenodo.23395414; JevGAG DOI 10.5281/zenodo.23693517) together with full replication artifacts. The programme audits when adaptive temporal granularity genuinely pays off for causal video generators, evaluated on two GPUs with different compute characteristics.

I am actively seeking AI/ML research internships and opportunities toward graduate study (Master's) in multimodal AI, world models, robotics, machine vision, and computer vision.

0 First-author papers under submission
0 Hardware audit · T4 + A100
0 Best intrinsic-probe AUROC
0 Peak benchmark accuracy

Highlights

Two first-author manuscripts · Under submission

Authored the Jev-Routed and JevGAG + DDAG studies on adaptive temporal granularity for causal video world models, now under submission to Multimedia Tools and Applications (MTA) and CVIU, with open Zenodo preprints and complete, reproducible replication artifacts.

Two-GPU, evidence-first audit

Measured adaptive temporal granularity on a Tesla T4 and an A100-SXM4-80GB; an intrinsic prefill probe reached AUROC 0.798 where a hand-crafted baseline failed (0.491).

Research packages, shipped complete

Projects delivered with automated figure generation, test suites, continuous integration, and full technical write-ups.

Controlled comparative studies

A strictly matched 7-model facial-expression benchmark, and a Z-transform system-identification study reaching 99.7–100% accuracy on held-out samples.

Research Interests

Robotics Science and Engineering

Autonomous and resilient robot systems, learning-based control, multi-agent autonomy, and the engineering that makes embodied agents reliable in the real world.

Machine Vision for Embodied Intelligence

Vision that closes the perception–action loop: spatial understanding, visual odometry and world-model diagnostics, and representations that let agents act.

Multimodal AI

Vision–language models, multimodal representation learning, and adaptive computation for generative video world models.

LLM / NLP

Language models, retrieval-augmented generation (RAG), autonomous agents, and semantic understanding.

Computer Vision

Image and video understanding, recognition systems, and medical imaging.

Deep Learning

Model design, controlled architecture comparisons, and reproducible evaluation.

Publications & Research Projects

Two first-author manuscripts are currently under submission to international journals — Multimedia Tools and Applications (MTA) and Computer Vision and Image Understanding (CVIU) — with open preprints and full replication artifacts on Zenodo. The research-grade projects below are self-directed studies.

JevGAG + DDAG — Regime-Aware Adaptive Temporal Granularity for Causal Video World Models: When Does Adaptivity Pay?

A two-part research programme on adaptive temporal granularity for causal video generation and interactive video world models: Part 1 — JevGAG (the report) audits when a generator should spend fine per-frame compute and when a cheaper chunked mode is enough, and Part 2 — DDAG (the method) turns those findings into a deployable, regime-aware rule.

on a matched Tesla T4 and A100-80GB study of a causal diffusion backbone, the same mode pair sits on opposite sides of the cost break-even; hand-crafted context statistics cannot predict coarse-unsafe segments (AUROC 0.491), while an intrinsic probe on the generator's own prefill activations reaches AUROC 0.798 — yet it inverts to 0.143 on the other GPU, and only a multi-feature model over the probe plus a sampler convergence residual transfers across both (0.842 / 0.833). A training-free 25% latent blend cuts the switch-boundary seam by 25% and improves fidelity, and the regime map shows adaptivity pays only when the cheap mode is cheaper and worse — the programme's honest headline is that the cheap mode was never worse, so the optimal policy is a fixed mode and a router is only worth deploying in a precisely stated region.

SubmissionZenodo DOICausal Video GenerationVideo World ModelsAdaptive ComputeEfficient InferenceJevUncertainty Quantification

Jev-Routed Temporal Granularity with Recovery and Hysteresis for Causal Video Generation

Causal video generators emit a rollout one temporal chunk at a time, which invites spending fine per-frame computation only where a segment is hard. Realizing that idea requires three preconditions that are usually assumed rather than measured: a mode that is genuinely cheaper on the deployment hardware, a signal that predicts hard segments before generation, and an independent endpoint that certifies the trade.

audits all three preconditions end to end on Causal-rCM (Wan2.1-T2V-1.3B-480p causal text-to-video diffusion), routing per segment among a frame-wise mode (c1-1), a chunk-3 mode (c3-3), and a near-zero-cost hold mode with a two-threshold controller that adds hysteresis and forced recovery. Routing is driven by the text-only Jev System One oracle, which answers typed difficulty, drift-risk, and motion-class questions before a segment is generated. Audits run on a 16 GB Tesla T4 and an A100-SXM4-80GB.

cost is hardware-conditional — a coarse forward is 3.01× a fine forward on the T4 against a 2.33× break-even (so coarse is never cheaper), but on the A100 the ratio falls to 1.60–1.75 and coarse is 1.46× faster in DiT time; a preregistered hand-crafted signal fails (AUROC 0.491) while the text-only Jev oracle reaches AUROC 0.788 [0.575, 0.946] at 0.67 s per decision; hysteresis and recovery cut switches (0.50→0.38 on the T4; 0.92→0.50 under injected noise on the A100) without worsening regret; and on 24 fresh A100 prompts a single-decision Jev policy saves 1.78 s of DiT time and 7.39 s of total time at a small −0.020 CLIP subject-consistency cost — a trade-off, not dominance.

SubmissionZenodo DOIv2PyTorchDiffusion TransformersCausal Video GenerationWorld Models

jev-adaptive-granularity-WM — Replication Artifact

the official code, locked protocols, calibration freezes, and audit artifacts behind the Jev-Routed preprint — a src/ package for causal-rCM inference, controller, uncertainty, and evaluation; 50 audit, calibration, and figure-generation scripts; 34 reproducible experiment job definitions (phase 0–5c plus RQ3/RQ4); and JSON/JSONL/CSV results for every phase. The study is deliberately evidence-preserving: negative and failed experiments are reported as evidence.

PyTorchWan2.1Diffusion TransformersKaggleReproducibility

wmdrift — Diagnostics for Video World Models

long-horizon failures of autoregressive video world models — camera drift, temporal jitter, fading spatial memory, quality decay — are described qualitatively, not measured, so runs cannot be compared.

inference-only metrics combining ORB visual odometry with Umeyama Sim(3) alignment, detrended optical-flow spectral analysis, loop-closure LPIPS, and Laplacian-variance quality trends with optional CLIP alignment. Validated against known ground-truth poses on synthetic fixtures; 24-test suite; runs on CPU.

PythonOpenCVPyTorchLPIPSCLIP

ARIA — Resilient LLM-Controlled Drone Autopilot

autonomous drones must survive actuator failure, accept natural-language commands, respect social constraints, and manage energy — usually solved in isolation.

four cooperating agents around a shared 6-DOF quadrotor model — self-healing control (PPO), an LLM pilot (Mistral-7B via llama.cpp), ethical guardrails (CLIP), and a digital twin forecasting energy and wind 60 s ahead (Kalman filter). One command regenerates every figure, telemetry log, and report; 19 unit tests; CI on GitHub Actions.

PyTorchstable-baselines3llama-cpp-pythonCLIPfilterpy

FER_2026 — Facial Expression Recognition: A Controlled 7-Model Study

it is unclear how much deep architectures buy over classical baselines when the evaluation protocol is not held constant.

a strictly identical protocol — same balanced CK+ corpus (2,450 images), same stratified split, same training loop — across KNN, SVM, a from-scratch CNN, VGG16, MobileNetV2, ResNet50, and EfficientNetB0. Results so far: ResNet50 100%, custom CNN 96.3%, EfficientNetB0 93.9%, SVM 73.1%, KNN 49.8% test accuracy.

PyTorchtorchvisionscikit-learnGradio

Deep Learning for LTI System Identification (Z-Transform)

can discrete-time filter identification be cast as learning over Z-transform pole-zero geometry, bridging classical DSP and deep learning?

pole-zero maps rendered as 64×64 images paired with 128-dim frequency-response vectors, comparing PoleZeroCNN, FreqMLP, and late-fusion FusionNet on 5-class filter classification — 99.7–100% accuracy on 750 held-out samples, with a complete 1,257-line LaTeX paper and 19 auto-generated figures.

PyTorchSciPyscikit-learnLaTeX

Projects

duomind — Jev + Small Local LLM (System 1 / System 2)

Pairs a small local LLM (System 2) with the Jev model (System 1) to make a small model faster and more accurate — OpenAI-compatible, private, and cheap to run locally inside Kilo Code and Cline. A project page is served at j1s4nn.github.io/duomind.

PythonLLMJevOpenAI-compatibleOllama

jevXagent — Transparent Proxy for AI Coding Agents

A transparent proxy that routes AI coding-agent traffic to cut latency and token cost. The repository reports reducing response times from 2.4 s to 890 ms (roughly 3× faster and ~80% cheaper) through a routing layer it calls the Line J architecture, working with Kilo Code, Cline, and Claude Code.

PythonLLM proxyRoutingCost optimizationKilo Code

AI_Agent — Autonomous Research Agent (ReAct + RAG)

A LangChain ReAct agent (gpt-4o-mini) that routes between FAISS-backed RAG over uploaded documents (MiniLM embeddings) and live web search, with multi-turn memory and a fully exposed reasoning trace, served through FastAPI and Streamlit.

LangChainFAISSOpenAI APIFastAPIStreamlit

DuplicateIQ — Semantic Duplicate Question Detection

A self-hosted service that detects duplicate questions by meaning rather than by matching words: Sentence-BERT (all-MiniLM-L6-v2) embeddings searched through a FAISS cosine index behind FastAPI, with a precision-first threshold and an automatic TF-IDF fallback.

Sentence-BERTFAISSFastAPIpytest

TCGA-BRCA Medical AI — MRI-Based Breast-Cancer Subtype Prediction

Deep-learning analysis of DCE-MRI for breast-cancer subtype prediction, built around the TCGA-BRCA cohort with a reproducible preprocessing and evaluation pipeline.

PyTorchMedical imagingDCE-MRI

atmosense-climate-ai — LSTM Climate Forecasting

LSTM-based forecasting on ERA5 reanalysis data, with a reproducible data pipeline and quantitative evaluation of forecast skill.

PyTorchLSTMERA5

Smart Elevator — Vision-Aided Dispatch System

A YOLOv5 vision-aided elevator dispatch system that uses object detection to inform scheduling decisions.

YOLOv5OpenCVPyTorch

Converge — AI Media Toolchain

An AI media toolchain integrating Real-ESRGAN super-resolution and Demucs source separation behind a unified interface.

Real-ESRGANDemucsPyTorch

Education

Bachelor of Science in Artificial Intelligence

Nanjing University of Information Science & Technology (NUIST) — Nanjing, China

Expected July 2027

  • Two first-author manuscripts on adaptive temporal granularity for causal video generation, under submission to Multimedia Tools and Applications (MTA) and Computer Vision and Image Understanding (CVIU), with open Zenodo preprints and full replication artifacts (Jev-Routed v2 DOI 10.5281/zenodo.23984346, v1 DOI 10.5281/zenodo.23395414; DOI 10.5281/zenodo.23693517).
  • Coursework delivered as complete research packages — e.g., deep-learning system identification (Digital Image Processing) with a full LaTeX paper, a reproducible pipeline, and 19 auto-generated figures.
  • Independent research engineering across video world-model diagnostics (wmdrift), multi-agent autonomy (ARIA), and controlled vision studies (FER_2026).

Skills

Programming
Python · Java · SQL
Deep Learning
PyTorch · TensorFlow · Keras · diffusion models · video generation
Machine Learning
scikit-learn · NumPy · Pandas
Computer Vision
OpenCV · CNNs · image processing
Robotics / Embodied AI
robot autonomy · learning-based control · visual odometry · world-model diagnostics
LLM / NLP
Transformers · embeddings · RAG · agents (LangChain, FAISS, Sentence-BERT)
Tools
Git · Linux · Docker · Jupyter · Zotero
AI Tools
ClaudeCode · KiloCode · Cline · OpenCode

Contact

I am open to AI/ML internships, research assistant positions, and conversations about Master's opportunities in multimodal AI, world models, robotics, machine vision, and computer vision.