Artifact: the official code, locked protocols, calibration
freezes, and audit artifacts behind the Jev-Routed preprint — a src/
package for causal-rCM inference, controller, uncertainty, and evaluation;
50 audit, calibration, and figure-generation scripts; 34
reproducible experiment job definitions (phase 0–5c plus RQ3/RQ4); and JSON/JSONL/CSV results
for every phase. The study is deliberately evidence-preserving: negative and
failed experiments are reported as evidence.
About
I am an Artificial Intelligence undergraduate at Nanjing University of Information Science & Technology (NUIST), China, where I design, train, and rigorously evaluate deep learning systems. My interests span multimodal AI, generative world models, large language models, computer vision, and reproducible machine learning research.
I work at the intersection of research engineering and applied AI: I build reproducible experiments, fair evaluation protocols, and quantitative analyses, then ship the result as a tool that other people can actually run. My day-to-day work is in PyTorch — designing and fine-tuning architectures (CNNs, transformers, LSTMs), building retrieval-augmented generation and agent pipelines with LangChain and FAISS, and writing the evaluation code that decides whether a model truly works.
My research is under submission: two first-author manuscripts on adaptive temporal granularity for causal video generation have been submitted to international journals — one to Multimedia Tools and Applications (MTA) and one to Computer Vision and Image Understanding (CVIU). Both works are also released as open preprints on Zenodo (Jev-Routed v2 DOI 10.5281/zenodo.23984346, v1 DOI 10.5281/zenodo.23395414; JevGAG DOI 10.5281/zenodo.23693517) together with full replication artifacts. The programme audits when adaptive temporal granularity genuinely pays off for causal video generators, evaluated on two GPUs with different compute characteristics.
I am actively seeking AI/ML research internships and opportunities toward graduate study (Master's) in multimodal AI, world models, robotics, machine vision, and computer vision.
Highlights
Two first-author manuscripts · Under submission
Authored the Jev-Routed and JevGAG + DDAG studies on adaptive temporal granularity for causal video world models, now under submission to Multimedia Tools and Applications (MTA) and CVIU, with open Zenodo preprints and complete, reproducible replication artifacts.
Two-GPU, evidence-first audit
Measured adaptive temporal granularity on a Tesla T4 and an A100-SXM4-80GB; an intrinsic prefill probe reached AUROC 0.798 where a hand-crafted baseline failed (0.491).
Research packages, shipped complete
Projects delivered with automated figure generation, test suites, continuous integration, and full technical write-ups.
Controlled comparative studies
A strictly matched 7-model facial-expression benchmark, and a Z-transform system-identification study reaching 99.7–100% accuracy on held-out samples.
Research Interests
Robotics Science and Engineering
Autonomous and resilient robot systems, learning-based control, multi-agent autonomy, and the engineering that makes embodied agents reliable in the real world.
Machine Vision for Embodied Intelligence
Vision that closes the perception–action loop: spatial understanding, visual odometry and world-model diagnostics, and representations that let agents act.
Multimodal AI
Vision–language models, multimodal representation learning, and adaptive computation for generative video world models.
LLM / NLP
Language models, retrieval-augmented generation (RAG), autonomous agents, and semantic understanding.
Computer Vision
Image and video understanding, recognition systems, and medical imaging.
Deep Learning
Model design, controlled architecture comparisons, and reproducible evaluation.
Publications & Research Projects
Two first-author manuscripts are currently under submission to international journals — Multimedia Tools and Applications (MTA) and Computer Vision and Image Understanding (CVIU) — with open preprints and full replication artifacts on Zenodo. The research-grade projects below are self-directed studies.
JevGAG + DDAG — Regime-Aware Adaptive Temporal Granularity for Causal Video World Models: When Does Adaptivity Pay?
Submission — Computer Vision and Image Understanding (CVIU), manuscript CVIU-26-3570. Open preprint — DOI 10.5281/zenodo.23693517. A two-part research programme on adaptive temporal granularity for causal video generation and interactive video world models: Part 1 — JevGAG (the report) audits when a generator should spend fine per-frame compute and when a cheaper chunked mode is enough, and Part 2 — DDAG (the method) turns those findings into a deployable, regime-aware rule.
Findings: on a matched Tesla T4 and A100-80GB study of a causal diffusion backbone, the same mode pair sits on opposite sides of the cost break-even; hand-crafted context statistics cannot predict coarse-unsafe segments (AUROC 0.491), while an intrinsic probe on the generator's own prefill activations reaches AUROC 0.798 — yet it inverts to 0.143 on the other GPU, and only a multi-feature model over the probe plus a sampler convergence residual transfers across both (0.842 / 0.833). A training-free 25% latent blend cuts the switch-boundary seam by 25% and improves fidelity, and the regime map shows adaptivity pays only when the cheap mode is cheaper and worse — the programme's honest headline is that the cheap mode was never worse, so the optimal policy is a fixed mode and a router is only worth deploying in a precisely stated region.
Jev-Routed Temporal Granularity with Recovery and Hysteresis for Causal Video Generation
Submission — Multimedia Tools and Applications (MTA). Open preprint — v2: DOI 10.5281/zenodo.23984346 (v1: DOI 10.5281/zenodo.23395414). Causal video generators emit a rollout one temporal chunk at a time, which invites spending fine per-frame computation only where a segment is hard. Realizing that idea requires three preconditions that are usually assumed rather than measured: a mode that is genuinely cheaper on the deployment hardware, a signal that predicts hard segments before generation, and an independent endpoint that certifies the trade.
Approach: audits all three preconditions end to end on
Causal-rCM (Wan2.1-T2V-1.3B-480p causal text-to-video diffusion), routing
per segment among a frame-wise mode (c1-1), a chunk-3 mode (c3-3),
and a near-zero-cost hold mode with a two-threshold controller that adds
hysteresis and forced recovery. Routing is driven by the text-only Jev
System One oracle, which answers typed difficulty, drift-risk, and motion-class questions
before a segment is generated. Audits run on a 16 GB Tesla T4 and an
A100-SXM4-80GB.
Findings: cost is hardware-conditional — a coarse forward is 3.01× a fine forward on the T4 against a 2.33× break-even (so coarse is never cheaper), but on the A100 the ratio falls to 1.60–1.75 and coarse is 1.46× faster in DiT time; a preregistered hand-crafted signal fails (AUROC 0.491) while the text-only Jev oracle reaches AUROC 0.788 [0.575, 0.946] at 0.67 s per decision; hysteresis and recovery cut switches (0.50→0.38 on the T4; 0.92→0.50 under injected noise on the A100) without worsening regret; and on 24 fresh A100 prompts a single-decision Jev policy saves 1.78 s of DiT time and 7.39 s of total time at a small −0.020 CLIP subject-consistency cost — a trade-off, not dominance.
DOI (v2) DOI (v1) Code & artifacts Project page Figures Videos
Problem: long-horizon failures of autoregressive video world models — camera drift, temporal jitter, fading spatial memory, quality decay — are described qualitatively, not measured, so runs cannot be compared.
Approach: inference-only metrics combining ORB visual odometry with Umeyama Sim(3) alignment, detrended optical-flow spectral analysis, loop-closure LPIPS, and Laplacian-variance quality trends with optional CLIP alignment. Validated against known ground-truth poses on synthetic fixtures; 24-test suite; runs on CPU.
Problem: autonomous drones must survive actuator failure, accept natural-language commands, respect social constraints, and manage energy — usually solved in isolation.
Approach: four cooperating agents around a shared 6-DOF quadrotor model — self-healing control (PPO), an LLM pilot (Mistral-7B via llama.cpp), ethical guardrails (CLIP), and a digital twin forecasting energy and wind 60 s ahead (Kalman filter). One command regenerates every figure, telemetry log, and report; 19 unit tests; CI on GitHub Actions.
Problem: it is unclear how much deep architectures buy over classical baselines when the evaluation protocol is not held constant.
Approach: a strictly identical protocol — same balanced CK+ corpus (2,450 images), same stratified split, same training loop — across KNN, SVM, a from-scratch CNN, VGG16, MobileNetV2, ResNet50, and EfficientNetB0. Results so far: ResNet50 100%, custom CNN 96.3%, EfficientNetB0 93.9%, SVM 73.1%, KNN 49.8% test accuracy.
Problem: can discrete-time filter identification be cast as learning over Z-transform pole-zero geometry, bridging classical DSP and deep learning?
Approach: pole-zero maps rendered as 64×64 images paired with 128-dim frequency-response vectors, comparing PoleZeroCNN, FreqMLP, and late-fusion FusionNet on 5-class filter classification — 99.7–100% accuracy on 750 held-out samples, with a complete 1,257-line LaTeX paper and 19 auto-generated figures.
Projects
Pairs a small local LLM (System 2) with the Jev model (System 1) to make a small model faster and more accurate — OpenAI-compatible, private, and cheap to run locally inside Kilo Code and Cline. A project page is served at j1s4nn.github.io/duomind.
A transparent proxy that routes AI coding-agent traffic to cut latency and token cost. The repository reports reducing response times from 2.4 s to 890 ms (roughly 3× faster and ~80% cheaper) through a routing layer it calls the Line J architecture, working with Kilo Code, Cline, and Claude Code.
A LangChain ReAct agent (gpt-4o-mini) that routes between FAISS-backed RAG over uploaded documents (MiniLM embeddings) and live web search, with multi-turn memory and a fully exposed reasoning trace, served through FastAPI and Streamlit.
A self-hosted service that detects duplicate questions by meaning rather than by matching words: Sentence-BERT (all-MiniLM-L6-v2) embeddings searched through a FAISS cosine index behind FastAPI, with a precision-first threshold and an automatic TF-IDF fallback.
Deep-learning analysis of DCE-MRI for breast-cancer subtype prediction, built around the TCGA-BRCA cohort with a reproducible preprocessing and evaluation pipeline.
LSTM-based forecasting on ERA5 reanalysis data, with a reproducible data pipeline and quantitative evaluation of forecast skill.
A YOLOv5 vision-aided elevator dispatch system that uses object detection to inform scheduling decisions.
An AI media toolchain integrating Real-ESRGAN super-resolution and Demucs source separation behind a unified interface.
Education
Bachelor of Science in Artificial Intelligence
Nanjing University of Information Science & Technology (NUIST) — Nanjing, China
Expected July 2027
- Two first-author manuscripts on adaptive temporal granularity for causal video generation, under submission to Multimedia Tools and Applications (MTA) and Computer Vision and Image Understanding (CVIU), with open Zenodo preprints and full replication artifacts (Jev-Routed v2 DOI 10.5281/zenodo.23984346, v1 DOI 10.5281/zenodo.23395414; DOI 10.5281/zenodo.23693517).
- Coursework delivered as complete research packages — e.g., deep-learning system identification (Digital Image Processing) with a full LaTeX paper, a reproducible pipeline, and 19 auto-generated figures.
- Independent research engineering across video world-model diagnostics (wmdrift), multi-agent autonomy (ARIA), and controlled vision studies (FER_2026).
Skills
Contact
I am open to AI/ML internships, research assistant positions, and conversations about Master's opportunities in multimodal AI, world models, robotics, machine vision, and computer vision.
- Email myprojectjisan@gmail.com
- GitHub github.com/j1s4nn
- Hugging Face huggingface.co/j1s4nn
- Kaggle kaggle.com/ajjisan
- X @j1s4nn
- LinkedIn linkedin.com/in/j1s4nn
- Location Nanjing, China