Member image
Youngjoon Jang
장영준
Ph.D. Student
School of Electrical Engineering (Division of Future Vehicle), KAIST

About me

I am a last-year Ph.D. student at KAIST, advised by Professor Joon Son Chung. I earned my M.S. supervised by Professor In So Kweon at KAIST. I was a visiting student at VGG Group, University of Oxford, under the supervision of Professor Andrew Zisserman. My research aims to effectively train deep neural networks with multi-modality (vision, audio and text). Also, I have an interest in techniques related to sign language for helping deaf people.

Experience

Visiting Student, VGG group, Oxford

May. 2024 - Nov. 2024

Advisor: Andrew Zisserman

Researcher, Multimodal AI Lab, KAIST

Mar. 2022 - Aug. 2022

Advisor: Joon Son Chung

Research Assistant, RO:BIT, Kwangwoon Univ.

Sep. 2016 - Feb. 2020

Advisor: Jin-Oh Kim

Education

Ph.D. in Electrical Engineering, KAIST

Sep. 2022 - Aug. 2025

Advisor: Joon Son Chung

M.S. in Electrical Engineering, KAIST

Mar. 2020 - Feb. 2022

Advisor: In So Kweon

B.S. in Robotics, Kwangwoon Univ.

Mar. 2014 - Feb. 2020

Selected Awards

2023
  • Top 3% Paper Recognition (ICASSP)
2021
  • 2nd Place, Science and Technology Specialized University Startup Competition (GIST)
  • 2nd Place, App Startup Support Program Contest (KAIST)
2018
  • 1st Place, R-BIZ Challenge TURTLEBOT3 AUTORACE
  • 5th Place, Sumo Robot, International Robot Contest (IRC)
2017
  • 3rd Place, R-BIZ Challenge TURTLEBOT3 AUTORACE
  • 1st Place, RoboCup Korea Open Rescue
  • 5th Place, RoboCup Iran Open Rescue

Publications

2025

Thumbnail
Lost in Translation, Found in Context: Sign Language Translation with Contextual Cues
Y. Jang*, H. Raajesh*, L. Momeni, G. Varol, and A. Zisserman
CVPR
Paper Project Page Code
Thumbnail
Test-Time Augmentation for Pose-invariant Face Recognition
J. Jung*, Y. Jang*, and J. S. Chung
FG
Paper
Thumbnail
VoiceEdit: Text-Driven Voice Conversion with Self-Supervised Learning
J. Jung*, J. Ahn*, C. Jung, T. D. Nguyen, Y. Jang, and J. S. Chung
ICASSP
Paper Project Page

2024

Thumbnail
Faces that Speak: Jointly Synthesising Talking Face and Speech from Text
Y. Jang*, J. Kim*, J. Ahn, D. Kwak, H. Yang, Y. Ju, I. Kim, B. Kim, and J. S. Chung
CVPR
Paper Project Page
Thumbnail
Let Me Finish My Sentence: Video Temporal Grounding with Holistic Text Understanding
J. Woo, H. Ryu, Y. Jang, J. W. Cho, and J. S. Chung
MM
Paper
Thumbnail
SlowFast Network for Continuous Sign Language Recognition
J. Ahn*, Y. Jang*, and J. S. Chung
ICASSP
Paper Code
Thumbnail
VoxMM: Rich Transcription of Conversations in the Wild
D. Kwak*, J. Jung*, K. Nam, Y. Jang, J. W. Jung, S. Watanabe, and J. S. Chung
ICASSP
Paper Dataset
Thumbnail
FreGrad: Lightweight and Fast Frequency-aware Diffusion Vocoder
T. D. Nguyen*, J. Kim*, Y. Jang, J. Kim, and J. S. Chung
ICASSP
Paper Project Page Code
Thumbnail
Seeing Through the Conversation: Audio-Visual Speech Separation based on Diffusion Model
S. Lee*, C. Jung*, Y. Jang, J. Kim, and J. S. Chung
ICASSP
Paper Project Page
Thumbnail
TalkNCE: Improving Active Speaker Detection with Talk-Aware Contrastive Learning
C. Jung*, S. Lee*, K. Nam, K. Rho, Y. Jang, and J. S. Chung
ICASSP
Paper Project Page

2023

Thumbnail
Self-sufficient framework for continuous sign language recognition
Y. Jang, Y. Oh, J. W. Cho, M. Kim, D. Kim, I. S. Kweon, and J. S. Chung
ICASSP
Paper
Thumbnail
That's What I Said: Fully-Controllable Talking Face Generation
Y. Jang*, K. Rho*, J. Woo, H. Lee, J. Park, Y. Lim, B. Kim, and J. S. Chung
MM
Paper Project Page
Thumbnail
Metric Learning for User-Defined Keyword Spotting
J. Jung*, Y. Kim*, J. Park, Y. Lim, B. Y. Kim, Y. Jang, and J. S. Chung
ICASSP
Paper Project Page Code

2022

Thumbnail
Signing outside the studio: Benchmarking background robustness for continuous sign language recognition
Y. Jang, Y. Oh, J. W. Cho, D. Kim, J. S. Chung, and I. S. Kweon
BMVC
Paper

2021

Thumbnail
Ksl-guide: A large-scale korean sign language dataset including interrogative sentences for guiding the deaf and hard-of-hearing
S. Ham, K. Park, Y. Jang, Y. Oh, S. Yun, S. Yoon, C. Kim, H. Park, and I. S. Kweon
FG
PDF Dataset

Contact

  jyj (at) kaist.ac.kr
  Room 3103, N24 (LG Innovation Hall)
KAIST logo