Youngjoon Jang

Contact: jyj [at] mmai.io

Room #3103, N24 Bldg, KAIST.

I am a Ph.D. student advised by Prof. Joon Son Chung at KAIST. I earned my M.S. supervised by Prof. In So Kweon at KAIST. I was a visiting student at VGG Group, University of Oxford, under the supervision of Prof. Andrew Zisserman.

My research aims to effectively train deep neural networks with multi-modality (vision, audio and text). Also, I have an interest in techniques related to sign language for helping deaf people.

Publications

ICASSP

VoiceDiT: Dual-Condition Diffusion Transformer for Environment-Aware Speech Synthesis

{Jaemin Jung, Junseok Ahn}*, Chaeyoung Jung, Tan Dat Nguyen, Youngjoon Jang, and Joon Son Chung (*: equal contributions)

In International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2025.

BIBTEX

@inproceedings{jung2025voicedit,
  title = {VoiceDiT: Dual-Condition Diffusion Transformer for Environment-Aware Speech Synthesis},
  author = {Jung, Jaemin and Ahn, Junseok and Jung, Chaeyoung and Nguyen, Tan Dat and Jang, Youngjoon and Chung, Joon Son},
  booktitle = {International Conference on Acoustics, Speech, and Signal Processing (ICASSP)},
  year = {2025}
}

ACMMM

Let Me Finish My Sentence: Video Temporal Grounding with Holistic Text Understanding

Jongbhin Woo, Hyeonggon Ryu, Youngjoon Jang, Jae Won Cho, and Joon Son Chung

In ACM International Conference on Multimedia (ACMMM), 2024.

BIBTEX

@inproceedings{woo2024let,
  title = {Let Me Finish My Sentence: Video Temporal Grounding with Holistic Text Understanding},
  author = {Woo, Jongbhin and Ryu, Hyeonggon and Jang, Youngjoon and Cho, Jae Won and Chung, Joon Son},
  booktitle = {ACM International Conference on Multimedia (ACMMM)},
  year = {2024}
}

CVPR

Faces that Speak: Jointly Synthesising Talking Face and Speech from Text

{ Youngjoon Jang, Ji-Hoon Kim}*, Junseok Ahn, Doyeop Kwak, Hongsun Yang, Yooncheol Ju, ILHWAN KIM, Byeong-Yeol Kim, and Joon Son Chung (*: equal contributions)

In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2024.

BIBTEX

@inproceedings{jang2024faces,
  title = {Faces that Speak: Jointly Synthesising Talking Face and Speech from Text},
  author = {Jang, Youngjoon and Kim, Ji-Hoon and Ahn, Junseok and Kwak, Doyeop and Yang, Hongsun and Ju, Yooncheol and KIM, ILHWAN and Kim, Byeong-Yeol and Chung, Joon Son},
  booktitle = {{IEEE} Conference on Computer Vision and Pattern Recognition (CVPR)},
  year = {2024}
}

ICASSP

Slowfast Network for Continuous Sign Language Recognition

{Junseok Ahn, Youngjoon Jang}*, and Joon Son Chung (*: equal contributions)

In International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2024.

BIBTEX PDF

@inproceedings{ahn2024slowfastsign,
  title = {Slowfast Network for Continuous Sign Language Recognition},
  author = {Ahn, Junseok and Jang, Youngjoon and Chung, Joon Son},
  booktitle = {International Conference on Acoustics, Speech, and Signal Processing (ICASSP)},
  year = {2024}
}

ICASSP

VoxMM: Rich Transcription of Conversations in the Wild

{Doyeop Kwak, Jaemin Jung}*, Kihyun Nam, Youngjoon Jang, Jee-weon Jung, Shinji Watanabe, and Joon Son Chung (*: equal contributions)

In International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2024.

BIBTEX

@inproceedings{kwak2024voxmm,
  title = {VoxMM: Rich Transcription of Conversations in the Wild},
  author = {Kwak, Doyeop and Jung, Jaemin and Nam, Kihyun and Jang, Youngjoon and Jung, Jee-weon and Watanabe, Shinji and Chung, Joon Son},
  booktitle = {International Conference on Acoustics, Speech, and Signal Processing (ICASSP)},
  year = {2024}
}

ICASSP

FreGrad: Lightweight and Fast Frequency-aware Diffusion Vocoder

{Tan Dat Nguyen, Ji-Hoon Kim}*, Youngjoon Jang, Jaehun Kim, and Joon Son Chung (*: equal contributions)

In International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2024.

BIBTEX

@inproceedings{nguyen2024fregrad,
  title = {FreGrad: Lightweight and Fast Frequency-aware Diffusion Vocoder},
  author = {Nguyen, Tan Dat and Kim, Ji-Hoon and Jang, Youngjoon and Kim, Jaehun and Chung, Joon Son},
  booktitle = {International Conference on Acoustics, Speech, and Signal Processing (ICASSP)},
  year = {2024}
}

ICASSP

TalkNCE: Improving Active Speaker Detection with Talk-aware Contrastive Learning

{Chaeyoung Jung, Suyeon Lee}*, Kihyun Nam, Kyeongha Rho, You Jin Kim, Youngjoon Jang, and Joon Son Chung (*: equal contributions)

In International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2024.

BIBTEX

@inproceedings{Jung2024talknce,
  title = {TalkNCE: Improving Active Speaker Detection with Talk-aware Contrastive Learning},
  author = {Jung, Chaeyoung and Lee, Suyeon and Nam, Kihyun and Rho, Kyeongha and Kim, You Jin and Jang, Youngjoon and Chung, Joon Son},
  booktitle = {International Conference on Acoustics, Speech, and Signal Processing (ICASSP)},
  year = {2024}
}

ICASSP

Seeing Through the Conversation: Audio-visual Speech Separation based on Diffusion Model

{Suyeon Lee, Chaeyoung Jung}*, Youngjoon Jang, Jaehun Kim, and Joon Son Chung (*: equal contributions)

In International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2024.

BIBTEX

@inproceedings{lee2024seeing,
  title = {Seeing Through the Conversation: Audio-visual Speech Separation based on Diffusion Model},
  author = {Lee, Suyeon and Jung, Chaeyoung and Jang, Youngjoon and Kim, Jaehun and Chung, Joon Son},
  booktitle = {International Conference on Acoustics, Speech, and Signal Processing (ICASSP)},
  year = {2024}
}

ACMMM

That’s What I Said: Fully-Controllable Talking Face Generation

{ Youngjoon Jang, Kyeongha Rho}*, Jongbhin Woo, Hyeongkeun Lee, Jihwan Park, Youshin Lim, Byeong-Yeol Kim, and Joon Son Chung (*: equal contributions)

In ACM International Conference on Multimedia (ACMMM), 2023.

BIBTEX Project PDF

@inproceedings{jang2023fctfg,
  title = {That’s What I Said: Fully-Controllable Talking Face Generation},
  author = {Jang, Youngjoon and Rho, Kyeongha and Woo, Jongbhin and Lee, Hyeongkeun and Park, Jihwan and Lim, Youshin and Kim, Byeong-Yeol and Chung, Joon Son},
  booktitle = {ACM International Conference on Multimedia (ACMMM)},
  year = {2023}
}

ICASSP

Self-Sufficient Framework for Continuous Sign Language Recognition

Youngjoon Jang, Youngtaek Oh, Jae Won Cho, Myungchul Kim, Dong-Jin Kim, In So Kweon, and Joon Son Chung

In International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2023.

Oral presentation, Top 3% recognition of all accepted papers

BIBTEX Project PDF

@inproceedings{jang2023ssslr,
  title = {Self-Sufficient Framework for Continuous Sign Language Recognition},
  author = {Jang, Youngjoon and Oh, Youngtaek and Cho, Jae Won and Kim, Myungchul and Kim, Dong-Jin and Kweon, In So and Chung, Joon Son},
  booktitle = {International Conference on Acoustics, Speech, and Signal Processing (ICASSP)},
  year = {2023}
}

ICASSP

Metric Learning for User-Defined Keyword Spotting

{Jaemin Jung, Youkyum Kim}*, Jihwan Park, Youshin Lim, Byeong-Yeol Kim, Youngjoon Jang, and Joon Son Chung (*: equal contributions)

In International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2023.

BIBTEX Project PDF

@inproceedings{jung2023kws,
  title = {Metric Learning for User-Defined Keyword Spotting},
  author = {Jung, Jaemin and Kim, Youkyum and Park, Jihwan and Lim, Youshin and Kim, Byeong-Yeol and Jang, Youngjoon and Chung, Joon Son},
  booktitle = {International Conference on Acoustics, Speech, and Signal Processing (ICASSP)},
  year = {2023}
}

Signing Outside the Studio: Benchmarking Background Robustness for Continuous Sign Language Recognition

Youngjoon Jang, Youngtaek Oh, Jae Won Cho, Dong-Jin Kim, Joon Son Chung, and In So Kweon

In British Machine Vision Conference (BMVC), 2022.

BIBTEX Project PDF Code

@inproceedings{jang2022signing,
  title = {Signing Outside the Studio: Benchmarking Background Robustness for Continuous Sign Language Recognition},
  author = {Jang, Youngjoon and Oh, Youngtaek and Cho, Jae Won and Kim, Dong-Jin and Chung, Joon Son and Kweon, In So},
  booktitle = {British Machine Vision Conference (BMVC)},
  year = {2022},
  preview = {signing_outside.png}
}

FG

KSL-Guide: A Large-scale Korean Sign Language Dataset Including Interrogative Sentences for Guiding the Deaf and Hard-of-Hearing

Soomin Ham, Kibaek Park, Youngjoon Jang, Youngtaek Oh, Seokmin Yun, Sukwon Yoon, Chang Jo Kim, Han-Mu Park, and In So Kweon

In International Conference on Automatic Face and Gesture Recognition (FG), 2021.

BIBTEX HTML Code Website

@inproceedings{ham2021ksl,
  title = {KSL-Guide: A Large-scale Korean Sign Language Dataset Including Interrogative Sentences for Guiding the Deaf and Hard-of-Hearing},
  author = {Ham, Soomin and Park, Kibaek and Jang, Youngjoon and Oh, Youngtaek and Yun, Seokmin and Yoon, Sukwon and Kim, Chang Jo and Park, Han-Mu and Kweon, In So},
  booktitle = {International Conference on Automatic Face and Gesture Recognition (FG)},
  pages = {1--8},
  year = {2021},
  organization = {IEEE}
}

Honors and Awards

Jun 2023	Top 3% Recognition Certificates, ICASSP 2023 [Certificate]