Youngjoon Jang

Contact: jyj [at] mmai.io

Room #3103, N24 Bldg, KAIST.

I am currently a Ph.D. student advised by Prof. Joon Son Chung, in Division of Future Vehicle at Korea Advanced Institute of Science and Technology (KAIST). Previously, I earned my M.S. in Division of Future Vehicle from KAIST (Feb. 2022) and B.S. in Division of Robotics from Kwangwoon University (Feb. 2020).

My research aims to effectively train deep neural networks with multi-modality (vision, audio and text). Also, I have an interest in techniques related to sign language for helping deaf people.

Publications

CVPR

Faces that Speak: Jointly Synthesising Talking Face and Speech from Text

{ Youngjoon Jang, Ji-Hoon Kim}*, Junseok Ahn, Doyeop Kwak, Hongsun Yang, Yooncheol Ju, ILHWAN KIM, Byeong-Yeol Kim, and Joon Son Chung (*: equal contributions)

In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2024.

BIBTEX

@inproceedings{jang2024faces,
  title = {Faces that Speak: Jointly Synthesising Talking Face and Speech from Text},
  author = {Jang, Youngjoon and Kim, Ji-Hoon and Ahn, Junseok and Kwak, Doyeop and Yang, Hongsun and Ju, Yooncheol and KIM, ILHWAN and Kim, Byeong-Yeol and Chung, Joon Son},
  booktitle = {{IEEE} Conference on Computer Vision and Pattern Recognition (CVPR)},
  year = {2024}
}

ICASSP

Slowfast Network for Continuous Sign Language Recognition

{Junseok Ahn, Youngjoon Jang}*, and Joon Son Chung (*: equal contributions)

In International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2024.

BIBTEX PDF

@inproceedings{ahn2024slowfastsign,
  title = {Slowfast Network for Continuous Sign Language Recognition},
  author = {Ahn, Junseok and Jang, Youngjoon and Chung, Joon Son},
  booktitle = {International Conference on Acoustics, Speech, and Signal Processing (ICASSP)},
  year = {2024}
}

ICASSP

VoxMM: Rich Transcription of Conversations in the Wild

{Doyeop Kwak, Jaemin Jung}*, Kihyun Nam, Youngjoon Jang, Jee-weon Jung, Shinji Watanabe, and Joon Son Chung (*: equal contributions)

In International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2024.

BIBTEX

@inproceedings{kwak2024voxmm,
  title = {VoxMM: Rich Transcription of Conversations in the Wild},
  author = {Kwak, Doyeop and Jung, Jaemin and Nam, Kihyun and Jang, Youngjoon and Jung, Jee-weon and Watanabe, Shinji and Chung, Joon Son},
  booktitle = {International Conference on Acoustics, Speech, and Signal Processing (ICASSP)},
  year = {2024}
}

ICASSP

FreGrad: Lightweight and Fast Frequency-aware Diffusion Vocoder

{Tan Dat Nguyen, Ji-Hoon Kim}*, Youngjoon Jang, Jaehun Kim, and Joon Son Chung (*: equal contributions)

In International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2024.

BIBTEX

@inproceedings{nguyen2024fregrad,
  title = {FreGrad: Lightweight and Fast Frequency-aware Diffusion Vocoder},
  author = {Nguyen, Tan Dat and Kim, Ji-Hoon and Jang, Youngjoon and Kim, Jaehun and Chung, Joon Son},
  booktitle = {International Conference on Acoustics, Speech, and Signal Processing (ICASSP)},
  year = {2024}
}

ICASSP

TalkNCE: Improving Active Speaker Detection with Talk-aware Contrastive Learning

{Chaeyoung Jung, Suyeon Lee}*, Kihyun Nam, Kyeongha Rho, You Jin Kim, Youngjoon Jang, and Joon Son Chung (*: equal contributions)

In International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2024.

BIBTEX

@inproceedings{Jung2024talknce,
  title = {TalkNCE: Improving Active Speaker Detection with Talk-aware Contrastive Learning},
  author = {Jung, Chaeyoung and Lee, Suyeon and Nam, Kihyun and Rho, Kyeongha and Kim, You Jin and Jang, Youngjoon and Chung, Joon Son},
  booktitle = {International Conference on Acoustics, Speech, and Signal Processing (ICASSP)},
  year = {2024}
}

ICASSP

Seeing Through the Conversation: Audio-visual Speech Separation based on Diffusion Model

{Suyeon Lee, Chaeyoung Jung}*, Youngjoon Jang, Jaehun Kim, and Joon Son Chung (*: equal contributions)

In International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2024.

BIBTEX

@inproceedings{lee2024seeing,
  title = {Seeing Through the Conversation: Audio-visual Speech Separation based on Diffusion Model},
  author = {Lee, Suyeon and Jung, Chaeyoung and Jang, Youngjoon and Kim, Jaehun and Chung, Joon Son},
  booktitle = {International Conference on Acoustics, Speech, and Signal Processing (ICASSP)},
  year = {2024}
}

ACMMM

That’s What I Said: Fully-Controllable Talking Face Generation

{ Youngjoon Jang, Kyeongha Rho}*, Jongbhin Woo, Hyeongkeun Lee, Jihwan Park, Youshin Lim, Byeong-Yeol Kim, and Joon Son Chung (*: equal contributions)

In ACM International Conference on Multimedia, 2023.

BIBTEX Project PDF

@inproceedings{jang2023fctfg,
  title = {That’s What I Said: Fully-Controllable Talking Face Generation},
  author = {Jang, Youngjoon and Rho, Kyeongha and Woo, Jongbhin and Lee, Hyeongkeun and Park, Jihwan and Lim, Youshin and Kim, Byeong-Yeol and Chung, Joon Son},
  booktitle = {ACM International Conference on Multimedia},
  year = {2023}
}

ICASSP

Self-Sufficient Framework for Continuous Sign Language Recognition

Youngjoon Jang, Youngtaek Oh, Jae Won Cho, Myungchul Kim, Dong-Jin Kim, In So Kweon, and Joon Son Chung

In International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2023.

BIBTEX Project PDF

@inproceedings{jang2023ssslr,
  title = {Self-Sufficient Framework for Continuous Sign Language Recognition},
  author = {Jang, Youngjoon and Oh, Youngtaek and Cho, Jae Won and Kim, Myungchul and Kim, Dong-Jin and Kweon, In So and Chung, Joon Son},
  booktitle = {International Conference on Acoustics, Speech, and Signal Processing (ICASSP)},
  year = {2023}
}

ICASSP

Metric Learning for User-Defined Keyword Spotting

{Jaemin Jung, Youkyum Kim}*, Jihwan Park, Youshin Lim, Byeong-Yeol Kim, Youngjoon Jang, and Joon Son Chung (*: equal contributions)

In International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2023.

BIBTEX Project PDF

@inproceedings{jung2023kws,
  title = {Metric Learning for User-Defined Keyword Spotting},
  author = {Jung, Jaemin and Kim, Youkyum and Park, Jihwan and Lim, Youshin and Kim, Byeong-Yeol and Jang, Youngjoon and Chung, Joon Son},
  booktitle = {International Conference on Acoustics, Speech, and Signal Processing (ICASSP)},
  year = {2023}
}

BMVC

Signing Outside the Studio: Benchmarking Background Robustness for Continuous Sign Language Recognition

Youngjoon Jang, Youngtaek Oh, Jae Won Cho, Dong-Jin Kim, Joon Son Chung, and In So Kweon

In British Machine Vision Conference (BMVC), 2022.

BIBTEX Project PDF Code

@inproceedings{jang2022signing,
  title = {Signing Outside the Studio: Benchmarking Background Robustness for Continuous Sign Language Recognition},
  author = {Jang, Youngjoon and Oh, Youngtaek and Cho, Jae Won and Kim, Dong-Jin and Chung, Joon Son and Kweon, In So},
  booktitle = {British Machine Vision Conference (BMVC)},
  year = {2022}
}

FG

KSL-Guide: A Large-scale Korean Sign Language Dataset Including Interrogative Sentences for Guiding the Deaf and Hard-of-Hearing

Soomin Ham, Kibaek Park, Youngjoon Jang, Youngtaek Oh, Seokmin Yun, Sukwon Yoon, Chang Jo Kim, Han-Mu Park, and In So Kweon

In International Conference on Automatic Face and Gesture Recognition (FG), 2021.

BIBTEX HTML Code Website

@inproceedings{ham2021ksl,
  title = {KSL-Guide: A Large-scale Korean Sign Language Dataset Including Interrogative Sentences for Guiding the Deaf and Hard-of-Hearing},
  author = {Ham, Soomin and Park, Kibaek and Jang, Youngjoon and Oh, Youngtaek and Yun, Seokmin and Yoon, Sukwon and Kim, Chang Jo and Park, Han-Mu and Kweon, In So},
  booktitle = {International Conference on Automatic Face and Gesture Recognition (FG)},
  pages = {1--8},
  year = {2021},
  organization = {IEEE}
}