Short Bio & Research Interests
I am an Associate Professor at the Andrew and Erna Viterbi Faculty of Electrical and Computer Engineering. I am the director of the Speech, Language, and Deep Learning Lab and affiliated with the Signal and Image processing Lab (SIPL).
I am excited about human speech. Speech is one of the most trivial yet one of the most complex signals we know. It bears information that the speaker would like to convey as well as her identity and her emotional and medical state. My research interests are driven by my passion for understanding and quantifying speech. My research concerns both machine learning and the computational study of human speech and language. My work on speech and language concentrates on speech processing, automatic speech recognition, speech synthesis, speaker recognition, automating laboratory phonology, and pathological speech. My research on machine learning focuses on core machine learning and deep learning algorithms, specifically, that capture the structure of complex tasks, such as automatic speech recognition. But also – how to make them reliable and trustworthy.
I received my BSc and MSc from Tel Aviv University in 1994 and 2002, respectively, and PhD from the Hebrew University of Jerusalem in 2008. My advisor was Yoram Singer. I did my postdoc with Hynek Hermansky at IDIAP Research Institue at EPFL and I was an Assistant Research Professor at TTI and the University of Chicago. Before moving to the Technion I was Associate Professor at the Department of Computer Science at Bar-Ilan University.
News
- An interview was published with me on Friday in "7 Days" by Dror Feuer on the topic of the new supercomputer "Israel-1" by NVIDIA.
- With Yossi Adi and Tal Rosenwein, I am organizing iSpeech 2023, the first Israeli seminar on speech & audio processing using neural nets.
- I am an elected member of the IEEE Speech and Language Processing Technical Committee
- I was nominated as an Associated Editor for the journal IEEE Signal Processing Letters
- I was nominated as an Associated Editor for the journal IEEE/ACM Transactions on Audio, Speech, and Language Processing
- "Why Amazon Scholar Yossi Keshet remains 'excited about speech'" - a blog post at Amazon Science By Larry Hardesty (August 23, 2022)
- I'm giving the opening talk, "Speech Processing: From Signal Processing to Deep Learning," at the SIPL Annual Event 2022. The talk is dedicated to our friend Yoav Medan who passed away last month and whose signal processing algorithmic thinking inspired my work in the field.
- On May 2022, I am proudly joining The Technion Faculty of Electrical and Computer Engineering.
- Jointly with Bhiksha Raj, I gave a tutorial at Interspeech 2019 on Generating adversarial examples for speech and speaker recognition and other systems.
- Together with Benny Pinkas, I organized The Second Focus Day on Deep Learning and Security.
- Together with Benny Pinkas, I organized The First Focus Day on Deep Learning and Security.
- Our joint work with Moustapha Cissé and Natalia Neverova from Facebook on fooling structured deep learning models got attention and was reviewed in New Scientist and MIT Technology Review.
- I am co-organizing the 4th Workshop on Machine Learning in Speech and Language Processing (MLSLP), co-located with ICML 2017 in Sydney, Australia, on August 11, 2017.
- I am co-chair with Noa Agmon, Noam Hazon, and Ariel Frank at the 14th Bar-Ilan Symposium on the Foundations of Artificial Intelligence (BISFAI).
- An interview with me by Ido Efrati was published in Ha’aretz (in Hebrew). As a result, I was interviewed on The morning show of Channel 10, on the evening show of Channel 1 “Erev Hadash,” and by Ben Kaspit on Channel 1 “Osim Seder.”
- With Matt Goldrick and Emily Cibelli, I am giving a tutorial on {Deep} Phonetic Tools at BigPhon, on July 13, 2016. We are presenting DeepVOT, DeepFormants, AutoVowelDuration, and DeepWDM.
- I am co-organizing the 3rd Workshop on Machine Learning in Speech and Language Processing (MLSLP) co-located with Interspeech 2016 in San Francisco, CA on September 13, 2016 with Karen Livescu, Mark Hasegawa-Johnson, Navdeep Jaitly, and Tara Sainath.
- I am co-organizing the 2nd Symposium on Machine Learning in Speech and Language Processing co-located with Interspeech 2012 in Portland, ON on September 14, 2012 with Karen Livescu, David Chiang, Fei Sha and Mark Hasegawa-Johnson.
- I am organizing Illinois Speech Day 2012 at TTI-Chicago on May 7, 2012.
- I am co-organizing the 1st Symposium on Machine Learning in Speech and Language Processing co-located collocated with ICML 2011 and ACL-HLT 2011 in Bellevue, WA, on June 27, 2011, with Geoffrey Zweig, Dan Roth, and Hal Daume III.
- I founded the ISCA special interest group on machine learning for speech and language (SIGML)
- I am organizing Illinois Speech Day 2011 at TTI-Chicago on May 11, 2011.