Skip to content
/ DeSTA2 Public
forked from kehanlu/DeSTA2

Code and model for ICASSP 2025 Paper "Developing Instruction-Following Speech Language Model Without Speech Instruction-Tuning Data"

License

ProdCor/DeSTA2

 
 

Repository files navigation

DeSTA2 implementation forked from the official repository.

The original README is available at README_original.md

We leverage DeSTA2 to answer the prompt "Using tone of voice only (prosody: pitch, rhythm, loudness, timbre). Ignore word meaning; do not transcribe. Reply with exactly one: angry | happy | sad | neutral" using emotionally incongruent audio samples from the Emotionally Incongruent Synthetic Speech dataset (EMIS).

The shell script run_desta2.sh automatically creates the conda environment used to evaluate this Spoken Language Model, following the method written on the paper. If you prefer, you can install packages via requirements.txt.

About

Code and model for ICASSP 2025 Paper "Developing Instruction-Following Speech Language Model Without Speech Instruction-Tuning Data"

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • HTML 58.8%
  • Python 36.6%
  • Jupyter Notebook 4.1%
  • Other 0.5%