pyannote / speech-separation-ami-1.0

huggingface.co
Total runs: 3.3K
24-hour runs: 0
7-day runs: -92
30-day runs: -5.1K
Model's Last Updated: Tháng mười một 11 2024

Introduction of speech-separation-ami-1.0

Model Details of speech-separation-ami-1.0

Using this open-source pipeline in production?
Consider switching to pyannoteAI for better and faster options.

🎹 PixIT / joint speaker diarization and speech separation

This pipeline ingests mono audio sampled at 16kHz and outputs speaker diarization as an Annotation instance and speech separation as a SlidingWindowFeature .

Audio files sampled at a different rate are resampled to 16kHz automatically upon loading.

Pipeline

It has been trained by Joonas Kalda with pyannote.audio 3.3.0 using the AMI dataset (single distant microphone, SDM). These paper and companion repository describe the approach in more details.

Requirements
  1. Install pyannote.audio 3.3.0 with pip install pyannote.audio[separation]==3.3.0
  2. Accept pyannote/separation-ami-1.0 user conditions
  3. Accept pyannote/speech-separation-ami-1.0 user conditions
  4. Create access token at hf.co/settings/tokens .
Usage
# instantiate the pipeline
from pyannote.audio import Pipeline
pipeline = Pipeline.from_pretrained(
  "pyannote/speech-separation-ami-1.0",
  use_auth_token="HUGGINGFACE_ACCESS_TOKEN_GOES_HERE")

# run the pipeline on an audio file
diarization, sources = pipeline("audio.wav")

# dump the diarization output to disk using RTTM format
with open("audio.rttm", "w") as rttm:
    diarization.write_rttm(rttm)

# dump sources to disk as SPEAKER_XX.wav files
import scipy.io.wavfile
for s, speaker in enumerate(diarization.labels()):
    scipy.io.wavfile.write(f'{speaker}.wav', 16000, sources.data[:,s])
Processing on GPU

pyannote.audio pipelines run on CPU by default. You can send them to GPU with the following lines:

import torch
pipeline.to(torch.device("cuda"))
Processing from memory

Pre-loading audio files in memory may result in faster processing:

waveform, sample_rate = torchaudio.load("audio.wav")
diarization = pipeline({"waveform": waveform, "sample_rate": sample_rate})
Monitoring progress

Hooks are available to monitor the progress of the pipeline:

from pyannote.audio.pipelines.utils.hook import ProgressHook
with ProgressHook() as hook:
    diarization = pipeline("audio.wav", hook=hook)
Citations
@inproceedings{Kalda24,
  author={Joonas Kalda and Clément Pagés and Ricard Marxer and Tanel Alumäe and Hervé Bredin},
  title={{PixIT: Joint Training of Speaker Diarization and Speech Separation from Real-world Multi-speaker Recordings}},
  year=2024,
  booktitle={Proc. Odyssey 2024},
}
@inproceedings{Bredin23,
  author={Hervé Bredin},
  title={{pyannote.audio 2.1 speaker diarization pipeline: principle, benchmark, and recipe}},
  year=2023,
  booktitle={Proc. INTERSPEECH 2023},
}

Runs of pyannote speech-separation-ami-1.0 on huggingface.co

3.3K
Total runs
0
24-hour runs
133
3-day runs
-92
7-day runs
-5.1K
30-day runs

More Information About speech-separation-ami-1.0 huggingface.co Model

More speech-separation-ami-1.0 license Visit here:

https://choosealicense.com/licenses/mit

speech-separation-ami-1.0 huggingface.co

speech-separation-ami-1.0 huggingface.co is an AI model on huggingface.co that provides speech-separation-ami-1.0's model effect (), which can be used instantly with this pyannote speech-separation-ami-1.0 model. huggingface.co supports a free trial of the speech-separation-ami-1.0 model, and also provides paid use of the speech-separation-ami-1.0. Support call speech-separation-ami-1.0 model through api, including Node.js, Python, http.

speech-separation-ami-1.0 huggingface.co Url

https://huggingface.co/pyannote/speech-separation-ami-1.0

pyannote speech-separation-ami-1.0 online free

speech-separation-ami-1.0 huggingface.co is an online trial and call api platform, which integrates speech-separation-ami-1.0's modeling effects, including api services, and provides a free online trial of speech-separation-ami-1.0, you can try speech-separation-ami-1.0 online for free by clicking the link below.

pyannote speech-separation-ami-1.0 online free url in huggingface.co:

https://huggingface.co/pyannote/speech-separation-ami-1.0

speech-separation-ami-1.0 install

speech-separation-ami-1.0 is an open source model from GitHub that offers a free installation service, and any user can find speech-separation-ami-1.0 on GitHub to install. At the same time, huggingface.co provides the effect of speech-separation-ami-1.0 install, users can directly use speech-separation-ami-1.0 installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

speech-separation-ami-1.0 install url in huggingface.co:

https://huggingface.co/pyannote/speech-separation-ami-1.0

Url of speech-separation-ami-1.0

speech-separation-ami-1.0 huggingface.co Url

Provider of speech-separation-ami-1.0 huggingface.co

pyannote
ORGANIZATIONS

Other API from pyannote

huggingface.co

Total runs: 7.6M
Run Growth: 1.9M
Growth Rate: 25.36%
Updated: Có thể 10 2024
huggingface.co

Total runs: 318.5K
Run Growth: -55.3K
Growth Rate: -17.63%
Updated: Có thể 10 2024
huggingface.co

Total runs: 100.8K
Run Growth: 86.7K
Growth Rate: 85.75%
Updated: Tháng mười một 15 2022