Skip to content

Sb new tokenizers#51

Merged
poonehmousavi merged 2 commits into
speechbrain:DASBfrom
poonehmousavi:sb_new_tokenizers
Jan 12, 2025
Merged

Sb new tokenizers#51
poonehmousavi merged 2 commits into
speechbrain:DASBfrom
poonehmousavi:sb_new_tokenizers

Conversation

@poonehmousavi
Copy link
Copy Markdown
Collaborator

@poonehmousavi poonehmousavi commented Jan 12, 2025

Update tokenizer_interface:

  • add Mimi (from SB main repo)
  • add Wavtokenizer (from SB main repo)
  • update speechTokenzier
  • add docstring
  • reshape some of the tokenizers to be consistent with the standard shape we define
  • add SQCodec tokenizer (both wrapper and original implementation)

@poonehmousavi poonehmousavi self-assigned this Jan 12, 2025
@poonehmousavi poonehmousavi added the enhancement New feature or request label Jan 12, 2025
@poonehmousavi poonehmousavi changed the base branch from main to DASB January 12, 2025 04:19
@poonehmousavi poonehmousavi merged commit 6935cb9 into speechbrain:DASB Jan 12, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@mravanelli mravanelli Awaiting requested review from mravanelli

Assignees

@poonehmousavi poonehmousavi

Labels

enhancement New feature or request

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@poonehmousavi