Skip to content

CV text - Local voice#38

Draft
Kostis-S-Z wants to merge 43 commits into
mainfrom
hybrid-cv-local-dataset
Draft

CV text - Local voice#38
Kostis-S-Z wants to merge 43 commits into
mainfrom
hybrid-cv-local-dataset

Conversation

@Kostis-S-Z

@Kostis-S-Z Kostis-S-Z commented Feb 12, 2025 •
edited
Loading

Copy link
Copy Markdown
Collaborator

What's changing

This PR adds the functionality to pull text sentences from the common voice when building the local voice dataset. This is mostly to help the user not having to think about text sentences to read out lout

How to test it

Steps to test the changes:

  1. Run the dataset maker app

Additional notes for reviewers

image

I already...

  • Tested the changes in a working environment to ensure they work as expected
  • Added some tests for any new functionality
  • Updated the documentation (both comments in code and under /docs)

@Kostis-S-Z
[WIP] add UI config for finetuning in notebook
7bf950c
@Kostis-S-Z
Merge branch 'main' of github.com:mozilla-ai/speech-to-text-finetune …
69f3c25 
…into add-config
@Kostis-S-Z
Add hf reference
df8d6ce
@Kostis-S-Z
Add config file using pydantic and yaml
cb6a41d
@Kostis-S-Z
Lint
73d060b
@Kostis-S-Z
Fix yaml issues
e388ac1
@Kostis-S-Z
Convert TrainingConfig to dict
a3550e5
@Kostis-S-Z
Fix EOF for yaml
22f790a
@Kostis-S-Z
Fix attribute name
e157ff9
@Kostis-S-Z
Rename app.py to transcribe_app.py
8dcfbce
@Kostis-S-Z
Add load_local_dataset function
e52364b
@Kostis-S-Z
Ignore local_data dir for git
8b179be
@Kostis-S-Z
Add app to create local dataset
c562459
@Kostis-S-Z
Merge from add-config
8fbdc77
@Kostis-S-Z
Add languages_common_voice_17_0.json
73ff562
@Kostis-S-Z
Add dataset_source attribute to config
f7ed2c1
@Kostis-S-Z
Minor config updates
d40011e
@Kostis-S-Z
Use csv instead of tsv
ab8110c
@Kostis-S-Z
Fix attribute name
e5946b3
@Kostis-S-Z
Enable using local dataset
b8ed63f
@Kostis-S-Z
Update import paths
f0c4da5
@Kostis-S-Z
Merge branch 'add-config' of github.com:mozilla-ai/speech-to-text-fin…
7d4d3a0 
…etune into 16-finetune-own-data
@Kostis-S-Z
Fix relative paths
653d8c7
@Kostis-S-Z
Update log
a226010
@Kostis-S-Z
Merge from main
545e2c4
@Kostis-S-Z
Remove hardcoded language path
db8c2fc
@Kostis-S-Z
Add note to README
5dd17b2
@Kostis-S-Z
Remove unused arg from function
b78edfc
@Kostis-S-Z
Add docstrings to make_local_dataset_app.py
4603045
@Kostis-S-Z
Fix type hints
6099c93
stefanfrench and others added 13 commits February 5, 2025 00:40
@stefanfrench @Kostis-S-Z
22 feature improve demo UI (#23)
5f093aa 
* changed the layout of the demo app

* minor changes to transcibe app

* lint test check

* Aesthetic format change

* Update demo/make_local_dataset_app.py

Co-authored-by: Kostis <Kostis-S-Z@users.noreply.github.com>

* Update demo/transcribe_app.py

Co-authored-by: Kostis <Kostis-S-Z@users.noreply.github.com>

* removing queue function

* Lint

---------

Co-authored-by: Kostis-S-Z <kostissz@pm.me>
Co-authored-by: Kostis <Kostis-S-Z@users.noreply.github.com>
@Kostis-S-Z
Merge from remote
39d3f78
@Kostis-S-Z
Add your own custom text data
c4f39f3
@Kostis-S-Z
Merge branch 'main' into 16-finetune-own-data
8a92b8f
@Kostis-S-Z
Move dataset making app to src
975a928
@Kostis-S-Z
Add HF instructions to README
6b9c55d
@Kostis-S-Z
Pin gradio version to fix UI issue
1ad2c80
@Kostis-S-Z
Merge branch 'main' into 16-finetune-own-data
b2c5c5e
@Kostis-S-Z
Fix paths
fce3414
@Kostis-S-Z
Merge remote-tracking branch 'origin/16-finetune-own-data' into 16-fi…
ee30646 
…netune-own-data
@Kostis-S-Z
Add languages CV to demo dir
a6e20b0
@Kostis-S-Z
Turn of fp16 by default
41e81c1
@Kostis-S-Z
Format
75afab7
Base automatically changed from 16-finetune-own-data to main February 13, 2025 18:31
@Kostis-S-Z Kostis-S-Z added the paused External contributions to this PR are welcomed. Interanlly, work on this is paused. label Feb 20, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

paused External contributions to this PR are welcomed. Interanlly, work on this is paused.

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@Kostis-S-Z @stefanfrench