MonsterMMORPG commited on
Commit
e69edcd
·
verified ·
1 Parent(s): cef5662

Clarify OmniVoice pretrained model CC-BY-NC license and preserve upstream model card

Browse files
OmniVoice/LICENSE CHANGED
@@ -1,201 +1,8 @@
1
- Apache License
2
- Version 2.0, January 2004
3
- http://www.apache.org/licenses/
4
 
5
- TERMS AND CONDITIONS FOR USE, REPRODUCTION, AND DISTRIBUTION
6
 
7
- 1. Definitions.
 
8
 
9
- "License" shall mean the terms and conditions for use, reproduction,
10
- and distribution as defined by Sections 1 through 9 of this document.
11
-
12
- "Licensor" shall mean the copyright owner or entity authorized by
13
- the copyright owner that is granting the License.
14
-
15
- "Legal Entity" shall mean the union of the acting entity and all
16
- other entities that control, are controlled by, or are under common
17
- control with that entity. For the purposes of this definition,
18
- "control" means (i) the power, direct or indirect, to cause the
19
- direction or management of such entity, whether by contract or
20
- otherwise, or (ii) ownership of fifty percent (50%) or more of the
21
- outstanding shares, or (iii) beneficial ownership of such entity.
22
-
23
- "You" (or "Your") shall mean an individual or Legal Entity
24
- exercising permissions granted by this License.
25
-
26
- "Source" form shall mean the preferred form for making modifications,
27
- including but not limited to software source code, documentation
28
- source, and configuration files.
29
-
30
- "Object" form shall mean any form resulting from mechanical
31
- transformation or translation of a Source form, including but
32
- not limited to compiled object code, generated documentation,
33
- and conversions to other media types.
34
-
35
- "Work" shall mean the work of authorship, whether in Source or
36
- Object form, made available under the License, as indicated by a
37
- copyright notice that is included in or attached to the work
38
- (an example is provided in the Appendix below).
39
-
40
- "Derivative Works" shall mean any work, whether in Source or Object
41
- form, that is based on (or derived from) the Work and for which the
42
- editorial revisions, annotations, elaborations, or other modifications
43
- represent, as a whole, an original work of authorship. For the purposes
44
- of this License, Derivative Works shall not include works that remain
45
- separable from, or merely link (or bind by name) to the interfaces of,
46
- the Work and Derivative Works thereof.
47
-
48
- "Contribution" shall mean any work of authorship, including
49
- the original version of the Work and any modifications or additions
50
- to that Work or Derivative Works thereof, that is intentionally
51
- submitted to Licensor for inclusion in the Work by the copyright owner
52
- or by an individual or Legal Entity authorized to submit on behalf of
53
- the copyright owner. For the purposes of this definition, "submitted"
54
- means any form of electronic, verbal, or written communication sent
55
- to the Licensor or its representatives, including but not limited to
56
- communication on electronic mailing lists, source code control systems,
57
- and issue tracking systems that are managed by, or on behalf of, the
58
- Licensor for the purpose of discussing and improving the Work, but
59
- excluding communication that is conspicuously marked or otherwise
60
- designated in writing by the copyright owner as "Not a Contribution."
61
-
62
- "Contributor" shall mean Licensor and any individual or Legal Entity
63
- on behalf of whom a Contribution has been received by Licensor and
64
- subsequently incorporated within the Work.
65
-
66
- 2. Grant of Copyright License. Subject to the terms and conditions of
67
- this License, each Contributor hereby grants to You a perpetual,
68
- worldwide, non-exclusive, no-charge, royalty-free, irrevocable
69
- copyright license to reproduce, prepare Derivative Works of,
70
- publicly display, publicly perform, sublicense, and distribute the
71
- Work and such Derivative Works in Source or Object form.
72
-
73
- 3. Grant of Patent License. Subject to the terms and conditions of
74
- this License, each Contributor hereby grants to You a perpetual,
75
- worldwide, non-exclusive, no-charge, royalty-free, irrevocable
76
- (except as stated in this section) patent license to make, have made,
77
- use, offer to sell, sell, import, and otherwise transfer the Work,
78
- where such license applies only to those patent claims licensable
79
- by such Contributor that are necessarily infringed by their
80
- Contribution(s) alone or by combination of their Contribution(s)
81
- with the Work to which such Contribution(s) was submitted. If You
82
- institute patent litigation against any entity (including a
83
- cross-claim or counterclaim in a lawsuit) alleging that the Work
84
- or a Contribution incorporated within the Work constitutes direct
85
- or contributory patent infringement, then any patent licenses
86
- granted to You under this License for that Work shall terminate
87
- as of the date such litigation is filed.
88
-
89
- 4. Redistribution. You may reproduce and distribute copies of the
90
- Work or Derivative Works thereof in any medium, with or without
91
- modifications, and in Source or Object form, provided that You
92
- meet the following conditions:
93
-
94
- (a) You must give any other recipients of the Work or
95
- Derivative Works a copy of this License; and
96
-
97
- (b) You must cause any modified files to carry prominent notices
98
- stating that You changed the files; and
99
-
100
- (c) You must retain, in the Source form of any Derivative Works
101
- that You distribute, all copyright, patent, trademark, and
102
- attribution notices from the Source form of the Work,
103
- excluding those notices that do not pertain to any part of
104
- the Derivative Works; and
105
-
106
- (d) If the Work includes a "NOTICE" text file as part of its
107
- distribution, then any Derivative Works that You distribute must
108
- include a readable copy of the attribution notices contained
109
- within such NOTICE file, excluding those notices that do not
110
- pertain to any part of the Derivative Works, in at least one
111
- of the following places: within a NOTICE text file distributed
112
- as part of the Derivative Works; within the Source form or
113
- documentation, if provided along with the Derivative Works; or,
114
- within a display generated by the Derivative Works, if and
115
- wherever such third-party notices normally appear. The contents
116
- of the NOTICE file are for informational purposes only and
117
- do not modify the License. You may add Your own attribution
118
- notices within Derivative Works that You distribute, alongside
119
- or as an addendum to the NOTICE text from the Work, provided
120
- that such additional attribution notices cannot be construed
121
- as modifying the License.
122
-
123
- You may add Your own copyright statement to Your modifications and
124
- may provide additional or different license terms and conditions
125
- for use, reproduction, or distribution of Your modifications, or
126
- for any such Derivative Works as a whole, provided Your use,
127
- reproduction, and distribution of the Work otherwise complies with
128
- the conditions stated in this License.
129
-
130
- 5. Submission of Contributions. Unless You explicitly state otherwise,
131
- any Contribution intentionally submitted for inclusion in the Work
132
- by You to the Licensor shall be under the terms and conditions of
133
- this License, without any additional terms or conditions.
134
- Notwithstanding the above, nothing herein shall supersede or modify
135
- the terms of any separate license agreement you may have executed
136
- with Licensor regarding such Contributions.
137
-
138
- 6. Trademarks. This License does not grant permission to use the trade
139
- names, trademarks, service marks, or product names of the Licensor,
140
- except as required for reasonable and customary use in describing the
141
- origin of the Work and reproducing the content of the NOTICE file.
142
-
143
- 7. Disclaimer of Warranty. Unless required by applicable law or
144
- agreed to in writing, Licensor provides the Work (and each
145
- Contributor provides its Contributions) on an "AS IS" BASIS,
146
- WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
147
- implied, including, without limitation, any warranties or conditions
148
- of TITLE, NON-INFRINGEMENT, MERCHANTABILITY, or FITNESS FOR A
149
- PARTICULAR PURPOSE. You are solely responsible for determining the
150
- appropriateness of using or redistributing the Work and assume any
151
- risks associated with Your exercise of permissions under this License.
152
-
153
- 8. Limitation of Liability. In no event and under no legal theory,
154
- whether in tort (including negligence), contract, or otherwise,
155
- unless required by applicable law (such as deliberate and grossly
156
- negligent acts) or agreed to in writing, shall any Contributor be
157
- liable to You for damages, including any direct, indirect, special,
158
- incidental, or consequential damages of any character arising as a
159
- result of this License or out of the use or inability to use the
160
- Work (including but not limited to damages for loss of goodwill,
161
- work stoppage, computer failure or malfunction, or any and all
162
- other commercial damages or losses), even if such Contributor
163
- has been advised of the possibility of such damages.
164
-
165
- 9. Accepting Warranty or Additional Liability. While redistributing
166
- the Work or Derivative Works thereof, You may choose to offer,
167
- and charge a fee for, acceptance of support, warranty, indemnity,
168
- or other liability obligations and/or rights consistent with this
169
- License. However, in accepting such obligations, You may act only
170
- on Your own behalf and on Your sole responsibility, not on behalf
171
- of any other Contributor, and only if You agree to indemnify,
172
- defend, and hold each Contributor harmless for any liability
173
- incurred by, or claims asserted against, such Contributor by reason
174
- of your accepting any such warranty or additional liability.
175
-
176
- END OF TERMS AND CONDITIONS
177
-
178
- APPENDIX: How to apply the Apache License to your work.
179
-
180
- To apply the Apache License to your work, attach the following
181
- boilerplate notice, with the fields enclosed by brackets "[]"
182
- replaced with your own identifying information. (Don't include
183
- the brackets!) The text should be enclosed in the appropriate
184
- comment syntax for the file format. We also recommend that a
185
- file or class name and description of purpose be included on the
186
- same "printed page" as the copyright notice for easier
187
- identification within third-party archives.
188
-
189
- Copyright 2026 Xiaomi Corp.
190
-
191
- Licensed under the Apache License, Version 2.0 (the "License");
192
- you may not use this file except in compliance with the License.
193
- You may obtain a copy of the License at
194
-
195
- http://www.apache.org/licenses/LICENSE-2.0
196
-
197
- Unless required by applicable law or agreed to in writing, software
198
- distributed under the License is distributed on an "AS IS" BASIS,
199
- WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
200
- See the License for the specific language governing permissions and
201
- limitations under the License.
 
1
+ OmniVoice pretrained model and derived ConvRot INT8 weights
 
 
2
 
3
+ The source model card states: "The pre-trained model is licensed under the CC-BY-NC due to constraints from its training data (e.g., Emilia)."
4
 
5
+ Source: https://huggingface.co/k2-fsa/OmniVoice#license
6
+ Authors: Han Zhu, Lingxuan Ye, Wei Kang, Zengwei Yao, Liyong Guo, Fangjun Kuang, Zhifeng Han, Weiji Zhuang, Long Lin, Long Lin, Daniel Povey.
7
 
8
+ The separately distributed source code is Apache-2.0. That code license does not replace the model license. See SOURCE_MODEL_CARD.md for the upstream attribution and terms.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
OmniVoice/README.md CHANGED
@@ -1,6 +1,6 @@
1
  # OmniVoice ConvRot INT8
2
 
3
- Quantized transformer weights for [k2-fsa/OmniVoice](https://huggingface.co/k2-fsa/OmniVoice), source revision `c5fdb5ccb189668d56333f77ba2629f4cd7535f4`. Apache-2.0; the original license accompanies this derivative.
4
 
5
  This checkpoint is loaded by the **Ultimate Text To Speech Generator With Voice Cloning** application. It is an application-specific ConvRot checkpoint, not a GGUF or a standalone Transformers model. Select OmniVoice and INT8 ConvRot in the application; it downloads the original tokenizer and auxiliary weights automatically.
6
 
 
1
  # OmniVoice ConvRot INT8
2
 
3
+ Quantized transformer weights for [k2-fsa/OmniVoice](https://huggingface.co/k2-fsa/OmniVoice), source revision `c5fdb5ccb189668d56333f77ba2629f4cd7535f4`. The pretrained weights are licensed under **CC-BY-NC**, according to the original model card. These derived weights retain those noncommercial terms. The upstream code has a separate Apache-2.0 license.
4
 
5
  This checkpoint is loaded by the **Ultimate Text To Speech Generator With Voice Cloning** application. It is an application-specific ConvRot checkpoint, not a GGUF or a standalone Transformers model. Select OmniVoice and INT8 ConvRot in the application; it downloads the original tokenizer and auxiliary weights automatically.
6
 
OmniVoice/SOURCE_MODEL_CARD.md ADDED
@@ -0,0 +1,787 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model:
3
+ - Qwen/Qwen3-0.6B
4
+ language:
5
+ - aae
6
+ - aal
7
+ - aao
8
+ - ab
9
+ - abb
10
+ - abn
11
+ - abr
12
+ - abs
13
+ - abv
14
+ - acm
15
+ - acw
16
+ - acx
17
+ - adf
18
+ - adx
19
+ - ady
20
+ - aeb
21
+ - aec
22
+ - af
23
+ - afb
24
+ - afo
25
+ - ahl
26
+ - ahs
27
+ - ajg
28
+ - aju
29
+ - ala
30
+ - aln
31
+ - alo
32
+ - am
33
+ - amu
34
+ - an
35
+ - anc
36
+ - ank
37
+ - anp
38
+ - anw
39
+ - aom
40
+ - apc
41
+ - apd
42
+ - arb
43
+ - arq
44
+ - ars
45
+ - ary
46
+ - arz
47
+ - as
48
+ - ast
49
+ - avl
50
+ - awo
51
+ - ayl
52
+ - ayp
53
+ - az
54
+ - ba
55
+ - bag
56
+ - bas
57
+ - bax
58
+ - bba
59
+ - bbj
60
+ - bbl
61
+ - bbu
62
+ - bce
63
+ - bci
64
+ - bcs
65
+ - bcy
66
+ - bda
67
+ - bde
68
+ - bdm
69
+ - be
70
+ - beb
71
+ - bew
72
+ - bfd
73
+ - bft
74
+ - bg
75
+ - bgp
76
+ - bhb
77
+ - bhh
78
+ - bho
79
+ - bhp
80
+ - bhr
81
+ - bjj
82
+ - bjk
83
+ - bjn
84
+ - bjt
85
+ - bkh
86
+ - bkm
87
+ - bky
88
+ - bmm
89
+ - bmq
90
+ - bn
91
+ - bnm
92
+ - bnn
93
+ - bns
94
+ - bo
95
+ - bou
96
+ - bqg
97
+ - br
98
+ - bra
99
+ - brh
100
+ - bri
101
+ - brx
102
+ - bs
103
+ - bsh
104
+ - bsj
105
+ - bsk
106
+ - btm
107
+ - btv
108
+ - bug
109
+ - bum
110
+ - buo
111
+ - bux
112
+ - bwr
113
+ - bxf
114
+ - byc
115
+ - bys
116
+ - byv
117
+ - byx
118
+ - bzc
119
+ - bzw
120
+ - ca
121
+ - ccg
122
+ - ceb
123
+ - cen
124
+ - cfa
125
+ - cgg
126
+ - chq
127
+ - cjk
128
+ - ckb
129
+ - ckl
130
+ - ckr
131
+ - cky
132
+ - cnh
133
+ - cpy
134
+ - cs
135
+ - cte
136
+ - ctl
137
+ - cut
138
+ - cux
139
+ - cv
140
+ - cy
141
+ - da
142
+ - dag
143
+ - dar
144
+ - dav
145
+ - dbd
146
+ - dcc
147
+ - de
148
+ - deg
149
+ - dgh
150
+ - dgo
151
+ - dje
152
+ - dmk
153
+ - dml
154
+ - dru
155
+ - dty
156
+ - dua
157
+ - dv
158
+ - dyu
159
+ - dzg
160
+ - ebr
161
+ - ebu
162
+ - ego
163
+ - eiv
164
+ - eko
165
+ - ekr
166
+ - el
167
+ - elm
168
+ - en
169
+ - eo
170
+ - es
171
+ - esu
172
+ - et
173
+ - eto
174
+ - ets
175
+ - etu
176
+ - eu
177
+ - ewo
178
+ - ext
179
+ - eyo
180
+ - fa
181
+ - fan
182
+ - fat
183
+ - ff
184
+ - ffm
185
+ - fi
186
+ - fia
187
+ - fil
188
+ - fip
189
+ - fkk
190
+ - fmp
191
+ - fr
192
+ - fub
193
+ - fuc
194
+ - fue
195
+ - fuf
196
+ - fuh
197
+ - fui
198
+ - fuq
199
+ - fuv
200
+ - fy
201
+ - ga
202
+ - gbm
203
+ - gbr
204
+ - gby
205
+ - gcc
206
+ - gdf
207
+ - gej
208
+ - ges
209
+ - ggg
210
+ - gid
211
+ - gig
212
+ - giz
213
+ - gjk
214
+ - gju
215
+ - gl
216
+ - glw
217
+ - gn
218
+ - gol
219
+ - gom
220
+ - gsl
221
+ - gu
222
+ - gui
223
+ - gur
224
+ - guz
225
+ - gv
226
+ - gwc
227
+ - gwe
228
+ - gwt
229
+ - gya
230
+ - gyz
231
+ - ha
232
+ - hah
233
+ - hao
234
+ - haw
235
+ - haz
236
+ - hbb
237
+ - he
238
+ - hem
239
+ - hi
240
+ - hia
241
+ - hkk
242
+ - hla
243
+ - hno
244
+ - hoj
245
+ - hr
246
+ - hsb
247
+ - ht
248
+ - hu
249
+ - hue
250
+ - hul
251
+ - hux
252
+ - hwo
253
+ - hy
254
+ - hz
255
+ - ia
256
+ - ibb
257
+ - id
258
+ - ida
259
+ - idu
260
+ - ig
261
+ - ijc
262
+ - ijn
263
+ - ik
264
+ - ikw
265
+ - is
266
+ - ish
267
+ - iso
268
+ - it
269
+ - its
270
+ - itw
271
+ - itz
272
+ - ja
273
+ - jal
274
+ - jax
275
+ - jgo
276
+ - jmx
277
+ - jns
278
+ - jqr
279
+ - juk
280
+ - juo
281
+ - jv
282
+ - ka
283
+ - kab
284
+ - kai
285
+ - kaj
286
+ - kam
287
+ - kbd
288
+ - kbl
289
+ - kbt
290
+ - kcq
291
+ - kdh
292
+ - kea
293
+ - keu
294
+ - kfe
295
+ - kfk
296
+ - kfp
297
+ - khg
298
+ - khw
299
+ - kj
300
+ - kjc
301
+ - kjk
302
+ - kk
303
+ - kln
304
+ - kls
305
+ - km
306
+ - kmr
307
+ - kmy
308
+ - kn
309
+ - kna
310
+ - knn
311
+ - ko
312
+ - kol
313
+ - koo
314
+ - kpo
315
+ - kqo
316
+ - ks
317
+ - ksd
318
+ - ksf
319
+ - kto
320
+ - kuh
321
+ - kvx
322
+ - kw
323
+ - kwm
324
+ - kxp
325
+ - ky
326
+ - kyx
327
+ - lag
328
+ - lb
329
+ - lcm
330
+ - ldb
331
+ - lg
332
+ - lij
333
+ - lir
334
+ - lkb
335
+ - lla
336
+ - ln
337
+ - lnu
338
+ - lo
339
+ - loa
340
+ - lrk
341
+ - lss
342
+ - lt
343
+ - ltg
344
+ - lto
345
+ - lua
346
+ - luo
347
+ - lus
348
+ - lv
349
+ - lwg
350
+ - mab
351
+ - maf
352
+ - mai
353
+ - mau
354
+ - max
355
+ - mbo
356
+ - mcf
357
+ - mcn
358
+ - mcx
359
+ - mdd
360
+ - mde
361
+ - mdf
362
+ - mek
363
+ - mer
364
+ - meu
365
+ - mfm
366
+ - mfn
367
+ - mfo
368
+ - mfv
369
+ - mgg
370
+ - mgi
371
+ - mhk
372
+ - mhr
373
+ - mi
374
+ - mig
375
+ - miu
376
+ - mk
377
+ - mkf
378
+ - mki
379
+ - ml
380
+ - mlq
381
+ - mn
382
+ - mne
383
+ - mni
384
+ - mqy
385
+ - mr
386
+ - mrj
387
+ - mrr
388
+ - mrt
389
+ - ms
390
+ - mse
391
+ - msh
392
+ - msw
393
+ - mt
394
+ - mtr
395
+ - mtu
396
+ - mtx
397
+ - mua
398
+ - mug
399
+ - mui
400
+ - mve
401
+ - mvy
402
+ - mxs
403
+ - mxu
404
+ - mxy
405
+ - my
406
+ - myv
407
+ - mzl
408
+ - nal
409
+ - nan
410
+ - nap
411
+ - nb
412
+ - nbh
413
+ - ncf
414
+ - nco
415
+ - ncx
416
+ - ndi
417
+ - ng
418
+ - ngi
419
+ - nhg
420
+ - nhi
421
+ - nhn
422
+ - nhq
423
+ - nja
424
+ - nl
425
+ - nla
426
+ - nlv
427
+ - nmg
428
+ - nmz
429
+ - nn
430
+ - nnh
431
+ - 'no'
432
+ - noe
433
+ - npi
434
+ - nso
435
+ - ny
436
+ - nyu
437
+ - oc
438
+ - odk
439
+ - odu
440
+ - ogo
441
+ - om
442
+ - orc
443
+ - oru
444
+ - ory
445
+ - os
446
+ - pa
447
+ - pbs
448
+ - pbt
449
+ - pbu
450
+ - pcm
451
+ - pex
452
+ - phl
453
+ - phr
454
+ - pip
455
+ - piy
456
+ - pko
457
+ - pl
458
+ - plk
459
+ - plt
460
+ - pmq
461
+ - pms
462
+ - pmy
463
+ - pnb
464
+ - poc
465
+ - poe
466
+ - pow
467
+ - prq
468
+ - ps
469
+ - pst
470
+ - pt
471
+ - pua
472
+ - pwn
473
+ - qug
474
+ - qum
475
+ - qup
476
+ - qur
477
+ - qus
478
+ - quv
479
+ - qux
480
+ - quy
481
+ - qva
482
+ - qvi
483
+ - qvj
484
+ - qvl
485
+ - qwa
486
+ - qws
487
+ - qxa
488
+ - qxp
489
+ - qxt
490
+ - qxu
491
+ - qxw
492
+ - rag
493
+ - rm
494
+ - ro
495
+ - rob
496
+ - rof
497
+ - roo
498
+ - rth
499
+ - ru
500
+ - rup
501
+ - rw
502
+ - sa
503
+ - sah
504
+ - sat
505
+ - sau
506
+ - say
507
+ - sbn
508
+ - sc
509
+ - scl
510
+ - scn
511
+ - sd
512
+ - sei
513
+ - shu
514
+ - si
515
+ - sip
516
+ - siw
517
+ - sjr
518
+ - sk
519
+ - skg
520
+ - skr
521
+ - sl
522
+ - sn
523
+ - snc
524
+ - snk
525
+ - so
526
+ - sol
527
+ - sps
528
+ - sq
529
+ - sr
530
+ - src
531
+ - sro
532
+ - ssi
533
+ - ste
534
+ - sua
535
+ - sv
536
+ - sva
537
+ - sw
538
+ - szy
539
+ - ta
540
+ - tan
541
+ - tar
542
+ - tay
543
+ - tbf
544
+ - tcf
545
+ - tcy
546
+ - tdn
547
+ - tdx
548
+ - te
549
+ - tg
550
+ - tgc
551
+ - th
552
+ - the
553
+ - thq
554
+ - thr
555
+ - thv
556
+ - ti
557
+ - tig
558
+ - tio
559
+ - tk
560
+ - tkg
561
+ - tkt
562
+ - tli
563
+ - tlp
564
+ - tn
565
+ - tok
566
+ - tpl
567
+ - tpz
568
+ - tqp
569
+ - tr
570
+ - trp
571
+ - trq
572
+ - trv
573
+ - trw
574
+ - tt
575
+ - ttj
576
+ - ttr
577
+ - ttu
578
+ - tui
579
+ - tul
580
+ - tuq
581
+ - tuv
582
+ - tuy
583
+ - tvo
584
+ - tvu
585
+ - tw
586
+ - twu
587
+ - txs
588
+ - txy
589
+ - udl
590
+ - ug
591
+ - uk
592
+ - uki
593
+ - umb
594
+ - ur
595
+ - ush
596
+ - uz
597
+ - uzn
598
+ - vai
599
+ - var
600
+ - ver
601
+ - vi
602
+ - vmc
603
+ - vmj
604
+ - vmm
605
+ - vmp
606
+ - vmz
607
+ - vot
608
+ - vro
609
+ - wbl
610
+ - wci
611
+ - weo
612
+ - wes
613
+ - wja
614
+ - wji
615
+ - wo
616
+ - wof
617
+ - xh
618
+ - xhe
619
+ - xka
620
+ - xmf
621
+ - xmv
622
+ - xmw
623
+ - xpe
624
+ - xti
625
+ - xtu
626
+ - yaq
627
+ - yav
628
+ - yay
629
+ - ydd
630
+ - ydg
631
+ - yer
632
+ - 'yes'
633
+ - yi
634
+ - yo
635
+ - yue
636
+ - zga
637
+ - zgh
638
+ - zh
639
+ - zoc
640
+ - zoh
641
+ - zor
642
+ - zpv
643
+ - zpy
644
+ - ztg
645
+ - ztn
646
+ - ztp
647
+ - zts
648
+ - ztu
649
+ - zu
650
+ - zza
651
+ pipeline_tag: text-to-speech
652
+ tags:
653
+ - zero-shot
654
+ - multilingual
655
+ - voice-cloning
656
+ - voice-design
657
+ library_name: omnivoice
658
+ ---
659
+
660
+ # OmniVoice 🌍
661
+
662
+ <p align="center">
663
+ <img width="200" height="200" alt="OmniVoice" src="https://zhu-han.github.io/omnivoice/pics/omnivoice.jpg" />
664
+ </p>
665
+
666
+ <p align="center">
667
+ <a href="https://huggingface.co/k2-fsa/OmniVoice"><img src="https://img.shields.io/badge/%F0%9F%A4%97%20Hugging%20Face-Model-FFD21E" alt="Hugging Face Model"></a>
668
+ &nbsp;
669
+ <a href="https://huggingface.co/spaces/k2-fsa/OmniVoice"><img src="https://img.shields.io/badge/%F0%9F%A4%97%20Hugging%20Face-Space-blue" alt="Hugging Face Space"></a>
670
+ &nbsp;
671
+ <a href="https://huggingface.co/papers/2604.00688"><img src="https://img.shields.io/badge/arXiv-Paper-B31B1B.svg"></a>
672
+ &nbsp;
673
+ <a href="https://github.com/k2-fsa/OmniVoice"><img src="https://img.shields.io/badge/GitHub-Code-181717?logo=GitHub" alt="GitHub Code"></a>
674
+ &nbsp;
675
+ <a href="https://zhu-han.github.io/omnivoice"><img src="https://img.shields.io/badge/GitHub.io-Demo_Page-blue?logo=GitHub&style=flat-square"></a>
676
+ &nbsp;
677
+ <a href="https://colab.research.google.com/github/k2-fsa/OmniVoice/blob/master/docs/OmniVoice.ipynb"><img src="https://colab.research.google.com/assets/colab-badge.svg" alt="Open In Colab"></a>
678
+ </p>
679
+
680
+
681
+ OmniVoice is a massively multilingual zero-shot text-to-speech (TTS) model supporting over 600 languages. Built on a novel diffusion language model-style architecture, it delivers high-quality speech with superior inference speed, supporting voice cloning and voice design.
682
+
683
+ - **Paper:** [OmniVoice: Towards Omnilingual Zero-Shot Text-to-Speech with Diffusion Language Models](https://huggingface.co/papers/2604.00688)
684
+ - **Repository:** [GitHub](https://github.com/k2-fsa/OmniVoice)
685
+ - **Demo:** [Hugging Face Space](https://huggingface.co/spaces/k2-fsa/OmniVoice)
686
+ - **Colab:** [Google Colab Notebook](https://colab.research.google.com/github/k2-fsa/OmniVoice/blob/master/docs/OmniVoice.ipynb)
687
+
688
+ ## Key Features
689
+
690
+ - **600+ Languages Supported**: The broadest language coverage among zero-shot TTS models.
691
+ - **Voice Cloning**: State-of-the-art voice cloning quality from a short reference audio.
692
+ - **Voice Design**: Control voices via assigned speaker attributes (gender, age, pitch, dialect/accent, whisper, etc.).
693
+ - **Fine-grained Control**: Non-verbal symbols (e.g., `[laughter]`) and pronunciation correction via pinyin or phonemes.
694
+ - **Fast Inference**: RTF as low as 0.025 (40x faster than real-time).
695
+ - **Diffusion Language Model-style Architecture**: A clean, streamlined, and scalable design that delivers both quality and speed.
696
+
697
+ ## Usage
698
+
699
+ To get started, install the `omnivoice` library:
700
+
701
+ > We recommend using a fresh virtual environment (e.g., `conda`, `venv`, etc.) to avoid conflicts.
702
+
703
+ **Step 1**: Install PyTorch
704
+
705
+ <details>
706
+ <summary>NVIDIA GPU</summary>
707
+
708
+ ```bash
709
+ # Install pytorch with your CUDA version, e.g.
710
+ pip install torch==2.8.0+cu128 torchaudio==2.8.0+cu128 --extra-index-url https://download.pytorch.org/whl/cu128
711
+ ```
712
+ > See [PyTorch official site](https://pytorch.org/get-started/locally/) for other versions installation.
713
+
714
+ </details>
715
+
716
+ <details>
717
+ <summary>Apple Silicon</summary>
718
+
719
+ ```bash
720
+ pip install torch==2.8.0 torchaudio==2.8.0
721
+ ```
722
+
723
+ </details>
724
+
725
+ **Step 2**: Install OmniVoice
726
+
727
+ ```bash
728
+ pip install omnivoice
729
+ ```
730
+
731
+ ### Python API
732
+
733
+ You can use OmniVoice for zero-shot voice cloning as follows:
734
+
735
+ ```python
736
+ from omnivoice import OmniVoice
737
+ import soundfile as sf
738
+ import torch
739
+
740
+ # Load the model
741
+ model = OmniVoice.from_pretrained(
742
+ "k2-fsa/OmniVoice",
743
+ device_map="cuda:0",
744
+ dtype=torch.float16
745
+ )
746
+
747
+ # Generate audio
748
+ audio = model.generate(
749
+ text="Hello, this is a test of zero-shot voice cloning.",
750
+ ref_audio="ref.wav",
751
+ ref_text="Transcription of the reference audio.",
752
+ ) # audio is a list of `np.ndarray` with shape (T,) at 24 kHz.
753
+
754
+ sf.write("out.wav", audio[0], 24000)
755
+ ```
756
+
757
+ For more generation modes (e.g., voice design), functions (e.g., non-verbal symbols, pronunciation correction) and comprehensive usage instructions, see our [GitHub Repository](https://github.com/k2-fsa/OmniVoice).
758
+
759
+
760
+ ## Discussion & Communication
761
+
762
+ You can directly discuss on [GitHub Issues](https://github.com/k2-fsa/OmniVoice/issues).
763
+
764
+ You can also scan the QR code to join our wechat group or follow our wechat official account.
765
+
766
+ | Wechat Group | Wechat Official Account |
767
+ | ------------ | ----------------------- |
768
+ |![wechat](https://k2-fsa.org/zh-CN/assets/pic/wechat_group.jpg) |![wechat](https://k2-fsa.org/zh-CN/assets/pic/wechat_account.jpg) |
769
+
770
+ ## Citation
771
+
772
+ ```bibtex
773
+ @article{zhu2026omnivoice,
774
+ title={OmniVoice: Towards Omnilingual Zero-Shot Text-to-Speech with Diffusion Language Models},
775
+ author={Zhu, Han and Ye, Lingxuan and Kang, Wei and Yao, Zengwei and Guo, Liyong and Kuang, Fangjun and Han, Zhifeng and Zhuang, Weiji and Lin, Long and Povey, Daniel},
776
+ journal={arXiv preprint arXiv:2604.00688},
777
+ year={2026}
778
+ }
779
+ ```
780
+
781
+ ## License
782
+
783
+ Our code is released under the Apache 2.0 License. The pre-trained model is licensed under the CC-BY-NC due to constraints from its training data (e.g., Emilia).
784
+
785
+ ## Disclaimer
786
+
787
+ Users are strictly prohibited from using this model for unauthorized voice cloning, voice impersonation, fraud, scams, or any other illegal or unethical activities. All users shall ensure full compliance with applicable local laws, regulations, and ethical standards. The developers assume no liability for any misuse of this model and advocate for responsible AI development and use, encouraging the community to uphold safety and ethical principles in AI research and applications.