Hugging Face
Models
Datasets
Spaces
Buckets
Docs
Enterprise
Pricing
Website
Tasks
HuggingChat
Collections
Languages
Organizations
Community
Blog
Posts
Daily Papers
Hardware
Learn
Discord
Forum
GitHub
Solutions
Team & Enterprise
Hugging Face PRO
Enterprise Support
Inference Providers
Inference Endpoints
Storage Buckets
Log In
Sign Up
aayushraina
/
bpe-hindi
Like
0
Text Generation
Hindi
hindi
tokenizer
bpe
subword
text-processing
text2text-generation
License:
mit
Model card
Files
Files and versions
xet
Community
Copy to bucket
main
bpe-hindi
Ctrl+K
Ctrl+K
1 contributor
History:
8 commits
aayushraina
Upload 4 files
30325e1
verified
almost 2 years ago
tokenizer
Upload 2 files
almost 2 years ago
.gitattributes
1.52 kB
initial commit
almost 2 years ago
README.md
2.91 kB
Upload 4 files
almost 2 years ago
app.py
4.22 kB
Upload 4 files
almost 2 years ago
app_gradio.py
4.08 kB
Upload 4 files
almost 2 years ago
byte_pair_encoder.py
8.03 kB
Upload 9 files
almost 2 years ago
data_loader.py
4.26 kB
Upload 9 files
almost 2 years ago
download_dataset.py
6.47 kB
Upload 9 files
almost 2 years ago
encoder.json
540 kB
Upload 9 files
almost 2 years ago
hindi_bpe.py
4.56 kB
Upload 9 files
almost 2 years ago
requirements.txt
149 Bytes
Upload 4 files
almost 2 years ago
test_hindi_bpe.py
5.78 kB
Upload 9 files
almost 2 years ago
tokenizer_config.json
359 Bytes
Upload tokenizer_config.json
almost 2 years ago
vocab_stats.json
474 kB
Upload 9 files
almost 2 years ago
