Maschine-Learning
/
Fabelous-albert-uncased
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases 1 Wiki Activity

1 Release 1 Tag

  • 0.1 af68eeab2b

    fabelous-albert-uncased Stable

    Fabel released this 2024-12-29 19:55:12 +00:00 | 0 commits to main since this release

    fabelous-albert-uncased

    Fabelous-Albert-Uncased is a bilingual ALBERT model pretrained on German, English, and code. This uncased model is a Masked Language Model (MLM) and can be fine-tuned for a variety of tasks, including but not limited to:

    • Named Entity Recognition (NER)
    • Binary Classification
    • Text Completion

    The model has been designed for efficiency and compatibility, requiring the use of the FastTokenizer for optimal performance.

    Features

    1. Bilingual Support

    • Trained on English and German text, enabling seamless bilingual tasks.

    2. Code Understanding

    • Incorporates code in its training data, making it suitable for programming-related NLP tasks.

    3. Uncased

    • Treats words as case-insensitive, which simplifies preprocessing steps and generalizes better for certain tasks.

    4. Fine-Tuning Ready

    • Easily fine-tune for tasks such as text classification, named entity recognition, and more.
    Downloads