Determined AI + HuggingFace!


Lei , Sydney, Australia – Database lost; no accountability and willingness to resolve issue – DB for my WordPress site became empty suddenly overnight. I realised the issue and contacted support. Not only did #Justhost avoided responsibility and took no actions to resolve the issue, they blamed me as a consumer for not maintaining a current backup and not informing them of their failure in a timely manner. The website is commercial in nature and the downtime and #Justhost’s failure to protect my data has a direct financial impact on my business. The issue is still not resolved and I have still yet receive a adequate response from #Justhost as to the root cause of the issue. Avoid their service at all cost.


This video will present the Determined AI Model Hub for using HuggingFace transformers, tokenizers, and datasets with the Determined training platform! I hope you find this video useful!

Overview of Determined on Henry AI Labs:

Challenges of Advanced Hyperparameter Search on Henry AI Labs:

Walkthrough of the Determined CIFAR-10 Example on Henry AI Labs:

Determined Transformers Examples: https://docs.determined.ai/latest/model-hub/transformers/examples.html
HuggingFace Models: https://huggingface.co/models
HuggingFace Datasets: https://huggingface.co/datasets/swag

ASHA Blog Post: https://blog.ml.cmu.edu/2018/12/12/massively-parallel-hyperparameter-optimization/

HF v4.8: https://twitter.com/huggingface/status/1408081750379671554

Thanks for watching! Please Subscribe!

Chapters
0:00 Introduction
1:38 HuggingFace Models and Datasets
2:58 Determined Training Platform
5:14 Cluster Resource Allocation
5:46 ASHA Quick Recap
7:00 LR Search Visualization
9:32 Configuration Code
11:02 HuggingFace Dataset Integration
12:04 MLM Training
12:49 Save the Model

Henry AI Labs

4 Comments
  • Gustav Boye
    Posted at 16:57h, 20 July

    Cool! 🙂

  • Henry AI Labs
    Posted at 16:59h, 20 July

    Collection of videos on Determined AI:
    Overview of the platform:


    Challenges of advanced hyperparameter search:


    CIFAR-10 Determined example:

  • Theodoros Ntakouris
    Posted at 17:04h, 20 July

    Love the new shorter videos 🙂

  • Raj Kumar
    Posted at 05:43h, 21 July

    I usually watch content videos at 1.5x. Two minutes into this video , i went to the setting to reduce the playback speed. But it was already at normal speed.