20 Jul Determined AI + HuggingFace!
Lei , Sydney, Australia – Database lost; no accountability and willingness to resolve issue – DB for my WordPress site became empty suddenly overnight. I realised the issue and contacted support. Not only did #Justhost avoided responsibility and took no actions to resolve the issue, they blamed me as a consumer for not maintaining a current backup and not informing them of their failure in a timely manner. The website is commercial in nature and the downtime and #Justhost’s failure to protect my data has a direct financial impact on my business. The issue is still not resolved and I have still yet receive a adequate response from #Justhost as to the root cause of the issue. Avoid their service at all cost.
Overview of Determined on Henry AI Labs:
Challenges of Advanced Hyperparameter Search on Henry AI Labs:
Walkthrough of the Determined CIFAR-10 Example on Henry AI Labs:
Determined Transformers Examples: https://docs.determined.ai/latest/model-hub/transformers/examples.html
HuggingFace Models: https://huggingface.co/models
HuggingFace Datasets: https://huggingface.co/datasets/swag
ASHA Blog Post: https://blog.ml.cmu.edu/2018/12/12/massively-parallel-hyperparameter-optimization/
HF v4.8: https://twitter.com/huggingface/status/1408081750379671554
Thanks for watching! Please Subscribe!
1:38 HuggingFace Models and Datasets
2:58 Determined Training Platform
5:14 Cluster Resource Allocation
5:46 ASHA Quick Recap
7:00 LR Search Visualization
9:32 Configuration Code
11:02 HuggingFace Dataset Integration
12:04 MLM Training
12:49 Save the Model