AI Security Lab

Summary Table of NLP Models (HF-based) – Vision-Type Models

AI Security Lab, BLOG / /

Name Full Name Architecture Base Model Developed Training Dataset Lib. & Framework Use Cases HF URL Githhub URL BEiT Bidirectional Encoder representation from Image Transformers Vision Transformer ViT 2021 ImageNet-21k, ImageNet-1k PyTorch, Hugging Face Transformers Image classification, semantic segmentation https://huggingface.co/microsoft/beit-base-patch16-224 https://github.com/microsoft/unilm/tree/master/beit BiT Big Transfer ResNet ResNet 2019 JFT-300M, ImageNet-21k TensorFlow, Hugging Face Transformers Image classification, transfer learning […]

Summary Table of NLP Models (HF-based) – Text-Type Models

AI Security Lab, BLOG / /

Name Full Name Architecture Base Model Developed Training Dataset Lib. & Framework Use Cases HF URL Githhub URL ALBERT A Lite BERT Transformer-based sequence-to-sequence BERT 2019 BookCorpus, English Wikipedia TensorFlow, PyTorch Natural Language Understanding https://huggingface.co/albert-base-v2 https://github.com/google-research/albert Bamba Bamba Transformer GPT-2 2023 Bambara language corpus PyTorch Bambara language generation https://huggingface.co/masakhane/bamba https://github.com/masakhane-io/bamba BART Bidirectional and Auto-Regressive Transformers

NLP Deep Learning Models (HF-based)

BLOG, AI Security Lab, PRATICAL TIPS / /

In the world of NLP, new models pop up almost every day, making it hard to keep track of them all. Our development team needed a way to summarize and organize key details about these models, so we decided to do some research. We started by analyzing all the models listed on Hugging Face, gathering