close
The Wayback Machine - https://web.archive.org/web/20220328222609/https://github.com/huggingface/transformers/issues/16308
Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ONNXConfig: Add a configuration for all available models #16308

Open
ChainYo opened this issue Mar 21, 2022 · 5 comments
Open

ONNXConfig: Add a configuration for all available models #16308

ChainYo opened this issue Mar 21, 2022 · 5 comments

Comments

@ChainYo
Copy link
Contributor

@ChainYo ChainYo commented Mar 21, 2022

This issue is about the working group specially created for this task. If you are interested in helping out, take a look at this organization, or add me on Discord: ChainYo#3610

We are looking for contributing to HuggingFace's ONNX implementation for all available models on the HF's hub. There is already a lot of architectures implemented for converting PyTorch models to ONNX, but we need more! We need them all!

Feel free to join us in this adventure! Join the org by clicking here

Here is a non-exhaustive list of models that all models available:

- ✅ Albert
- ✅ BART
- BeiT
- ✅ BERT
- 🛠️ BigBird
- BigBirdPegasus
- Blenderbot
- BlenderbotSmall
- ✅ CamemBERT
- Canine
- CLIP
- CTRL
- ConvBert
- ConvNext
- ✅ Data2Vec
- Deberta
- DebertaV2
- DeiT
- DecisionTransformer
- DETR
- ✅ Distilbert
- DPR
- ✅ Electra
- FNet
- FSMT
- ✅ Flaubert
- Funnel
- GLPN
- ✅ GPT2
- ✅ GPTJ
- ✅ GPT-Neo
- Hubert
- ✅ I-Bert
- ImageGPT
- LED
- ✅ LayoutLM
- 🛠️ LayoutLMv2
- LayoutXLM
- Longformer
- Luke
- Lxmert
- ✅ M2M100
- MaskFormer
- ✅ mBart
- MPNet
- MT5
- ✅ Marian
- MegatronBert
- MobileBert
- Nystromformer
- OpenAIGPT
- ✅ PLBart
- Pegasus
- Perceiver
- PoolFormer
- ProphetNet
- QDQBERT
- rag
- Realm
- Reformer
- RemBert
- ResNet
- RetriBert
- RoFormer
- ✅ RoBERTa
- SEW
- SEW-D
- Segformer
- Splinter
- SqueezeBERT
- Swin
- ✅ T5
- TAPAS
- TransfoXL
- TrOCR
- UniSpeech
- UniSpeechSat
- VAN
- ViT
- Vilt
- VisualBERT
- Wav2Vec2
- WavLM
- XGLM
- XLM
- XLMProphetNet
- ✅ XLM-RoBERTa
- ✅ XLM-Roberta-XL
- XLNet
- Yoso

If there is a next to a model, it means that the model is already supported by ONNX.
🛠️ next to a model means that the PR is in progress and finally if there is nothing next to a model, it means that the model is not yet supported by ONNX and thus we need to add support for it.

If you need some help about implementing an unsupported model, here is a guide from HuggingFace's documentation.

If you want an example of implementation, I did one for CamemBERT some months ago.

@ChainYo
Copy link
Contributor Author

@ChainYo ChainYo commented Mar 21, 2022

@ChainYo
Copy link
Contributor Author

@ChainYo ChainYo commented Mar 21, 2022

@vumichien
Copy link
Contributor

@vumichien vumichien commented Mar 22, 2022

Let me try with BigBird

@vumichien
Copy link
Contributor

@vumichien vumichien commented Mar 26, 2022

@LysandreJik
Copy link
Member

@LysandreJik LysandreJik commented Mar 28, 2022

Love the initiative here, thanks for opening an issue! Added the Good First Issue label so that it's more visible :)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Linked pull requests

Successfully merging a pull request may close this issue.

None yet
3 participants