【回答问题】ChatGPT上线了！推荐40个以上比较好的自然语言处理模型以及github源码？
BERT (Bidirectional Encoder Representations from Transformers): https://github.com/google-research/bert
GPT (Generative Pre-training Transformer): https://github.com/openai/gpt-3
Transformer: https://github.com/huggingface/transformers
ELMo (Embeddings from Language Models): https://github.com/allenai/allennlp
ULMFiT (Universal Language Model Fine-tuning for Text Classification): https://github.com/fastai/fastai
RoBERTa (Robustly Optimized BERT Pretraining Approach): https://github.com/pytorch/fairseq
ALBERT (A Lite BERT): https://github.com/google-research/albert
XLNet (eXtreme Language Modeling): https://github.com/zihangdai/xlnet
ERNIE (Enhanced Representation through Knowledge Integration): https://github.com/PaddlePaddle/ERNIE
T5 (Text-To-Text Transfer Transformer): https://github.com/google-research/text-to-text-transfer-transformer
MT-DNN (Multilingual Tasks with Deep Neural Networks): https://github.com/namisan/mt-dnn
DeBERTa (Decoding-enhanced BERT with Disentangled Attention): https://github.com/microsoft/DeBERTa
NeMo (Natural Language Modelling): https://github.com/NVIDIA/NeMo
Texar-PyTorch (Text Generation and Beyond): https://github.com/asyml/texar
FlauBERT (French BERT): https://github.com/getalp/FlauBERT
MMBT (Multilingual Multitask BERT): https://github.com/tluk/mmbt
XLM (Cross-lingual Language Model): https://github.com/pytorch/fairseq
BERTweet (BERT for Tweets): https://github.com/huggingface/twitter-bert
Reformer (Efficient Transformer): https://github.com/lucidrains/reformer-pytorch
BART (Denoising Autoencoding Transformations for Language Generation): https://github.com/pytorch/fairseq
K-BART (Knee-to-base BART): https://github.com/huggingface/k-bart
Megatron-LM (Scalable Language Model): https://github.com/NVIDIA/Megatron-LM
Funnel-Transformer (Efficient Transformer): https://github.com/openai/funnel-transformer
Electra (Efficient and Robust Pre-training for NLP): https://github.com/google-research/electra
GPT-2 (Language Model): https://github.com/openai/gpt-2
GPT-3 (Language Model): https://github.com/openai/gpt-3
Sparse Transformer (Efficient Transformer): https://github.com/lucidrains/sparse-transformer
LAMA (Language Model Analysis): https://github.com/huggingface/lama
本文链接：https://my.lmcjl.com/post/6864.html
4 评论