T5 and MT5 Models

Links

• T5
  • GitHub: https://github.com/google-research/text-to-text-transfer-transformer
  • Paper: https://arxiv.org/abs/1910.10683
• MT5
  • GitHub: https://github.com/google-research/multilingual-t5
  • Paper: https://arxiv.org/abs/2010.11934

Training with Hugging Face Transformers

• https://github.com/huggingface/transformers/tree/master/examples/seq2seq