In this blog, we will briefly talk about how we fine-tuned a transformer model meant for a masked language modeling (MLM) task, to make it suitable for a classification task.

Preamble

NLP for command line classification

Fine-tuning a Hugging Face model

Importing custom models into Elastic

Using the Transformer model for inference — a series of experiments

Using multiple nodes and threads

Dynamic quantization

Knowledge Distillation

Dynamic quantization and knowledge distillation

Bringing it all together

What's next

Getting the Most Out of Transformers in Elastic

Author

Benjamin Trent

Articles

Getting the Most Out of Transformers in Elastic