Exploring Open-Source Large Language Models for InkMind: Choosing a Better Poetry Continuation Model

Introduction

Large Language Models (LLMs) have become important tools in natural language processing (NLP). They can generate text, summarize information, answer questions, and assist with creative writing. Most modern text-generating LLMs use the Transformer architecture and learn patterns in language from large collections of text.

Our project, InkMind , focuses on poetry generation through text continuation. Unlike an instruction-based chatbot, InkMind receives an opening phrase or part of a poem and generates the following words. For example, given the input “Beneath the moon, I walk alone,” the model should continue the text in a coherent and creative way.

In our earlier assignment, we explored GPT-2, including tokenization, embeddings, self-attention, and text-generation parameters such as temperature, top-k, and top-p.…