Tag: genai

Archival bots: My mother, my model for language

Jenny Hedley   During two stages in my life—at age seven and again in my twenties—I acted as surrogate speaker when head-and-neck cancer muted my mother’s voice. In the years between, we collaborated on so many creative projects that our voices often became enmeshed. I have perpetuated this mother–daughter entanglement eighteen years after her death by training a small language model (SLM) on a dataset of personal writing which includes her voice. Specifically, my JenAI language model’s ‘memoir’-tagged voice trained upon my unpublished manuscript ‘Hermit Crab Diary’ which weaves together my mother’s and my 2005–2007 diary entries with my contemporaneous…

… read more

Generative AI model training: Why do you sound like me? Because I am you

Jenny Hedley   My first fine-tuned small language model (SLM) was a boring failure who sounded didactic, encyclopaedic. JenAI v1 had trained on approximately 280,000 words of my creative writing and yet still had the (un)distinctive (non)voice of a bot trained on textbook-quality data.[1] I had tagged each of my training datasets with <author>, <genre>, and <subgenre> so that the model could learn that Jenny Hedley’s nonfiction writing—in memoir, academic, or poetic form—should read a particular way. My Python training scripts needed adjusting to make my self-miming language model more faithful to my voice, tone, and the themes of my…

… read more