I’ve recently joked that I’m old enough to know it’s a foolish endeavor and will likely fail, but I’m still young enough to think I can do it anyway. And that’s how LitRPG Adventures was born. I simply gave it two examples of what I wanted, and it was able to figure out the rest. Unlike my work with GPT-2, I wasn’t using fine-tuning on GPT-3 at all. I quickly got to work, putting together a very rough examples. I stumbled across her blog post while researching during my experiments with a character backstory generator of my own using GPT-2.Īfter emailing Greg Brockman at OpenAI and explaining what I’d been working on and asking for access to the GPT-3 API beta, I was surprised to find out I was accepted. She used a dataset supplied by her readers. I didn’t get access right away, but I emailed with a detailed plan of how I’d been using GPT-2, and how I would like to use GPT-3.Ĭheck out my DND Backstory Generator made with the latest, greatest AI.Ī couple years ago, Janelle Shane wrote about using an RNN (recurrent neural net) to create D&D character backstories. After many hours of fine-tuning the 775m model, I began to see some interesting results. My personal journey with GPT-3 began back in February as I used the previous model (GPT-2) to create D&D character backstories. This is known as two-shot learning, by the way. Because I’m using a general model (Davinci) that is not fine-tuned (yet), I have to give GPT-3 two examples for it to output something decent. ![]() Using what’s coming to be known as “prompt engineering,” I have coaxed GPT-3 to deliver character backstories, spells, skills, creatures, dungeons, cities, shops, and more. As a result, it’s very good at generating new content that’s similar to existing works. GPT-3 was trained on an enormous amount of fantasy and sci-fi content. It can generate whole sentences with this method. GPT-3 takes a sequence of characters as input and produces the next character in the sequence as output. OpenAI GPT-3 is a state-of-the-art generative text model. ![]() In this post I’ll share my experience and outline what I learned. It has been an amazing and encouraging experience. Since then, I’ve built a set of twelve fantasy RPG content generators. Earlier this summer, I got access to GPT-3 API from OpenAI.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |