Say cheese, write a Haiku with the Poetry Camera

The Poetry Camera, developed by innovators Kelin Carolyn Zhang and Ryan Mather, mimics the design of a traditional Polaroid camera while integrating the capabilities of AI. Utilizing OpenAI’s GPT-4—the technology also used in ChatGPT Plus—this open-source device creatively crafts poems from the images it takes, offering poetic renditions of the captured scenes.

Zhang and Mather ingeniously merged their artistic and technological prowess, creating a device that transcends conventional boundaries.

The project’s origin is when I got access to GPT-3,” Mather told TechCrunch. “What if you took a camera, but it was a reaction to Instagram culture? What if text comes out instead of a photo,” Mather added.

The Poetry Camera, being open-source, empowers users to experiment with different poetic styles including haikus, sonnets, and free verse, depending on their inclination and familiarity with coding. It operates on a Raspberry Pi, a compact single-board computer that processes visual input to discern essential details, patterns, colors, and emotional tones within the images.

Mather emphasized to TechCrunch that the camera is designed to respect user privacy, not storing any images or poems digitally, thus underscoring the ephemeral nature of its creations.

This unique project caught the eye of many when Zhang and Mather showcased it at various social events among friends and relatives. The Poetry Camera not only bridges the divide between technology and art but also stimulates vibrant conversations and sparks the imaginations of those who interact with it.

Discussing its broader impact, Zhang remarked: “I think poetry cameras are a microcosm of what will happen to many industries with AI. Poetry cameras are unlike a traditional discipline: You never met someone who says, ‘Oh, I’m a poetry photographer for corporate events,’ laughs Zhang. Poetry Cameras are in between this established field of photography and poetry. It is this new, weird thing. Most importantly, watching people interact with them is enjoyable: People find childlike joy in their playful persona.”

Meta wants to change how you see the world with AI

Originally a personal endeavor, the Poetry Camera’s surge in popularity on social media has prompted Zhang and Mather to explore its commercial viability. They are contemplating selective releases that focus on maintaining high-quality standards rather than mass production.

Looking ahead, Zhang and Mather see the Poetry Camera as both a unique gadget and an agent of change in the interaction between technology and art. They aspire for their invention to encourage others to delve into the convergence of these domains, expanding the limits of creativity and fostering innovative expressions.

You can find videos on tikTok that show how Poetry Camera works:

We took postry camera (by @kelin and I) to our friend Kassia’s studio in LA! We’re fascinated with how different kinds of artists and creatives interpret it differently and bring their own unique flavor to the project. You can check out Kassia’s work at Giant Robot if you’re local! Poetry Camera is a device Kelin and I created that turns images it sees into poems. The images are not stored so the only artifact that remains is the poem. If you’re interested in buying a kit to make your own, you can sign up for our mailing list at https://poetry.camera , we may do a kickstarter! #ai #art #poetry #mediaart #design #photography

♬ Cena Engraçada e Inusitada de 3 Minutos – HarmonicoHCO

Featured image credit: Poetry Camera