Topics
previous
AI
Amazon
Image Credits:Poetry Camera(opens in a new window)
Apps
Biotech & Health
Climate
Image Credits:Poetry Camera(opens in a new window)
Cloud Computing
Commerce
Crypto
Ryan Mather and Kelin Carolyn Zhang in an interview with your correspondent.Image Credits:Screenshot from Zoom
initiative
EVs
Fintech
The poem generated and printed by Poetry Camera (transcribed below).Image Credits:Poetry Camera
Fundraising
Gadgets
Gaming
Another sample poem.Image Credits:Poetry Camera
Government & Policy
computer hardware
Another sample poem, with, in the background, the person who inspired it.Image Credits:Poetry Camera
Layoffs
Media & Entertainment
Meta
Microsoft
Privacy
Robotics
Security
Social
Space
Startups
TikTok
transit
Venture
More from TechCrunch
Events
Startup Battlefield
StrictlyVC
Podcasts
Videos
Partner Content
TechCrunch Brand Studio
Crunchboard
Contact Us
Have you ever stood in front of a redwood and wondered , “ Would n’t it be great if this was verse instead of a tree diagram ? ” Neither didJoyce Kilmer . Kelin Carolyn Zhang and Ryan Mather , however , have set out to bridge the gap between AI tech and poetry with their captivating inspiration — thePoetry Camera . The overt source twist combines carving - border engineering with artistic vision , leave in a conception that pushes the edge of both fields .
At first glance , the Poetry Camera seems like another widget in the ever - evolving landscape of digital devices . However , upon snug inspection , it becomes evident that this is no ordinary tv camera . or else of but capturing images , the Poetry Camera assume the concept of picture taking to new heights by generating thought - provoking poetry ( or , well , as thought - provoking as AI poetry can get ) base on the visuals it take on .
Zhang and Mather , the masterminds behind this project , have seamlessly blended their expertise in applied science and art to create a technically impressive and aesthetically beguile equipment .
The story of the Poetry Camera began as a personal love project for Zhang and Mather , who found themselves captivated by the mind of merging their love for technology with their appreciation for the arts . In the former stages of development , they spend countless hours tinkering with various components and experimenting with different AI models to bring their visual sense to life .
“ The project ’s line is when I get admission to GPT-3 . My first instinct was to play Dungeons & Dragons with it because I ’m a nerd . I figured ‘ if this thing could play Dungeons & Dragons , that would be impressive . ’ And yeah , it did work for that . This was back when you had to do prompt engineering . So it took some elbow grease to get it to work . But I also had this idea of maybe make some photographic camera as a project , ” says Mather . “ What if you took a camera , but it was a reaction to Instagram culture ? What if text comes out instead of a photograph ? … Everyone prefers the Quran reading over the movie , so it ’s like that for capturing moments . ”
As they polish their prototype , Zhang and Mather began to share their creation with friends and family unit at societal gatherings . The reactions they received were nothing short of astonishing . hoi polloi were fascinate by the concept of a camera that could generate poesy base on what it visit . The twist quick became the substance of attention , trigger off lively discussions and ignite the imagination of all who meet it .
These initial reaction were a powerful motivator for Zhang and Mather to remain refining their invention . They actualise that the Poetry Camera had the potential difference to bridge the interruption between engineering and art in a way that resonated with multitude . As word of the Poetry Camera spread , the twain were inundated with inquiry from funny individuals eager to experience the machine for themselves . This interest led them to consider the possible action of transform their task into a possible commercial product , making the magic of the Poetry Camera accessible to a broader audience .
Join us at TechCrunch Sessions: AI
Exhibit at TechCrunch Sessions: AI
The tech
At the centre of this innovative equipment lies a Raspberry Pi , a credit add-in - sized individual - board computer that bundle a muscular puncher . This tiny yet mighty component serves as the mind of the Poetry Camera , enable it to capture image and convey with OpenAI ’s GPT-4 to generate poetry .
A Raspberry Pi get the ikon and then employs computing equipment vision algorithms to analyze the visual data . The AI models then render the image , identifying key constituent , colors , traffic pattern and emotions within the frame . This entropy serve as the founding for the poetry - generation process .
Zhang point the camera at our Zoom interview :
And out come a poem :
Behind the lens , a gentleman adjust his gaze , Within the square confines of pixel space . Zoomed in on faces domiciliate in practical place , Long since departed the rat race .
day filters through wither sheers , In his bridge player , lukewarm chocolate lead . Conversations drift , across virtual frontier , His reflection mirror , in the screen appears .
On the ledge , books lean , silent chatter , A thriving plant , the only living matter . With glasses perched , home becomes his quiet batter , Within this walls , his man disperse .
In this 2024 April morn , A fresh normality , quietly worn .
A poem by@poetry.camera
Zhang theorise that the reference to “ pull up stakes from the rat race ” is a reference to my Hawaiian shirt .
The artificer tell me that the Poetry Camera ’s output is not restrain to a individual format . Because the twist is subject generator , user can choose from various poetic forms — such as haiku , sonnet or free verse — depending on their preferences and ability and willingness to get involved with the source computer code .
As the Poetry Camera continues to develop , Zhang and Mather are exploring fresh ways to heighten its capableness . They constantly rarify and select the AI models , expand the twist ’s prompts and experimentation with advanced innate language processing proficiency . The destination is to make a machine that generates poetry and lease in meaningful dialogue with substance abuser , nurture a mysterious connection between technology and the arts .
The intersection of art and technology
The Poetry Camera service as a testament to the incredible voltage at the crossway of art and technology . By harnessing the power of AI and machine learning , Zhang and Mather have created a gimmick that not only captures the beauty of the world around us but also translate it in a way that can be astonishingly touching . As technology , it ’s unsubdivided , but I get laid how accessible Poetry Camera make thing . It becomes so easy to dare to daydream and push the boundaries of what technology can accomplish .
Screens command our daily lives ; the Poetry Camera offers a refreshing departure from the average . Rather than trust on a digital show to showcase its poetic outputs , the machine employs a more tactile and immersive method acting of interaction . The mother verse form are printed on theme , creating a physical incarnation of the artistic experience . The temporary nature of the art gets taken pretty far with Poetry Camera .
“ We do n’t save any of the images or the poem digitally . There are a few reason for that : One , it ’s easygoing . Two : privacy . Three , it adds extra meaning to the poems if they ’re like these ephemeral sorts of artifact . If you lose it , it ’s go , ” Mather explains . “ Everyone has a camera in their air pocket through their cell phone now — we wanted to do something very different . ”
We ’ve regard new UIs with products like Plaud and the Humane Ai Pin — and this twist continues in the same vein . It allows drug user to disconnect from the constant barrage of visual stimulation and occupy with the Poetry Camera ’s instauration in a more mindful and meditative manner . Not to get all artistic creation bookman , but the visceral experience of holding a printed poem in my mitt is an invitation to contemplate on the Holy Scripture , revalue the knockout of the nomenclature and form a deeper connection with the artwork .
The design philosophy draw out beyond the machine , tempt the entire drug user experience . Zhang and Mather have carefully craft the Poetry Camera to nurture a sensation of wonder and discovery . Capturing an image , waiting for the AI to generate a poem and then incur the print output creates a sense of anticipation and surprise , enhancing the overall engagement with the gimmick .
A reflection of the future of AI and personal computing
Zhang and Mather ’s design philosophy for the Poetry Camera reflect their broader vision for the future of personal computer science and AI . They believe applied science should be seamlessly incorporate into our daily lives , enhance our experience without overwhelming us with constant stimuli . By creating a machine that prioritise simpleness and esthetic expression , they are dispute the status quo and paving the direction for a new era of technology .
“ I think poetry camera are a microcosm of what will happen to many industries with AI . Poetry cameras are unlike a traditional discipline : You never met someone who say , ‘ Oh , I ’m a poetry lensman for incarnate events , ’ laugh Zhang . Poetry Cameras are in between this established field of photography and poetry . It is this new , eldritch matter . Most importantly , watch people interact with them is enjoyable : mass discover childlike pleasure in their playful persona . ”
What’s next?
As the Poetry Camera continues to captivate audiences and render buzz , Zhang and Mather are cautiously considering the future of their advanced creation . While the gadget start as a personal mania task , the overwhelmingly positivistic response has direct them to explore the possibility of making it commercially available to a broader hearing .
“ After the first 100 times mass asked , we aver , ‘ We ’re not sell it , ’ but after 101 questions , we started believe about it in more detail , inquire if we should be make it uncommitted to people , ” Zhang contemplates . “ But at the same fourth dimension , it ’s an art project , you sleep with ? Our initial reception was to leave capitalist economy out of it . ”
However , true to their dedication to sustainability and aware consumption , Zhang and Mather are engage time before rushing into mass production . Instead , they are taking a more deliberate coming , with the electric potential for circumscribed intersection drop that prioritize quality over quantity . By carefully controlling the production process , they aim to ensure that each Poetry Camera is crafted with the utmost attention to item and satisfy their in high spirits standards for performance and durability .
I challenged the squad on get to grease one’s palms a hardware product : Phones have cameras , internet connections and screens . Would n’t it be more sustainable to use hardware that already exists ?
“ The most sustainable thing would be not to make anything at all , ” Zhang fit . “ But we ab initio set out this asan open source DIY project , and we had all the instructions online ; it was just that it ’s hard for people to gather all the different parts needed . Initially , we played with the idea of creating a composition board natural enclosure . But I ’ve notice that part of what construct masses love and want to act with it is the kind of Poké lump - polished intersection aesthetic . I think that for the Poetry Camera to come in awake in its fullest form , it should be a milled - looking product . I do n’t know how to approach it with sustainability in intellect , but it ’s important to us . ”
appear forward , Zhang and Mather envision a future where the Poetry Camera is not just a novelty machine but is also a accelerator for change in how we interact with engineering and art . They hope their creative activity will revolutionize others to search the convergence of these two fields , pushing the boundaries of what is potential and make young forms of formula .
I bed living in a world where enthusiastic hobbies intersect with art and applied science , and this project fall utterly into that Venn diagram .
“ For me , this uphold to be art because it ’s about expressing . It ’s a fomite for shaping a universe that we require to see , which is a world where people can toy with this young engineering : AI is not all doom and gloom . And it ’s not just about AI mimicking world in a deeper , quicker and worse way , ” concludes Zhang . “ It ’s about making something alone new with its new technology and fetch out that inner child again . For this undertaking , it ’s not about making money — it ’s about making that childish admiration possible again . ”
If you need a closer aspect at the camera in action , TikTok seems to be the best resourcefulness .
