Browsed by
Category: Art+Design

AI generated short films using LTX Studio

AI generated short films using LTX Studio

AI video platform LTX Studio is now open for users to get stuck in and make short films, storyboards and other generative productions all from a simple text prompt. Simply type the film idea or a full synopsis of your desired creation and then set the visual aesthetic, aspect ratio, inspiration and your virtual casting for a selection of AI generated characters.

It utilizes dozens of AI models to generate the script, add voice narration, background music, sound effects, and generate the image and video elements.

Other AI video tools create more realistic video, speech tools with more realistic speech and lip sync available in both Pika Labs and Runway — but for each of those you still have to make a series of short clips and they have poor character consistency.

It has a lot of limitations; but it absolutely could be used for previsualization and concept pieces.

Articles:

Generating a music video from a text prompt

Generating a music video from a text prompt

Sora is an artificial intelligence video generator that is capable of producing multi-shot clips of a minute or longer from nothing more than a text prompt — but so far only a select few have used it to create content. OpenAI is working on security issues and slowly rolling it out this year.

One of the artists given early access to Sora is August Kamp, a musician, researcher and creative activist. She described Sora as representing a “turning point” for artists as it means the only limitation on visuals is the human imagination. 

“Taking these pictures that I’ve held onto [in my mind] for two years and saying ‘August – we can share these with folks’. that’s what I think is special about this tool,” she said.

Article:

‘Photo’ Was Made From an 84-Year-Old Woman’s Memory using prompt engineer

‘Photo’ Was Made From an 84-Year-Old Woman’s Memory using prompt engineer

An interviewer and a prompt engineer will sit down with the subject whose memory they are trying to retrieve, as the person recalls a specific event or place the promptographer will input the descriptions into an AI image generator and what follows is a bit of back and forth to get the image right.

“You show the image generated from that prompt to the subject and they might say, ‘Oh, the chair was on that side’ or ‘It was at night, not in the day’,” explains Garcia. “You refine it until you get it to a point where it clicks.”

It’s more like guided painting/drawing of a scene from a description – but using generative AI to do the work is pretty unique.

The team recently worked with an 84-year-old woman from Barcelona called Maria. Maria has vivid memories of peering out from her balcony as a child to try and catch a glimpse of her father who was incarcerated in a prison opposite where they lived.

These childhood memories only existed inside Maria’s mind, but the AI researchers worked with her to bring these reminisces to life by describing the place and the historical context (Maria’s father had been jailed by General Franco).

“It’s very easy to see when you’ve got the memory right because there is a very visceral reaction,” Pau Garcia, founder of Domestic Data Streamers, tells MIT Reivew. “It happens every time. It’s like, ‘Oh! Yes! It was like that!’”

AI image from the Spanish Civil War was co-created by a 90-year-old woman called Nuria who vividly remembers men waiting outside bomb shelters with shovels and picks ready to rescue anyone trapped inside.

It’s not as complex as previous methods of reconstructing images from brain scans, but it’s an interesting approach.

Articles:

Catholic Shops for 2024

Catholic Shops for 2024

I was recently looking for good baptism gifts for an adult joining the church.

Transparent LCD’s

Transparent LCD’s

LG OLED Signature T announced at CES it is going to be the first commercially available transparent TV. It definitely could add a lot to minimalist living spaces. Samsung, not to be outdone, introduced its micro-LED display technology which seems to deliver an even brighter, better image.

Transparent OLED and LCD screens have around for a while – in fact, you’re probably using one. People were making cool transparent panels by taking a standard backlit LCD, remove the LCD antiglare coating, do a little wiring, then put a lot of light behind it.

LG also has large transparent OLEG signage as well.

Personally, I don’t think just making a standard TV out of a transparent display is understanding what new things are possible with this technology. The Verge review even points out that the tv came with a movable backing screen that slid behind it to help it act more like a traditional TV – so why go transparent? I personally think this opens up a lot of new ideas for innovative new products and experiences instead of just being a minimalist TV.

To that point, the LG Dukebox showed up at CES 2024 and is one of the first devices to make use of a transparent LCD as part of the product design. It’s essentially a re-imagined jukebox. You get to see the internals of the system while the user interface is displayed on the transparent display.

While a good start, I can think of a number of interesting new products that simply COULDN’T really be made in other ways than using a transparent display. Those are the kinds of product ideas that I think are ripe for this kind of technology.

DreaMoving – now anyone can dance

DreaMoving – now anyone can dance

I previously wrote about the Everybody Dance Now technology that allows you to take a video of a source dancer and then apply it to a video of a target person.

Now we have text-to-video technology called DreaMoving. You can start with a reference image, type in a description of the kind of moving you want, and get a generated video clip.

Article:

Holodeck flooring

Holodeck flooring

Lanny Smoot is a Disney Research Fellow that is being inducted into the National Inventors Hall of Fame.

Here he is showing off his holo-tile floor that allows multiple people to walk on it in any direction and it automatically keeps you centered on the floor. Definitely something that could be used for VR.

Deep Nostalgia

Deep Nostalgia

MyHeritage Deep Nostalgia is a tool that came out about 3 years ago and can add animation to static faces in your photos to bring life to them. People first tried it on historical images:

Then it became a trend on TikTok to upload images of relatives that have long since died. While it’s not perfect, it brought many to tears to see their loved ones again.

Of course, this can be a double-edged sword. This technology can bring the past to life, but it can also be used to create fake videos of living people.