INFP: Audio-Driven Interactive Head Generation in Dyadic Conversations

by nnxon 12/21/2024, 7:06 AMwith 21 comments

by ilakshon 12/22/2024, 5:32 PM

Amazing.. unfortunately code and data link back to the project page. But amazing research.

by vesseneson 12/22/2024, 7:55 PM

So much grumpiness! This is amazingly cool. The out of band (paintings) look great. Lots of good preemptive facial expressions: people clearing their throats to interrupt.. really awesome.

by yapyapon 12/22/2024, 7:03 PM

haha wow they’ll stop at nothing to sell this “agent” crap in generative “AI”.

I wonder how many years it’ll take till the VCs // general public finally realize the marketing sham they have fallen for and the bubble will pop.

Nevertheless, cool project in theory but they say

“Imagine having a conversation with a socially intelligent agent. It can attentively listen to your words and offer visual and linguistic feedback promptly. This seamless interaction allows for multiple rounds of conversation to flow smoothly and naturally. In pursuit of actualizing it, we propose INFP, a novel audio-driven head generation framework for dyadic interaction.”

Do people actually hold conversations with chatbots enough to make this a viable thing? I know this is just the code but it is made by ByteDance so they definitely have a monetary incentive to make it and of course want a ROI, 1. do enough people hold conversations with bots to make this worthwhile and 2. are these hypothetical people okay?

by from-niblyon 12/22/2024, 5:14 PM

Invoking Cunningham's Law. I just don't see the usecase for this. Like what are humans fundamentally missing that this is solving?

Pumping out more content faster? I can't even fathom a world where even more content is pumped out.

Avatar video calls? Just turn your video off if you are going to do that I don't need to talk to a puppet I want to talk to you.

Scams, misinformation campaigns, sucking lonely people down an even more lonely hole?

This feels past making a better mousetrap and into making a better window breaker.

by Y_Yon 12/22/2024, 7:43 PM

If only there was another term for "dyadic conversations", like "dialogues".

by mklon 12/22/2024, 7:37 PM

Unfortunate choice of name. If you search for you'll get a crap ton of Myers-Briggs pseudoscience (https://en.wikipedia.org/wiki/Myers%E2%80%93Briggs_Type_Indi...).

by uprootdevon 12/22/2024, 7:42 PM

I thought this was about the INFP personality type.