Google Meet rolls out multi-device adaptive audio merging

by tfshon 5/26/2024, 3:22 PMwith 268 comments

by crazygringoon 5/26/2024, 6:17 PM

I just want to say that this is really actually kind of mind-blowing from an audio engineering perspective.

Outputting audio from multiple laptops in the same room is easy. Perfectly syncing it is harder. Implementing echo cancellation across all of that is quite a bit trickier than regular single-device echo cancellation.

But then treating all the laptop microphones as a kind of microphone array, having to deal with sync issues and phase issues and background noise issues... that's hard core.

Kudos to the engineering team on this one. This is actually pretty amazing.

by neviron 5/26/2024, 4:40 PM

Meet, to me, is the perfect balance of functionality and simplicity (as an end user). And features like this only make that more apparent.

Zoom and Teams always frustrate me, even though they're what I use far more often.

It's too bad that video conferencing is largely a game of who has the most boxes checked - IT admins and A/V folk are the ones that need to be convinced, and Meet just doesn't ...meet... their needs

by pachicoon 5/26/2024, 5:12 PM

GitLab offers a nice course about transitioning to remote work. One of the items in their guidelines about online meeting is not having hybrid meetings. This is, all those attending must attend from their own device rather than the meeting room one (see Jabra) precisely for the reasons this feature tries to address.

by indymikeon 5/26/2024, 5:09 PM

I just exited my startup and now work for a much bigger company. I'm going from a Google-based productivity stack to a Microsoft one, and so far Teams is the worst and best change. Google Meet was fantastic for "just working" especially for less sophisticated meeting guests. The only time Meet didn't work is when corporate IT departments at customers actively blocked Meet so their minions used the "approved meeting solution".

As far as Teams vs. Meet, it seems like Teams is great when you are working with people that have climbed it's learning curve. Teams is also filled with UX paths where it takes one or two extra clicks (and thoughts) to do simple things like share a file.

by nh2on 5/26/2024, 6:50 PM

I want a simpler feature:

Auto-detect people not using headphones, and prevent them from speaking. Until they put some one.

Ideally showing them some customisable scolding message.

So far, any feedback / echo cancellation I've encountered just makes everybody's life miserable. Degradation to non-duplex voice (because all except the loudest speaker are attenuated down), "seaside noise" effect", etc.

This is the reason why a phone call over GSM or landline still often "feels" better than any HD video call with people on screens: Low-latency duplex audio.

Most* of this goes away if you just wear headphones.

Maybe this can be fixed by making the algorithm way more complicated, as the announced feature does. But I'd be surprised.

[*]: "Most": 2 people with headphones sitting near each other still cause echoes for each other and other participants. Fixing that is truly novel, and needed even for headphone users.

by pcxon 5/26/2024, 4:51 PM

Kudos to Meet team for supporting this! In the video conf world, where most problems are well solved, this is such an amazing feature to differentiate and be customer first!

by madispon 5/26/2024, 4:56 PM

Sadly this is feature-gated behind Gemini :/

> Available for Google Workspace customers with the Gemini Enterprise, Gemini Business, Gemini Education, Gemini Education Premium, and the AI Meetings and Messaging add-on.

by ravon 5/26/2024, 5:10 PM

Meet is nice and nicer than Teams and Zoom in my opinion, but for 1-on-1 pair programming I think Facebook Messenger actually has the best experience - when you're on the same screen resolution, the screen sharing is 100% zoom (unlike Meet which has padding around the edges), and you can move seamlessly between mobile and desktop (i.e. answer a video call on mobile, the other party sets up screen sharing, and you go to a laptop to continue the call). Too bad I'm not automatically Facebook friends with all my co-workers!

by robbyiq999on 5/27/2024, 4:02 AM

What if the resulting audio output of the digitally converted human vocalization has an inaudible frequency modulation or signature added to it which operates in a range inaudible to the human ear, you could then detect said signal and filtered out its source or merged / manipulated

Now fixing search, that would be truly mind blowing.

by foreigneron 5/26/2024, 4:39 PM

Do any of the video call services support full duplex audio? It feels so stifling to have to be perfectly silent while others are speaking, compared to the give and take of a normal conversation.

by dtx1on 5/26/2024, 6:06 PM

We use google meet internally where i work but i often have to work with external companies using teams, zoom and whatever else. Google Meet just works, all day, everyday for us (barring a fucked up client audio setup...) and this is such a sweet feature we've struggled with, I genuinely look forward to testing this

by nickpsecurityon 5/26/2024, 6:17 PM

Another advantage of Meet that it is under U.S. control and law. Zoom out their development team in China. That country actively targets dissidents. It’s easier when those controlling the software are easy for them to control.

Better to use Meet than Zoom if the Chinese are in your threat profile or a larger threat.

by Docksonon 5/27/2024, 6:25 AM

I'm surprised no one here has mentioned around.co yet. They've had this feature for years which was the main reason our team has been using it. Good to see other services catching up.

by pquki4on 5/26/2024, 5:41 PM

My company has conference rooms that have specialized hardware for Microsoft Teams meetings. The audio really sucks -- everyone must project their voice for people joining online to hear. If someone speaks in a low voice, nothing can be heard on Teams even though it is clear enough for people in the room. I don't understand how we haven't solved this problem yet.

The functionality here seems interesting, but I assume only works well if everyone or almost everyone brings a laptop. It probably won't work well for those situations where only one or two people take their laptops to an in-person meeting.

by 7ewison 5/26/2024, 9:43 PM

I had the opportunity to try this last month, it worked really well!

by sirjazon 5/27/2024, 1:03 AM

But when will Google roll out a stand alone app for meet on Windows and MacOS? It couldn't be that hard and it would have better performance then running in the browser.

by echelonon 5/26/2024, 4:49 PM

Meet and Google Docs are perfect Google products.

I'm disapponted when people send me Zoom meetings or want to meet on Slack. Google Meet is a 10x better experience.

by dansimauon 5/26/2024, 5:25 PM

I've always thought it would be nice if microphones can be merged when on a phone call with AirPods in. The mics in those headphones are really far away from my face and when it's windy talking on them is almost impossible. It would be nice to be able to just talk into the mic on my phone. Then the phone could boost my voice from multiple mics and filter out background noise.

by andaion 5/26/2024, 5:43 PM

Sounds imprrssive, but also overengineered? Don't headphones solve the same problem?

Though I guess in a hybrid meeting they'd make it harder to hear the people in the room. (But you'd hear them through the laptop, normally? I guess there would be an uncanny delay...)

by sMarsIntruderon 5/26/2024, 5:33 PM

Available for Google Workspace customers with the Gemini Enterprise, Gemini Business, Gemini Education, Gemini Education Premium, and the AI Meetings and Messaging add-on.

So basically unaffordable for most organisations.

by perryizgr8on 5/27/2024, 2:09 AM

> Available for Google Workspace customers with the Gemini Enterprise, Gemini Business, Gemini Education, Gemini Education Premium, and the AI Meetings and Messaging add-on.

What does this mean?

by noduermeon 5/27/2024, 1:37 AM

Odd. Today I was on a Meet with my girlfriend and her audio kept dropping to silence when she would put the phone down and walk around the kitchen. If she spoke loudly enough it would cut back in. As if it was waiting to recognize voice versus ambient noise.

We use Meet a lot, and I'd never noticed that happening before and wondered if it was due to some setting.

by anotheryouon 5/26/2024, 6:28 PM

Surround sound from the speakers next :)?

I however think (emulated) stereo sound and low latency would do wonders. Sadly this feature here will only introduce latency.

Feedback cancellation for external speakers would also be amazing, so you can get rid of your headphones at home. Close up mic and noise gate works, but is fiddly (and no easy noise gate and compressor on linux...)

by Brajeshwaron 5/27/2024, 1:42 AM

A bit off-topic but I'm going to take this opportunity to ask for help. In Zoom, I can share multiple screens/windows at once by CMD + Selecting multiple windows. How do I do that in Google Meet. I want to do a presentation and I want to show/share two separate screens/windows (not monitors) at once.

by ghostpepperon 5/26/2024, 10:34 PM

Maybe the next feature they can work on is allowing multiple people to speak simultaneously

by pachicoon 5/26/2024, 5:07 PM

Am I the only one surprised that they keep using this blog style as it was 2005?

by opdahlon 5/26/2024, 5:40 PM

This amazing news for my hybrid team. It has always been a struggle figuring out with laptop to use, moving around so you get closer to the mic etc. Hopefully it is as seamless as they portray it here in the blog.

by andy_pppon 5/27/2024, 6:35 AM

I’ve thought about why you couldn’t do this forever! Amazing technology but I always thought multiple audio input should be able to make a room a better source not worse and full of feedback.

by urbandw311eron 5/27/2024, 7:48 AM

Fantastic idea. This is the first actually useful (as in “step change useful”, not just “here’s another way of browsing your cat photos”) feature I’ve seen from Google in years.

by heetonon 5/27/2024, 1:30 PM

Question: hasn't around.co been doing this for years?

I remember using that tool in 2022 or so, multiple people in a room with this kind of audio sync / cancellation.

by gcron 5/27/2024, 12:39 PM

If this works externally anywhere close to as well as it worked internally, this is going to be incredibly cool.

by notatoadon 5/26/2024, 6:27 PM

does this mean that when a new person joins a meeting that isn't on mute by default, we won't have to deal with the echos from everybody else in the office while they scramble to find the mute button?

because that sounds amazing

by alberthon 5/26/2024, 9:44 PM

If this works, I really hope it comes to both Teams & Zoom as well.

by deepak_sozialon 5/26/2024, 6:52 PM

Will this work on Google Workspace Business Starter plans?

by moomoo11on 5/26/2024, 5:17 PM

Meet is nice, but could the screen sharing view just please take 100% height/width?

I hate that I have to always manually tweak it through dev tools to make it usable.

How many 400k TC engineers and misguided product managers does it take to make that change? FFS

by ClassyJacketon 5/27/2024, 1:54 AM

Google Meet? They made another one? I can't keep up. Is this a replacement for Hangouts? Allo? Duo? This is so confusing.

by pawelwentpawelon 5/26/2024, 5:02 PM

Do other platforms already provide something similar? While I've been picking up calls mostly in meeting / silent rooms (times of gathering around a jabra like a camping bonfire are fortunately gone for now) - some of the users of a platform that I've built (https://flat.social) would occasionally experience the atrocious feedback whistle while being in physical proximity.

by user3939382on 5/27/2024, 2:13 PM

I want to be able to customize a route in desktop Google Maps and send it to my phone.

by bagelson 5/26/2024, 4:37 PM

I'm more interested in cancelling regular feedback from one laptop in the meeting.

by shartson 5/26/2024, 6:05 PM

It took this many years to get echo cancellation implemented? Many other services had this like a decade ago.

by krashidovon 5/26/2024, 6:19 PM

The fact that you can't easily go full screen on Meets is bizarre. Makes it a non-starter for pairing. Also, the dedicated app's session lasts for like a day which makes it useless, so I'm stuck having to scroll through my 3 chrome windows and 40 tabs to see where my meets tab is. Although I'm sure the session timeout is some sort of gsuite configuration

by hugocbpon 5/27/2024, 2:07 PM

Amazing!

I don't trust Google with barely anything these days anymore (except Gmail just because it has been so long, and Maps), but Google Meet is the one thing that I prefer Google's solution over anyone else's.

Meet is just so much better than Zoom, Teams, FaceTime, WhatsApp Video, etc.

I'm so glad they are tackling this specific issue. Pretty amazing feat if it works well.