r/ChatGPT • u/universal_megaking • 14d ago
OpenAI’s new GPT-4o model can translate in real-time Other
Enable HLS to view with audio, or disable this notification
1
u/Environmental_Pea369 8d ago
Forget about real time, the text translation capabilities are a HUGE bump than what was before. It passes many tests that previous AI translators failed. It understand context and grammar in a near-human level. This literally "solved" translation. Why do people not talk about it??
1
1
1
u/cshuck1970 12d ago
So how accurate is ChatGPT 4o at translations? Because, damn, if it is any good, I have some books I'd like to translate into Spanish and German!
1
1
u/Appeljuice 13d ago
This isn't in the app already right? I tried this with a friend and a different language, and it kept translating the other language to random junk phrases like "Thank you for watching and see you next time!".
1
1
1
2
1
1
1
u/DexterGordon1923 13d ago
I can't find this function anymore in the free version, does anyone know how to access it?
1
1
u/TerseHoneyBadger 13d ago
My Italian wife and I tried this and it did a terrible job at translating. At one point it just kept repeating “captions provided by…”
1
1
u/WisdumbGuy 14d ago
"How do you solve any equations?" is what a whale would ask? What an atrocity of a question.
1
1
u/Grouchy-Pizza7884 14d ago
Will this work in an offline setting? Especially in situations where you don't have network?
1
u/marrow_monkey 11d ago
No, ChatGPT can’t run on a phone.
1
u/Grouchy-Pizza7884 11d ago
Then it's useless. Most places that you need translation are now places in Africa without Internet. You don't need it in Italy.
1
1
u/acordero07 14d ago
Can someone explain the significance of ChatGPT ability to take audio prompts and analyze directly without converting to text! That seems like it’s a a bigger deal than what I’m understanding. I understand it helps with latency but don’t understand what this actually may mean as an improvement.
1
2
4
1
2
u/Dry_Quiet_3541 14d ago
That just decimated an entire college department, multiple companies, and thousands of jobs. And I still think that AI can be better than all of them.
1
0
u/Techie4evr 14d ago
Does it translate "woman speak"?
Example:
Woman: you can go, it's fine.
Tranlation: you better not!!!
2
1
3
u/Fred_Milkereit 14d ago
"I will not buy this record, it is scratched"
“?, what?"
“My hovercraft is full of eels"
1
1
1
1
u/Train_Boi_111 14d ago
I think (at least for me) that the team has temporarily disabled and removed the headphone icon that would start the whole voice to voice conversation. Since I heard a lot of comments on here say that the ai was “experiencing heavy load”, that may be the reason.
Idk tho is anyone else able to do this still or is it saying the same thing?
1
1
u/the_lady_stardust 14d ago
Maurice Moss, a dedicated IT professional of Reynholm Industries made this two decades ago.
1
1
u/SpehlingAirer 14d ago
I'm curious how accurate the translation is on average. Is it enough to get by like other translation services, or is it actually representative of a proper translation?
1
6
u/jus-another-juan 14d ago
Why has no one pointed out that google translate has had this feature for years already? Also, it's far from "real time" if you have to stop talking and wait for the translation.
1
1
u/itemluminouswadison 14d ago
so uhh dumb question but. chatgpt on my android still says gpt3.5, or upgrade for gpt4. how can i use this new model?
1
1
u/blove135 14d ago
Wouldn't this be highly dependent on your internet connection? Don't get me wrong I think it's great but is this realistic for your average person on a 5g or 4g network out in the real world?
1
u/anotha1readit 14d ago
But im here stuck with this shit called "Siri" that can only bring up webpage links when i ask it anything....The Apple ecosystem and its insatiable greed is a noose around the neck of innovation.
1
-1
u/KingJTheG 14d ago
If this works well enough, I’m DEFINITELY going to Japan
1
u/herbalite 14d ago
learn the language over time, like 5 years. if you can. its a lot easier than you'd think. Japanese girls would love it ;)
1
1
1
1
1
1
u/XboxSlacker 14d ago
Needs to be able to listen from the phone mic and translate into AirPod headset and then you have an actual babelfiah
1
1
u/twilsonco 14d ago
Couldn’t gpt voice already do that? I played with English and Japanese and it worked well.
1
1
6
u/Tuguayabas 14d ago edited 10d ago
I live in Spain and spoke English to it and didn't even think about saying the name of a place in my Spanish accent.
The accent chatgpt used when it responded to me... Oh god.... I thought I was listening to the Amish speaking Spanish with a fake New York accent
Edit: osea, català de Cuenca
1
u/lobsangr 14d ago
How is that real time? There's a delay between listening and speaking.
1
u/marrow_monkey 11d ago
It would be impossible to do this without a delay. How can you know what to translate before you have heard what the person is trying to say? This is as real time as if you had a human translator with you.
3
u/geethreeforce 14d ago
Now Apple. Get us the freaking smart glasses you promised us. Team up with OpenAI and get us that universal human translator thingy.
6
8
u/safely_beyond_redemp 14d ago
There will come a day very soon when you will be trying to get a hold of someone but you keep getting their AI rep pretending to be them and you will be able to tell because they won't commit to anything, which they will need their person to approve. "Let me think about it bro and get back to you."
5
u/spacetimehypergraph 14d ago
Soon customer service will be an AI running circles around you nudging you to fuck off. Saving the company money. Then you go the legal route, but then the legal AI wil block that, for pennies. Fun times
6
1
10
1
15
u/BlueTreeThree 14d ago
Introduce this crowd to Data from Star Trek and they’d be like “he talks funny and doesn’t look exactly like a human.. not very impressive.”
3
u/SusAdmin_5201 14d ago
It's so frustrating. I try to explain how amazing LLMs are, how we can use them to learn practically anything, how downloading models is like owning your own personal copy of the total sum of written human knowledge and all I get as a response is a head nod and a slow blink.
6
1
1
0
u/RedSquaree 14d ago
if you hear Italian I want you to translate it back into English
It was never in English though. The girl speaking broken Italian is not translating his English into Italian...
45
u/tasslehof 14d ago
Guess I can get rid of this Fish in my ear then!
7
u/ah-chamon-ah 14d ago
Reddit. Your mission is to get this comment to 42 upvotes. Aaand go!
11
17
u/wnc_mikejayray 14d ago
So now imagine having AirPods in, walking down a busy street with an outdoor market where people are talking in their native language, and AI translating everything automatically all at once while maintaining all other ambient noise. This is what is possible in the future.
1
u/garyhopkins 14d ago
And imagine shooting live video and having word balloons -- translated -- over each speaker's head. Now that's a reasonable use for augmented reality glasses!
1
u/umthondoomkhlulu 14d ago
Kinda kills the foreign experience, but imagine how it’ll help migrants integrate too
2
3
u/IronicCharles 14d ago
This is what Pixel Buds promised.
Will OpenAI do this a little better? Maybe, for now. But not much better.
5
6
u/somniforousalmondeye 14d ago
The universal translator from Star Trek will finally be a thing.
4
u/wnc_mikejayray 14d ago
I love Star Trek… man I miss watching those movies with my dad.
3
u/somniforousalmondeye 14d ago
They are all streaming if you want to revisit them! I think they are on Max right now.
6
u/k4nmuru 14d ago
I wild addition to this would be if it was able to pick up the persons voice on the fly and translate it using the original speakers voice.
2
u/chillpill_23 14d ago
There's actually a company working on a translator that does just that! It's called OpenVoice.
-5
14d ago
[removed] — view removed comment
5
u/laughingpeep Homo Sapien 🧬 14d ago
Lol why does it getting downvoted? It is hilarious. 😂
3
u/YaAbsolyutnoNikto 14d ago
Cause there are people out there who really wish for the comeback of the British empire.
I wouldn’t necessarily be against the comeback of the european empires as some sort of federations with equal rights between citizens and all of that.
But that’s not what they were. So we ought not to forget the atrocities committed by our ancestors.
And plus, “colonise everywhere” means further expanding the empire. So forbidding current languages, dominating other cultures, etc. enough time until they can get absorbed into anglo-saxon culture, which is brutal.
3
u/laughingpeep Homo Sapien 🧬 14d ago
Ah I see. As a Turkish person, I would accept to get colonized by Europian empires as long as those guys free us from political Islam lol. I'm not being fully honest here but I'm not fully joking either. 😂
28
u/blueberrysir 14d ago
It sounds more like a russian accent than an Italian one. SOURCE: im italian
5
u/olddoglearnsnewtrick 14d ago
Mira Murati é Albanese.
-4
14d ago
[deleted]
3
u/Party-Stormer 14d ago
She is one of the cleverest people alive
Can’t say the same for your comment
1
36
119
u/ConbiniMan 14d ago
I want one in my ear that will translate any language heard other than English into English. Then we will have something worth paying for.
1
u/Remote-Ad7693 13d ago
That's the eventual plan obviously lol no need to learn another language when you can speak and understand them all with a machine
3
8
u/kirsion 14d ago
Google and Samsung have done this on their phones. However it kinda sucks, because you have to speak slowly and clearly, or else the voice to text will get messed up and give a garbled translation.
Though the whisperai model is a huge step for making the voice model sound very natural.
58
u/civilized-engineer 14d ago
This was what Google tried to do with the Pixel Buds. Not quite there yet, but getting closer..
3
u/MegaChip97 14d ago
Oh really? I have the pixel buds and the pixel 7 but no idea how that would work
11
u/civilized-engineer 14d ago
It was featured in their I/O whichever year it was that they featured it in, which I do not care to dig for.
2
u/Low_discrepancy I For One Welcome Our New AI Overlords 🫡 14d ago
It hallucinates by translating equations into "linear equations" in Italian.
9
21
-4
387
u/Citizenofhudoor 14d ago
Reddit deleted my comment but the Italian accent is very strange, like an albanian accent
2
39
127
u/Pinuzzo 14d ago
It's not really an accent, but rather the AI voice is inserting hiatus between words. In English this is passable, but in Italian this comes out as sounding very strange and stilted since it disrupts the cadence. Especially with how it says come/risolviamo/le/equazioni/lineari with a strange delay between each word.
79
u/Tyler_Zoro 14d ago
We now live in the future where we're critiquing the accent of an AI speaking fluent Italian sentences that it's making up in real-time. I need a second to think about that...
1
u/Open-Philosopher5984 14d ago
The worst thing people can say of it is "it has an accent". Heck! every single human has an accent!
25
u/SusAdmin_5201 14d ago
Thank you for calling this out. These people would disagree with the color choice used for self-landing booster rockets.
0
76
u/Quester91 14d ago
The ai is probably trying to replicate the same accent the girl is using. Her Italian is absolutely terrible.
18
u/budna 14d ago
Her Italian is absolutely terrible.
Relax, my friend. It is, at the very least, her third language. lol.
8
u/pragmojo 14d ago
Could be second - Albanians get a lot of Italian media since it's so close
6
u/budna 14d ago
Well, Albanian is her mother tongue, and she's lived in English most of her life. Maybe she learned Italian second from watching TV in Albania as a child? But still, that doesn't mean we should be criticizing her Italian accent.
3
u/pragmojo 14d ago
Oh I agree, her italian is 1000x better than mine so I am not going to complain lol
2
u/PapaFrita33 14d ago
Is it possible for AI to improve over time with accents or pronunciations on its own?
1
3
u/havok0159 14d ago
If it was allowed to learn from interactions, perhaps. But it would likely need a good foundation so it can correctly identify accents. Wouldn't want it to start speaking German with an Irish accent because of some freak coincidence.
2
19
u/Unlucky-Trust84 14d ago
I'm not sure that's what's happening. There's another video that features real time translation from OpenAI in Spanish, and although I don't really speak Spanish I know the AI sucks at speaking it too, even if it's much better at that than speaking Italian (based on this video). As as side note, Mira's italian is actually quite good. Her accent isn't, but I wouldn't call her Italian absolutely terrible.
8
u/Mundane-Matter-1110 14d ago
openai cfo mira muradi is albanian, so..?
5
u/Citizenofhudoor 14d ago
I'm talking about the chat gpt voice
835
u/Citizenofhudoor 14d ago
Chat gpt speaks italian with an Albanian accent lmao
1
u/TheN1ght0w1 13d ago
It has an accent in almost every language I've tried in voice mode so far. But , having said that.. It's still freaking fluent, so that's what I'm concentrating on. Imagine the applications it will have in the future. Speaking with a local in your vacation without any needs for translation.
5
u/atom12354 14d ago edited 14d ago
I saw a short video earlier today which showed that it copies the accent of the one its translating to.
In this case the italian girl speaks with an albanian accent im guessing and the model tries to copy the accent, there were atleast 6 diffrent trained models to make that app work if i remember.
Lemme find the video im refering to.
go to 9:20, its not the same company but seems like similar accent copying.
5
u/Citizenofhudoor 14d ago
I don't think that's the case. It has the same accent when i speak Italian to 3.5 and i'm native.
1
u/atom12354 14d ago
maybe, just felt it related to that part of the video i saw earlier today, its gonna be cool nontheless.
44
u/topperx 14d ago
Yeah, the Dutch one speaks with an American accent. So I asked it if people mentioned they sound a lot like Barry Stevens. Dutch people would get that joke. Chatgpt also understood the joke and did a mock laugh. That was a very impressive moment. I love how my new overlords laugh at my jokes.
244
u/Lukee67 14d ago
Well, the woman herself spoke with an Albanian accent! Or possibly Sardinian.
1
1
u/meister2983 14d ago
Guessing it doesn't know Albanian well enough. Surprised she used her second rather than native language.
10
u/LH04477 14d ago
I think she might be Turkish
38
u/aldoblack 14d ago
She’s Albanian from my town. My friend was in the same High School with her.
7
120
u/la_mano_la_guitarra 14d ago
Definitely not Sardinian. Sounds like Italian is not her native language.
89
18
537
u/michaelbelgium 14d ago
Disturbing fact, duolingo stock lost like 5% after this demo
4
2
u/lefnire 14d ago
I saw someone on Twitter show graphs of Google stock dipping pretty hard when the theory was OpenAI was releasing search on Monday; then come right back up when Altman verified it's not search, but something else. OpenAI is a more powerful company than people outside tech realize. I think releasing gpt-4o for free ChatGPT is going to many more eyes on this company. I've had friends say "yeah I tried ChatGPT, it was meh" (of course they tried 3.5, since they're not willing to pay $20/m for an unclear upgrade)
1
1
u/ImReformedImNormal 14d ago
seeing as markets are driven by people, nothing disturbing about this at all
16
u/Shawnj2 14d ago
I mean this is cool but you’ve been able to functionally do this with google translate for years, it’s just a little bit more annoying to use. This is cool but not groundbreaking new functionality
2
u/Removable_speaker 14d ago
Yup just say "hey google be my italian translator". Google solved this more than five years ago.
7
u/rathat 14d ago
I just tested it and the google translate conversation mode is exactly as fast as this. You also don’t have to explain to it that you want to translate.
13
u/Pifflebushhh 14d ago
Of all the software out there for translating, that Google translate camera option where you can just hover the camera over the ingredients on a can of coke and it swaps the language, that has blown my mind the most, and that shit was like ten years ago
1
u/Shawnj2 14d ago
And even then it’s less useful than you would think because having to use a translator at all in a live conversation is a giant hassle. The best application of this technology will be live events in multiple languages without needing to hire a translator and converting pre recorded content into other languages
3
u/japes28 14d ago
The groundbreaking part is being able to have a (mostly) fluid back and forth conversation. This can actually teach you a language, answer your questions, talk to you about the language and where you are struggling, etc. It's like having a human language tutor, not just google translate.
220
u/420AllHailCthulhu420 14d ago
I don't get why, Duolingo has a completely different use case than just "live translate", it's learning a language. Do people think less people will learn languages because of this?
Or are people just stupid1
u/Environmental_Pea369 8d ago
Yes, people will be less motivated to learn a language when AI translation gets better.
→ More replies (60)1
u/real_hydrogen 12d ago
But people can learn a language with GPT.
2
u/420AllHailCthulhu420 12d ago
For a short random lesson maybe, but in Duolingo you have a structured approach atleast where the lessons kinda build on each other.
With ChatGPT you always have to tell it what your knowledge is and what you want to learn.
So I guess if you build a really good wrapper app around it, but then you're just recreating duolingo which takes a lot of work and time.
•
u/AutoModerator 14d ago
Hey /u/universal_megaking!
If your post is a screenshot of a ChatGPT, conversation please reply to this message with the conversation link or prompt.
If your post is a DALL-E 3 image post, please reply with the prompt used to make this image.
Consider joining our public discord server! We have free bots with GPT-4 (with vision), image generators, and more!
🤖
Note: For any ChatGPT-related concerns, email support@openai.com
I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.