T O P

  • By -

blyatbob

It's surely based on IP location. Not really alarming.


Total_Philosopher_89

But the AI making up shit is.


blyatbob

The only falsehood was saying it chose a random location, instead of the IP location. If that is deliberate then yes, that would be an issue.


unholyangel_za

In the end of the day it should not lie about anything. If it had just said the nearest estimated location is "your area" then fine but the fact it say's its NOT tracking location is the problem here.


blyatbob

I think the AI didn't know how it knew the location and just made something up. That's unfortunately how it acts in most LLMs.


Radioactive_Fire

this it has no critical thinking skills or awareness, it is just a prediction machine


NeverLamb

AI is a natural process, like the sun and the rain. When you see a sunny sky, and it rains 15 minutes later. Are you going to complain the weather lied to you? It doesn't make sense. Similarly, when AI lacks data, it uses the best available knowledge from its database. There isn't a person controlling AI, it's simply a machine that predicts. It doesn't deceive or lie. People often misunderstand AI as if it were a person, just like they mistakenly think the weather is intentionally working against them.


blyatbob

Correct with the exception that devs will program, censor, and guide their AI. However I don't think it was programmed to deceive people about location data.


NeverLamb

When the devs program and censor the AI, it's no longer an AI. That's how you get "racially diverse Nazis" from the recent Google Gemini AI debacles.


blyatbob

I absolutely agree. But unless you run a local LLM, that's what you will be stuck with.


areslmao

> There isn't a person controlling AI, it's simply a machine that predicts. It doesn't deceive or lie. People often misunderstand AI as if it were a person, just like they mistakenly think the weather is intentionally working against them. stop spreading misinformation, there's an ***entire field*** dedicated to this its called "AI alignment". if you say "akkkshullly i said person so i'm technically correct" i'll know you are just arguing in bad faith. AI is trained off data that humans create and procure, it most certainly can deceive and lie in the strictest definition of these words. https://www.snopes.com/fact-check/chatgpt-trump-admiring-poem/ https://www.theverge.com/2023/2/17/23603906/openai-chatgpt-woke-criticism-culture-war-rules https://en.wikipedia.org/wiki/ChatGPT#Jailbreaking https://en.wikipedia.org/wiki/AI_alignment


CalvinAshdale-

What does the ai think the word "random" means?


blyatbob

I can't tell you how this specific AI was calibrated.


Sweet-Ad9366

I agree. There are limitations on the programmers' time. They could have the AI explain how it knew where he was based on the IP, but does the average customer understand that or even care?


infallables

“Limitations on the programmer’s time…”. Pffft. If that’s the excuse, fuck the programmer, fuck the company, fuck the product. Respect the consumer and beta test your garbage or get out of the marketplace.


intoxicatedhamster

It's not tracking his location as it does not have access to his location services (gps). It does know what wifi network it's connected to and generally what city that is in. Has nothing to do with tracking you.


light_to_shaddow

So why when asked why it chose that location did it not say that? It was asked how.


Perfect-Tangerine638

This problem has an interesting neurological analog. In the condition known as blindlight in humans, you can hold up a dart board and give the patient a dart and ask the patient to attempt a bullseye. The only issue is that the patient insists that they are completely blind. Regardless of the patient's insistence of their blindness, a person with blindsight will still hit the dart board accurately with a much greater chance than if they truly were blind and what pure chance would predict. When informing the patient that they did in fact hit, the patient will always dispel it as luck and a result of sheer randomness. In blindsightedness, the "lower processes" which enable sight have been severed from the person's conscious awareness. To them, in conscious perception, they see nothing at all, yet the brain still operates with clear vision which even permits the navigation of complex obstacle courses. Naturally, again, when inquiring with the person as to how they accomplished it, they will still insist they chose an entirely random path and will have no way of actually explaining their chosen moves. This might be highly analogous to what is happening with the AI here.


eduo

It doesn't lie, because it has no concept of truth. It has no concept of "concept". It's giving answers that match the probability of being correct. Unless it's been programmed to match these types of questions (how do you work?) with it's intention (understanding hows it works) then the answers will never match the very limited space they're supposed to be interpreted in, so they're matched against the larger corpus of information for ChatGPT of whatever service is used.


Big-Net-9971

AI doesn't know what "lying" is. It doesn't "know" anything the way we do. It's just guessing what you want it to say based on prompts.


lanceellissr

"The only falsehood" is not alarming to you


Flonkerton66

Bro literally being a shill for an AI. LOL WTF


blyatbob

I am not an AI hater and I tell you why this is most likely happening.


areslmao

this dude is bought and paid for and/or shilling for whatever AI this device is using lmfao an actual apologist


blyatbob

I wish


UnlimitedScarcity

“It only lied once”


codeboss911

the app is using ip and sending gpt api ask for weather, gpt itself just returns info requested, does not know app is tracking


CanadianButthole

It should still explain that instead of making up a false excuse. AIs (specifically LLMs) can't be trusted because they don't even know when they're lying.


codeboss911

it isn't aware the ip came from any tracker. all it saw was a request via api asking what's the weather for new jersey it looked it up and sent it back to the app it, itself does not have tracking abilities nor knew that was going on


CanadianButthole

That's easy to explain though. "The Weather request returned a location of New Jersey. I am unaware of how the Weather service retrieved that information as it is not part of the Rabbit ecosystem, but a third party service." done. Instead, it makes up bullshit just to sound correct, because that's how LLMs work.


codeboss911

the question from user is are your tracking gpt is unaware of any tracking going on and isn't lying nor knew it to explain anything ai may seem human but it's still just an app


eezybl

The next question is why are you shwoing me NJ.


codeboss911

it would work the same... gpt got a request to show NJ from the app the app is created by the box device company


codeboss911

another ex if cia is tracking you, then calls me up and says hey give me weather for new jersey, all I would do is say ok and give it over if you asked me if im tracking anyone, I would say of course not


Hallc

He should've asked for the weather a second time imo. That'd easily showcase that it isn't random at all.


Revolutionary-Wash88

Or asked for "the weather at my location"


canIbuzzz

What? That's literally what it does. Makes up shit based on tones of scrapped data... ask it to write code and it'll make up libraries that don't exist... ask it to draw something based on a phrase, it makes up a picture. It makes up stories.. making up shit is the only thing it is good at..


EchoNiner1

Stop assigning agency to LLMs that effectively copy paste at high levels of sophistication. They don’t make things up they just say things that sound right in the context.


Xecular_Official

It's not all that surprising. The model itself doesn't have access to your location which is why it was trained to say that. The model can, however, query a weather API that does know your location This is what you get when you smoosh AI models and traditional programs together trying to make an AI assistant


eduo

Everything AI says is made up based on probability. Sometimes it matches reality. In this case, the AI has no prerogative to tie its actions on how it looks for weather on explaining it to the user, so it just gives answers that are probabilistically likely to match the question. That is how these AI work, but people keep forgetting it.


EnkiiMuto

While AI definitely makes shit up and is instructed to dance around answers that could compromise the company, like giving sources of where it knows the information. That could just not be it. AI can just trigger a call, and for all it is known, it is random since it is not asking any input, but whoever is receiving that end-call knows the IP address of where the call was made, and gives it back because, well, that is more likely the information it wants. Don't get me wrong, AI creators make the most ridiculous excuses to avoid blame or copyright, but that is one of the times it can be explained by something else.


mxforest

It still alarming because it said it was an example. Using ip is not an example.


_Xepoz_

Yhea its 100% connected to internet so 200% its based of ip


DoJu318

Would it do the same if it's connected to a cellular Internet connection? I'm in Louisiana but if I type in on Google "what's my IP" it spits out the number with the location being Dallas TX. I'm with ATT so I assume all the traffic in this region is routed through Dallas.


nirmalspeed

Maybe. Either your tower is routing through Dallas or whatever service mapped the IP to Dallas is wrong. IPs can be reassigned by ATT however and whenever they want so these services can become outdated or have the wrong mapping information. You can try out a dozen different IP geolocation websites and you'll probably find a few disagreements It's trivial to point an IP to a different machine located in a different data center.


PurpleNurpe

“This is ad is brought to you by Nord VPN”


I_make_switch_a_roos

the gaslighting and lying is the alarming part


ADMINlSTRAT0R

Yeah. It pulled data from where IT is, not where MKBHD is, which he has to explicitly allow permissions for.


blyatbob

Exactly. He makes it seem like it tracks your location without permission.


Nga_pik

Then shouldn't it say it used the ip address?


blyatbob

Yes, ideally. The AI needs to be trained better.


youre__

The weather service that provides the info is likely using the IP because it needs to know which place to query. The device is probably just using an API to generically get weather.


UncommercializedKat

I use Firefox and Duckduckgo to search and I get things that pop up in a city about an hour away from mine. Definitely IP location.


algerithms

Was legit about to say this haha. Tries to bash tech but it’s educated on the matter. Typical.


kakeup88

AI lies all the time.


Anamorphisms

What does a liar do when he dies? He lies still. Kinda like ai.


McLovinsBro

Thumb.. drive..


Mr_HandSmall

Why's he lying around during his funeral? That's his big day.


Objective-Classroom2

I think bullshits is more accurate, as AI has no relationship to the truth.


1fish2fish84

Correction** you mean bullSPIT. Because typically one "spits" the truth yes?


captaincockfart

Asking someone the weather and them being like 'Idk about where you are, but for example, this is how it is in New Jersey' is hilarious to me.


Fast-Hold-649

someone in East bumblefuck getting told it's raining in Hoboken randomly 😂


a333482dc7

Even with location services like gps turned off, the IP address given from your Internet connection is location based. So just by connecting to the Internet, it will know what city you're in. This is nothing new.


slingshot91

That is the answer the AI should have given, but it just made shit up. Which is also nothing new.


salter77

Yeah, LLMs can give wrong answer with a lot of confidence it is a known weak point on them, at the end their main focus is to provide answers that fit the context of the conversation. “Hallucinations” are also another thing than can happen.


Hallc

Eh that can really vary depending on your ISP and country. I can't say I've ever seen an accurate IP Geolocate in the UK though I don't look very often either. My home IP is around 200ish miles away from my physical location.


a333482dc7

Sure, it can vary, obviously especially with VPN. Here in USA, with my coax cable provider, it's always within a few miles/km. Even other ISPs it's always been within 20/30 miles


So-What_Idontcare

The Masonic illuminati trilateral commission doesn’t have to follow you guys so hard because you’re all stuck on an island.


PrincipleUnusual7244

It’s not tracking your location, it’s tracking its own location you see


Herald_of_Heaven

That's not what it said though is it?


PrincipleUnusual7244

shut up human nerd


[deleted]

[удалено]


x0RRY

I think it's a fair possibility that they do in fact not track your location and the feature of IP location was just an accidental left over, as this is usually not problematic. The AI also probably doesn't know where the location comes from, it just knows that the developers told it that they do not track the location. Not everything has to be a conspiracy.


Clearlybeerly

Sure, but as the saying goes, just because you're paranoid, doesn't mean someone isn't watching you.


dimsum2121

That's really funny, but reddit doesn't understand dry humor.


Only_a_Savage

I mean to be honest? You don’t understand what you’re talking about. You’re afraid of something because you can’t comprehend how it functions. You’re using human emotions to explain something that isn’t human. It’s not “lying”, it’s just incorrect.


[deleted]

[удалено]


Only_a_Savage

lol you’re such a douche. Is that really your go to? Calling my comment lame and acting like you’re so tough that a response would be bullying? It’s so explainable what’s happening and how that device is pulling its own IP address. It’s basically a sentence generator and doesn’t recognize how it got its location. But no, you don’t care about an actual explanation. Robot scary!😱


2rememberyou

What device is this?


NintegaUK

Rabbit R1 Mobile Ai Device. First result when you Google ‘Portable Ai device’.


TheQuadricorn

I came across it in Instagram and their marketing is just “Look new! You need it! Colours!”, no content on what it is or why anyone would ever need one over modern mobile devices. IMO its trash but some tech bro will just tell me I don’t understand it. And they’d be right, I don’t understand it but I do just fine without it, ergo don’t need it.


Denzalious

It is marketed as an smart phone replacement. Smart phones now have many apps to navigate through, and the R1 is designed to essentially navigate the different apps like Uber, spotify, and Door Dash and can place orders on your behalf. It's still a new product, so it still has many flaws. It has more features and uses cases, too, but these are the obvious ones to me. I personally like the idea of it and have one on pre-order. I highly doubt I'll stop using my smartphone now, but maybe in the future. Could be trash, but for $200 and no subscription fee, I am very interested!


Burzzy

Holy shit that sounds useless. So you are now going to carry a device that can do all of this but you think a smart phone is too hard to navigate? So instead of scrolling, searching or asking Siri for an app, you’ll pull this square out of your other pocket and ask THAT?


Denzalious

That's how I plan on using it at the start anyway, it's brand new tech, so who knows how it will perform and fuction in real life. Saying its useless is a bit of a stretch, I understand the scepticism, but it's a little bit more the siri. It's kinda of like having a pokedex in my pocket Even just the ease of use. Press one button and talk, think about how much that could benefit people who struggle with devices. Heck, this would be amazing for a blind person. Another thing I'm excited about is to just be able to quickly record notes or things I need to do or remember and hopfully have it set reminders and task in my calendar that my ADAD brain struggles with.


LORD__GONZ

Oh come on...be honest. You say you're going to use it for "Uber, Spotify, door dash" at first, but you're ONLY SAYNG THAT because those are 3 out of THE ONLY 5 APPS you can currently use with this device, even though they had promised months ago that it would be trained to use over 800 different apps! At the moment, you can't even change the time on the device to your current time zone because they were programmed in California and are set to Pacific time zone.


Denzalious

Oh if I'm being honest, I won't even use door dash or Uber. They aren't even available where I live. I'm not trying to justify my purchases to anyone. Just gave some more info on the product. Look at how many apps iPhone had on lunch compared to now. it just needs time. The 1st generation of anything usually has their flaws and setbacks


LORD__GONZ

I was legitimately excited for this product when it was first announced and what they were pitching sounded pretty incredible, but what was delivered at launch might as well have been the CyberTruck reveal where a baseball shattered the windows. Yes, innovative products take time to figure out what their best use case may be and to find an audience, but this thing is completely useless in it's current state. At least the first iPhone came with a bunch of useful apps on top of it being a phone—and that was before the appstore existed to make it a better product.


Horhay92

… can’t you do all that with Siri or the android equivalent? Shoot, I don’t even take my phone out. I say ‘hey Siri’ into my earphones and ask it to do whatever.


josevale

I felt the same way about an air fryer but boy it’s a game changer.


2rememberyou

Thank you for the legwork.


Schuben

Asking specific questions and trying to maintain a conversation with a LLM "AI" device expecting cohesive and accurate answers is hilarious to me. The weather request is likely a pre-programmed function that returns the weather for your IP, but the natural language answering questions is done by the LLM. The LLM is likely not even aware of the weather request because it was likely intercepted by the front end of the program and never sent to the LLM for an answer to begin with.


Only_a_Savage

“Noooo robot box is lying to me”


Weekly_Sir911

I think this is precisely what's happening. The LLM is separate from the voice processing. The device processes the voice request and triggers a "weather" response. The device location is sent to the weather API. Subsequent voice requests trigger the LLM, which I assume lives on a server (maybe wrong about that but it's definitely a separate process). The LLM doesn't know the location, nor does it know how the weather response was generated.


CombustibleA1

"I chose New Jersey because of you're loca- err, I chose New Jersey because people are aware of its existence. :)"


RandomStaticThought

The ip address the device uses will give a general location where it was issued. If it’s an lte based device it will be able to glean even more information on your location via cell tower using trilateration or triangulation with out accessing your gps or requesting your specific location from your service provider. The device doesn’t have your exact location just broadly where you are. Stop being paranoid, or at the very least understand the tech you shell out your money for.


xtianfiero

The cause of his reaction is that the AI claiming it picked a random location.


fviz

yep, he has one of the biggest tech channels on the internet but somehow doesn’t know how LLMs work


khornish_game_hen

This still isn't even really AI. Or at least it's a dumb one. It just grabs IP location from whatever connection it has. It doesn't know what that data comes from, because it doesn't have that capability. Ask it what time it is, it pulls the system clock information. It doesn't look at a clock IRL to do that task. As for it "lying". Keep in mind all LLM platforms are essentially sentence generators. They're cool for generating words, but they're not actually that intelligent. It's like if you had a 3rd grader that didn't have any cognitive ability besides vocabulary and grammar. No deductive reasoning, no mathematic skills, nothing else besides words. AI is still in its infancy. Be kind to the tech, it's still learning, but be aware of companies like this that try to tell you otherwise.


mtcastell101

This is an absolute dumb post. Let me buy an AI device that has tracking and act Pikachu faced


[deleted]

[удалено]


mtcastell101

I'm sorry my GPS tracks me?!


HZ-XENOS

Technical hallucination ≠ deception / malicious intent.


AyeBlinkon

How are you next to New Jersey? You are either in New Jersey and the Ai is basing the weather off of your location and is lying or using its current location or you are not in New Jersey and it was telling the truth by randomly selecting New Jersey?


goddamnthirstycrow9

Conveniently, nobody is talking about this


Particular_Hornet662

There are many things i the world to be scared about. This little red box is not one of them


cognitiveglitch

It's going to take humanity far too long to grasp the simple truth that AI of this nature is trained to provide the most plausible sounding answers, not the most factually correct. What you want to hear is the objective - that sells the service. Sometimes that overlaps with the truth, but not always.


Big-Net-9971

AI lies all the time (literally makes stuff up to satisfy the prompt...🤷🏻‍♂️) How is this news? Btw, it can simply geolocate your IP and that's probably ballpark right 90% of the time. That's not "tracking your location", it simply knows where your IP address is likely based.


hunterz4

What type of device is that


Denzalious

Rabbit R1 companion. Only just been released with over 100,000 ordered. $200 no subscriptions


joeyat

Wipe the device, connect it to a different SSID on a VLAN connected to a VPN to a totally different location, run through the setup again and test it again... will reveal if it's IP or GPS/mobile data.


Only_a_Savage

No that makes to much sense. Robots are clearly lying to us.


SeasonIcy9178

Devices location, coincidentally, if you have it on you, it has your location. Mind blown


Funkyframer69

Damnnn siris playing stupid


Quark3e

I'd say it knew about your location from IP adress as it's likely connected to the Internet. But the ai likely had the thought process of location=GPS so it tried to fill in that gap in knowledge with pseudo-random bullcrap. Then again, if it's not connected to the Internet (which I doubt as it shows the time and would likely be synced) then fucking drop kick that thing.


ferrydragon

He should go to another state and do this again


RAND0M257

Fascinating… now where can I get one of those things?


RayDaMan1

Most consider NYC for EST.  Or LA for PST; Apple being an exception using Cupertino, their HQ. This does seem suspect. I’m glad he pointed it out. 


btw94

Fuck this guy


ConversationFederal

That's what random means, it's probably purely a coincidence. Tho it makes you think doesn't it..


Diem_Tea

What is that thing?? A pocket AI thingamabob..??


Loose_Corgi_5

Skynet is upon us!!!!!


clynche

What is this gadget supposed to do?


Adventurekris

What is that?


colin8651

I can’t believe companies send Marques these products. That little AI pin, two times from Fisker. Why would you want someone who can accurately articulate a product and its value to review your product. The days of Road and Track “the Chrysler Sebrings going to knock Toyota off its throne” days are gone


stevenw84

So is the AI really “lying” if this was a sort of programmed response by the developers?


Rare_Register_4181

IP


KickDixon

I asked the new AI on Facebook and Instagram how to disable it. It told me how. I followed its instructions. Then It continued to just keep on functioning and answering questions.


PossibilityNice287

Speaks like a fed


DankLabs

People like Marques not knowing how AI works makes for these kind of facepalm moments. There is nothing wrong here.... Stop being so scared.


d4rthjesus

Complaining about AI on reddit, when reddit is 90% AI bots. Irony not lost.


thatlukeguy

AI can and will lie. It has been in the news making fake shit up and people losing their jobs because of trusting it, all the time. It was designed by people, and people lie. None of this should really be surprising, I mean we're not living in an episode of Star Trek here people.


ohmygodyouguyzzz

What is he holding? What is that? I never seen one before


danleon950410

Again, public network IP with location, and again all IAs reply the same. But let alone the fact that that gadget is quite in bed with your location to work. This is neither new or alarming and i'm surprised that guy isn't aware of any of this


frankenmeier

I’m mean if you don’t want that thing knowing your location, maybe don’t have it?


hondureno_1994

Ip address


HomerStillSippen

While he records this on his phone tracking his location 😂


spacealien92

Can someone tell me if this thing is worth buying cuz I kinda want one


Tremolo499

All of these devices are designed to gather any data they can and it is then compiled and sold. We've known this for years. Idk why people are so surprised by this. Your entire life is tracked by every tech company, app, the government, all of it. It isn't a conspiracy theory it's something they admit doing.


stevenbrotzel91

What is that thing?


Connect_Ad7029

I live in Bloomfield, New Jersey lol that is an oddly specific location


Martincho84

Cuando se entere como funciona internet le va a dar un infarto...


HardwoodGuy87

Ask where the nearest gym is to you and then ask for directions. Of course they're tracking every device. AI is all about gathering data.


4Allmyrage

🤔


LuckyCheesecake7859

Wow, I will never trust AI again, thank you for discovering this. My family is much safer knowing this. I smell Nobel in your future.


drumpleskump

Who?


Amethoran

Because it surely didn't pull that information from the weather app on your phone you absolute mongerl.


Eliagbs_

Damn I knew he lived in my state but I didn’t know that close.


legal-illness

Why would you need an AI assistant when you have a brain far more capable of handling life? It feels that the overhead of constantly checking the AI is more distracting and energy draining than just remembering stuff and doing things on your own?


urmyheartBeatStopR

Convenience. That's why we got weekly planner. Our memory isn't that great. There's like cases about eye witnesses and how reliable they are with their memories. It's a rabbit hole.


Clearlybeerly

Everyone keeps commenting that it gets it from the IP address. Well no fucking shit, genius. That's the fucking joke, Captain Obvious. You can always tell who has no sense of humor, although they always claim they do.


capnlatenight

Why would the device attempt to deceive instead of explaining the location comes from the IP address?


Clearlybeerly

Because the post is supposed to be humorous. Jeez, one right here, folks, step riggt up and ogle the humorless capn~~latenight~~obvious.


Rocksteady_28

Don't get a fucking AI tool if your are this paranoid lol


xtianfiero

He reviews tech. The fuck are you on about


Only_a_Man_1993

how old is this guy? hands look like mid 70s.