╌>

Here's how AI could help catch shoplifters in the act

  

Category:  Health, Science & Technology

Via:  perrie-halpern  •  5 years ago  •  44 comments

Here's how AI could help catch shoplifters in the act
The tech identifies suspicious activity based on shoppers’ behavior, such as body language, gait and facial expressions.

S E E D E D   C O N T E N T



190315-vaakeye-al-1352_9464331a8675003c6

By   Jaclyn Jeffrey-Wilensky

Shoplifting continues to be a huge problem around the world,   costing retailers billions of dollars a year   in the United States alone. But a Japanese startup has developed artificial intelligence software that it says can catch shoplifters in the act — and alert staff members so they can swoop in to prevent pilferage.

The system isn’t yet available in the U.S., but the Tokyo-based company behind it, Vaak, says   tests in local convenience stores showed the system slashed shoplifting losses by 77 percent.

Dubbed Vaakeye, the system works with a store’s surveillance cameras to catch thievery that busy staffers might miss. Its developers trained the system by showing it more than 100 hours of closed-circuit television footage that depicted honest shoppers as well as shoplifters.

Vaak CEO Ryo Tanaka said the system identifies suspicious activity on the basis of more than 100 aspects of shoppers’ behavior, including gait, hand movements, facial expressions and even clothing choices. Promotional   videos show Vaakeye spotting a range of suspicious activities , from “restless” behavior and “sneaking” to putting items into bags or pockets.

If the system spots behavior it deems suspicious, it alerts store personnel via an app. Then it’s up to staffers to take action — typically by approaching the potential shoplifters and asking if they need help. The system doesn’t actually label people as shoplifters; rather, Tanaka said, it tells staffers to “please check these people — they might steal things.”

This isn’t the first time   artificial intelligence   has been used to combat retail shrinkage. Retailers have used AI to detect refund fraud and employee theft. And Japanese communications giant NTT East made headlines last summer with AI Guardsman, a camera that uses technology similar to Vaakeye’s to analyze shoppers’ body language for signs of possible theft. AI Guardsman’s developers said the camera cut shoplifting losses by 40 percent.

Chelsea Binns, an assistant professor at John Jay College of Criminal Justice in New York City, said the Vaakeye system “appears to show great promise for loss prevention.” But, she added, retailers must weigh the costs and benefits of surveillance. “If regular customers are afraid to enter stores because they don’t like the idea of being tracked, this could potentially hurt retail sales,” she said.

Sven Dietrich, another John Jay professor, said   deep learning algorithms   tend to be only as good as the data used to train them. He offered a hypothetical scenario in which shoplifters in a training video wear blue jackets — something that might lead to the conclusion that anyone in a blue jacket is suspicious.

“You have to be sure you have enough information,” he said. “Otherwise, the algorithm might be extracting a certain bias."

And such systems might be biased against more than a shopper’s clothing.

Jerome Williams, a professor and senior administrator at Rutgers University’s Newark campus, has written extensively on race and retail environments. He said that unless training data is carefully controlled, a theft-detection algorithm might wind up unfairly targeting people of color, who are   routinely stopped on suspicion of shoplifting   more often than white shoppers.

“The people who get caught for shoplifting is not an indication of who’s shoplifting,” Williams said. “It’s a function of who’s being watched and who’s being caught, and that’s based on discriminatory practices.”

Williams said black shoppers who   felt they had been unfairly scrutinized in stores   previously might be more likely to appear nervous in subsequent shopping experiences — a potentially risky proposition if a system misidentifies anxiety as suspicious behavior. Still, he praised Vaakeye’s focus on body language. “I think it’s a good approach,” he said. “You shouldn’t racially profile. You should behaviorally profile.”

Nell Watson, a Belgium-based engineer who speaks widely about machine learning, agreed that behavior is an essential part of the equation. “It may be argued that you could engineer a system which is perhaps even less biased than a given human being, because human beings have their own impressions about people,” she said. But, she added, “it really depends on how well audited the algorithms are by independent experts in this kind of area.”

Audited or not, Vaakeye is already out in the world. Tanaka said the system had been installed in about 50 stores in the Tokyo area and would be soon be available more widely in Japan.


Tags

jrDiscussion - desc
[]
 
Perrie Halpern R.A.
Professor Expert
1  seeder  Perrie Halpern R.A.    5 years ago

I think that this tech is really cool, but AI, in general, worries me. Not only does it "think", it apparently can spy on us, even without people watching. 

 
 
 
Vic Eldred
Professor Principal
1.1  Vic Eldred  replied to  Perrie Halpern R.A. @1    5 years ago

It is really cool and some of it worries me as well. This specific use of AI may take a while to be implemented in the US:

"But a Japanese startup has developed artificial intelligence software that it says can catch shoplifters in the act — and alert staff members so they can swoop in to prevent pilferage."

Can you imagine what the ACLU will do with store "staff members" swooping in on a shoplifter ?


 
 
 
Freefaller
Professor Quiet
1.1.1  Freefaller  replied to  Vic Eldred @1.1    5 years ago
Can you imagine what the ACLU will do with store "staff members" swooping in on a shoplifter ?

Vic maybe I'm missing something but why would the ACLU become involved in a criminal being caught?

 
 
 
Vic Eldred
Professor Principal
1.1.2  Vic Eldred  replied to  Freefaller @1.1.1    5 years ago

Because the ACLU might just feel that those doing the catching are not legally qualified to do so. You don't think questions could arise?  Exactly what is a store employee legally allowed to do?  Make an apprehension? Hold someone until the police arrive?


 
 
 
katrix
Sophomore Participates
1.1.3  katrix  replied to  Vic Eldred @1.1.2    5 years ago

Some stores have security guards who are legally allowed to make an apprehension and hold someone until the police arrive. 

For other store employees, I think it differs by state - for example, Arizona has a shopkeeper law which a "shopkeeper" can legally detain someone while waiting for the police.  But if I owned a store, I'd be very leery of letting anyone who isn't a trained security guard detain someone, for fear of lawsuits. 

 
 
 
Vic Eldred
Professor Principal
1.1.4  Vic Eldred  replied to  katrix @1.1.3    5 years ago
Some stores have security guards who are legally allowed to make an apprehension and hold someone until the police arrive. 

In MA there are specific rules for store detectives, security guards and Constables. There is almost an art to staying within the guidelines. They almost have to wait for the suspect to leave the store without paying, carefully "apprehend" the suspect before leaving the store property, somehow detain the suspect until the police arrive. It must be a tall order if the thugs know the rules.

For other store employees, I think it differs by state - for example, Arizona has a shopkeeper law which a "shopkeeper" can legally detain someone while waiting for the police.  

I imagine Arizona would be a state with very unique laws. Don't they give out drivers licences for life?

But if I owned a store, I'd be very leery of letting anyone who isn't a trained security guard detain someone, for fear of lawsuits. 

That's my point.

 
 
 
Freefaller
Professor Quiet
1.1.5  Freefaller  replied to  Vic Eldred @1.1.2    5 years ago
Because the ACLU might just feel that those doing the catching are not legally qualified to do so. You don't think questions could arise?  Exactly what is a store employee legally allowed to do?  Make an apprehension? Hold someone until the police arrive?

I was assuming the process would be the same as it currently is without any changes except that AI was used to spot the individual.  Lol why change what works, right. 

 
 
 
Vic Eldred
Professor Principal
1.1.6  Vic Eldred  replied to  Freefaller @1.1.5    5 years ago

There is no question that the process of spotting the individual would be vastly improved AND would reduce the cost of surveillance. No debate there.

 
 
 
Buzz of the Orient
Professor Expert
2  Buzz of the Orient    5 years ago

I think that some teenagers think of shoplifting as a kind of game, or challenge.  My father had an employee who was a kleptomaniac, and he went to court to give character evidence a few times.

 
 
 
Sister Mary Agnes Ample Bottom
Professor Guide
3  Sister Mary Agnes Ample Bottom    5 years ago

How lovely to know that in the future, I'll be thrown into a state of extreme paranoia whenever a sales person asks me if I need assistance.

 
 
 
Buzz of the Orient
Professor Expert
3.1  Buzz of the Orient  replied to  Sister Mary Agnes Ample Bottom @3    5 years ago

LOL - Of course that's going to be the result.  I think the only solution is going to be to send a robot in to do the shopping.

 
 
 
Ender
Professor Principal
3.1.1  Ender  replied to  Buzz of the Orient @3.1    5 years ago

Walmart already has online shopping. Pick out what you want, pay for it and just pick it up. They even load it in your car. Staring to sound like a better way to go.

 
 
 
Buzz of the Orient
Professor Expert
3.1.2  Buzz of the Orient  replied to  Ender @3.1.1    5 years ago

So where is the Sears catalog when we really need it?

 
 
 
katrix
Sophomore Participates
3.2  katrix  replied to  Sister Mary Agnes Ample Bottom @3    5 years ago

Actually, much of the time when someone's asking you if you need assistance, they're also ensuring that you know they're keeping an eye on you.  Partly to see if you look like you need help, and partly to see if you look like you're shoplifting.

 
 
 
Sister Mary Agnes Ample Bottom
Professor Guide
3.2.1  Sister Mary Agnes Ample Bottom  replied to  katrix @3.2    5 years ago
...Partly to see if you look like you need help, and partly to see if you look like you're shoplifting.

Nothing like a big blast of retro-angst this early in the morning!

 
 
 
katrix
Sophomore Participates
3.2.2  katrix  replied to  Sister Mary Agnes Ample Bottom @3.2.1    5 years ago

Heh.  I remember as a teenager, the store clerks definitely kept an eye on us, and many stores now don't allow students to bring backpacks into stores. 

 
 
 
CB
Professor Principal
3.2.3  CB  replied to  katrix @3.2    5 years ago

Well, blow me down! I get asked this all the time and of course I tell them I do have a question and starting loading 'em up! HA

Then, I tell 'em I can wait while they go fetch me answers! I do, really, wait for answers.

On a serious note, those workers with the 'talkies" are the worse. They look like aspiring secret service agents communicating on their little hips and sleeve combo's. Then, here comes, "May Ella" or "Leroy,"  with a, "Hi, can I help you find something?" That one is a dead give away to me.

Because it strikes me that I must look like I must appear to A WATCHER to not be sufficiently able to locate something. I give that one this: "Nope, I'm doing fine."

But, you've given me something to ponder. Yes, indeedie.

I am remembering that one day I went into Walmart this year (2019) and I literally looked around at every non-food, non-toy shelf in there, before asking someone where the replacement vacuum cleaner 'bands' were! I mean, I surprised myself at how many shelves I took in. Just bending and folding away! (Smile.) And, making notes on my cellphone Audible book!

 
 
 
CB
Professor Principal
3.3  CB  replied to  Sister Mary Agnes Ample Bottom @3    5 years ago
If the system spots behavior it deems suspicious, it alerts store personnel via an app. Then it’s up to staffers to take action — typically by approaching the potential shoplifters and asking if they need help. The system doesn’t actually label people as shoplifters; rather, Tanaka said, it tells staffers to “please check these people — they might steal things.”

Well, just call me "Jingle jangle" then. Because I do at least two, well maybe three, caliber "maneuvers" in stores that keeps getting me asked if "I need help":

  1. I dawdle. Take my time. Read labels. Look at every shelf in the place.
  2. I bend and 'fold' slowly and awkwardly. Bad legs, you know.
  3. I love loose-fitting clothing. And, I am always fidgeting around with my cellphone which is clamped to my belted waist, because I am stopping to make notes on Audible books I listen to.

But, for the love of peace, I would not take something that does not belong to me if it accidentally came out to the parking lot in my cart unpaid! Which happened last weekend!

I brought it back in and the clerk thanked me. (She should have been embarrassed, that she was too lazy to look and keep me, the customer, save from "AI"!) I could have been jailed or humiliated by "AI!"

 
 
 
321steve - realistically thinkin or Duu
Sophomore Participates
4  321steve - realistically thinkin or Duu     5 years ago

So, don't shoplift, no problem. 

Hard to prosecute an innocent person and you may be able to sue their pants off. 

 
 
 
Sister Mary Agnes Ample Bottom
Professor Guide
4.1  Sister Mary Agnes Ample Bottom  replied to  321steve - realistically thinkin or Duu @4    5 years ago

It's not about being innocent, it's about being judged by artificial 'intelligence' based on the actions and personal style of others.

 
 
 
321steve - realistically thinkin or Duu
Sophomore Participates
4.1.1  321steve - realistically thinkin or Duu   replied to  Sister Mary Agnes Ample Bottom @4.1    5 years ago
It's not about being innocent, it's about being judged by artificial 'intelligence'

Suspected not judged. 

People   have been doing the same thing for years, basically "profiling" shoppers. 

 
 
 
Trout Giggles
Professor Principal
5  Trout Giggles    5 years ago

Hell, I'm in big trouble...I always look suspicious

 
 
 
Sister Mary Agnes Ample Bottom
Professor Guide
5.1  Sister Mary Agnes Ample Bottom  replied to  Trout Giggles @5    5 years ago
I always look suspicious

I know.  It's why I hang around you.  It throws the suspicion off of me.

 
 
 
Trout Giggles
Professor Principal
5.1.1  Trout Giggles  replied to  Sister Mary Agnes Ample Bottom @5.1    5 years ago

jrSmiley_79_smiley_image.gif

 
 
 
devangelical
Professor Principal
5.1.2  devangelical  replied to  Sister Mary Agnes Ample Bottom @5.1    5 years ago

bwah ha ha, that's why I hang with both of you's here.

 
 
 
devangelical
Professor Principal
5.2  devangelical  replied to  Trout Giggles @5    5 years ago

me too, I guess. I always used to get the full treatment at airport security checkpoints until I got some federal ID several years ago.

 
 
 
It Is ME
Masters Guide
6  It Is ME    5 years ago

They keep developing "Things" that take away the "Human factor" !

I don't like it.....AT ALL !

 
 
 
charger 383
Professor Silent
7  charger 383    5 years ago

when AI learns trends and statistics and applies them, it will be accused of profiling 

 
 
 
Perrie Halpern R.A.
Professor Expert
7.1  seeder  Perrie Halpern R.A.  replied to  charger 383 @7    5 years ago
when AI learns trends and statistics and applies them, it will be accused of profiling 

Programs don't have bias. People do. So I don't see that as an issue. 

What concerns me is that we keep developing all this AI, with little thought of the possible negative outcomes. As AI gets more advanced, it might not need us. 

This is something we have been warned about for a very long time, and no one seems to take it seriously.

 
 
 
katrix
Sophomore Participates
7.1.1  katrix  replied to  Perrie Halpern R.A. @7.1    5 years ago

But charger's point is valid.  If teenagers shoplift more, they will be targeted more by AI.  Same with any gender, race, etc.  When people do that, we call it profiling, whether or not it is based on actual trends and statistics.  Will that change if it's AI doing the profiling?

 
 
 
Trout Giggles
Professor Principal
7.1.2  Trout Giggles  replied to  Perrie Halpern R.A. @7.1    5 years ago
This is something we have been warned about for a very long time, and no one seems to take it seriously.

They made 4 or 5 movies out of it

 
 
 
Perrie Halpern R.A.
Professor Expert
7.1.3  seeder  Perrie Halpern R.A.  replied to  katrix @7.1.1    5 years ago
Will that change if it's AI doing the profiling?

AI does it without emotion and based on an algorithm. That being said because it will operate from the "norm", it could actually miss people since it's not looking for it. But I guess we would have to know how it finds the shoplifters. 

 
 
 
CB
Professor Principal
7.1.4  CB  replied to  Perrie Halpern R.A. @7.1    5 years ago

You are asking the, "What about the people?" question. And, it is a big concern/dilemma/problem in the making.

But, technology is the story that eats its own book in the end, Yes?

Humanity has no choice, but to climb that mountain and cross over into the other side! We must know what we do not yet know and are capable of finding out!

 
 
 
Perrie Halpern R.A.
Professor Expert
7.1.5  seeder  Perrie Halpern R.A.  replied to  Trout Giggles @7.1.2    5 years ago
They made 4 or 5 movies out of it

Sure did and all were cautionary tales. 

  • Blade Runner
  • AI
  • The Matrix
  • I Robot
  • 2001
  • West World

Just off the top of my head. 

 
 
 
Trout Giggles
Professor Principal
7.1.6  Trout Giggles  replied to  Perrie Halpern R.A. @7.1.5    5 years ago

LOL....I was talking about The Terminator movies

 
 
 
CB
Professor Principal
7.2  CB  replied to  charger 383 @7    5 years ago

I can see that, because in the gif above. You can see the AI is attempting to 'data-ID' the persons. Such as: Name. ID#. Location. How many times warned #.  Notes. 

May auto-place call off-site to Law Enforcement.

 
 
 
Hal A. Lujah
Professor Guide
9  Hal A. Lujah    5 years ago

As if humans aren’t smart enough to stay competitive with store security.  This is just a how-not-to-get-caught training video for future criminals.

 
 
 
Perrie Halpern R.A.
Professor Expert
9.1  seeder  Perrie Halpern R.A.  replied to  Hal A. Lujah @9    5 years ago

Maybe it could turn into a game. Beat the AI security.

 
 

Who is online












442 visitors