Hacker News new | past | comments | ask | show | jobs | submit login
Amazon interviewed me about my Amazon fake reviews detection app
141 points by vumania on July 12, 2015 | hide | past | favorite | 50 comments
Here's how it went down.

So last April-May, I built a chrome extension that detects fake reviews on Amazon. It analyzes a combination of factors about the linguistics of the review (part of speech tags, unigrams and bigrams analysis), the reviewer metadata (rank, percent helpful reviews, number of reviews...), and the overall product reviews statistics (standard deviation, percent one time reviewers... etc).

At the end the reviews quality are scored on all these factors to give the product reviews a letter grade rating where "F" means that the product is very likely to have gone through a reviews bombing campaign and an "A" grade is for a product that contains mostly reliable reviews from reliable reviewers.

On the side I've been applying to Amazon jobs, and the last one I applied I included in my resume that I made such an app. About a couple of weeks later I get an email saying I was lined up for an interview. The interview went OK, I didn't do great in it to be honest, I didn't do bad either. I got asked about the chrome extension I made to describe what it did and why I did it which I obliged in answering.

Two weeks later, I contacted them to know about the hiring process and I got a reply that I was not considered for the job and that they couldn't share the reason why.

That sucked. What stung me even further, and made me believe that the interview was only a sham reason to only know about my app, was the fact that the product that I used as an illustration on the chrome extension store got banned. Not only that, but multiple products from the same seller and other sellers in that product category engaging in review deception schemes also got banned or more in their lingo "Discontinued".

BUT the app still detects products with deceptive reviews in other categories so it wasn't a site-wide update.

This is my story. Do with it as you wish. And be careful in dealing with large corporations.

Edit: Here's the link to the chrome extension in question:

https://chrome.google.com/webstore/detail/evalute-amazon-reviews-le/cfngaogeljebhifobnjlhoakgaogmndj?hl=en




But Chrome extensions are easy to deconstruct. Just open the CRX file using 7Zip and read through the source code.

Your interview might have made them acutely aware that your extension exists and they may have either got a copy and looked their site's products to find issues or at least take care of the "low hanging fruit" examples you used.

So what occurred might have been as you say. And I suspect you didn't move forward on the interview process BECAUSE of your extension (i.e. they didn't want to muddy the waters in case Amazon's legal department wants to send you a C&D letter) but I don't think they needed to interview you to get intelligence on your extension (since any engineer worth their salt at Amazon could have told them the same thing, just by downloading a copy and reading).

It sucks that Amazon didn't see the value of your innovations and exploit them to make their site better. But their loss I guess...


I tried out this extension and found that it slowed down chrome and even crashed within a few minutes of using it. so perhaps amazon didn't get as much useful information as you think.


They couldn't if he put the logic on a server and just make the extension a client (which seems better to cache things across clients, I don't know if it's the case here).


They don't need to make an interview to learn more about the extension but even so it's convenient to be able to talk to the author directly.


It is usual practice not to give a reason. If you give a reason, you are creating 'exposure' which could lead to a lawsuit, or worse, a class action lawsuit. Most big companies have this policy in place.

So no, it was not some sort of ploy to get info on your chrome extension. If they wanted to do that, they could have just unzipped it and read through your source code. It's trivial.

Lastly, kudos to Amazon for paying attention. Sounds like they investigated the vendors and banned them for review pumping.


But writer should be given some credit, he executed it right using possible resources. May be they used his approach .


More accurate title: "Amazon didn't hire me. During my interview, they asked about a Chrome extension I built that detects bad reviews."


We've changed the title from "Amazon interviewed me only to learn about my Amazon fake reviews detection app".


Almost certainly, someone at Amazon was impressed with your app, but ultimately they just weren't that into you. It's not a big deal. You're a smart guy and capable of something different than being a tiny cog inside of Bigco anyway.

Happy to brainstorm about standalone services you could build with your abilities.


Have you considered the possibility that Amazon's fraud detection systems independently caught the same product that your extension caught?

Also, another part of your story doesn't make sense: Amazon is growing like crazy right now[1], so why wouldn't they continue with the hiring process if you passed the interview? Setting up a "sham interview" like you're suggesting implies that it's worth the company's time to talk to you for 20 minutes about your Chrome extension, but not worth the company's time to actually hire you. This might be true for a company that has a hiring freeze or is downsizing or laying people off, but not a company that's hiring tens of thousands of people every year.

[1] http://www.geekwire.com/2014/company-town-amazons-rapid-grow...


This doesn't answer your question, but many HN posts talk about how awful it is to work at Amazon. You sound smart and resourceful. Apply somewhere that's more likely to make you happy.


There are new Reddit threads from veteran Amazon employees about what a horrible place Amazon is for their developers, and its gotten much worse in recent years. You can find them from here:

http://www.geekwire.com/2015/old-man-at-amazon-gives-advice-...

They appear to be using stack ranking and performance improvement plans to massively churn their work force so a significant percentage of employees doing good work are disposed of by their two year anniversary just because their system is designed that way. They seem to be making their “teams" in to brutal exercises in survival of the fittest or more accurately survival of those most able to play the stack ranking game. Stacking ranking nearly destroyed Microsoft so you assume it is or will do the same to Amazon.

I feel for young programmers starting out, because the work environment seems to be bad and getting worse in a lot of places.


[deleted]


I got interviewed once by Amazon. Basically, they wanted me to do consulting with all the negative sides of it minus the major positive one - the pay. I had a friend who quit Amazon and he told me that backstabbing was actually encouraged there, which makes it a hostile and carcinogenic working environment.


What kind of work did he do for the company?


[deleted]


I'm sorry to hear that.


After about 8 years of helping my mom grow her business on Amazon, I can tell you for a fact, when that company sees something it wants, and can get it for free, they just take it from you.

She created a unique product offering on Amazon and sold it well, about 500 units per month. The product was not hard to knock off, as it is a simple manufacturing process, and now Amazon sells their own version of it, with better search placement to boot. Contrast that with another product she purchases on the open market, similar unit sales with better margins, and has sustained that for several years. Amazon can't identify the source, so they don't sell their version of it.

With Amazon, if you're not the customer, you're the product. The only exception: AWS customers are sometimes both, Dropbox is an example.


One opinion I've see is that they use third party sellers to identify valuable product niches to get into. I've read many accounts of Amazon launching their own version of a product and sometimes going as far as suspending or ejecting the seller or sellers with the product that inspired them.

My guess is that there are too many sellers making money on Amazon who take the abuse. To speak up would mean to risk losing your business. So people don't. I see one massive class action lawsuit in the making.

The other Amazon scam has to do with sales tax. Rather than collecting sales tax on every sale they've somehow managed to pass this on to third party sellers. It's as if Walmart had their suppliers become responsible for collecting and paying sales tax at every Walmart location. Which makes no sense.

Amazon should collect and pay sales taxes in every state where they have a warehouse. States are getting cheated out of tax revenue because Amazon plays lose with this and sellers have no clue they are tasked with collecting taxes. A secondary effect is that sellers get into massive trouble with authorities because Amazon doesn't collect taxes for them and does not submit the funds to the sellers. When sellers discover they were made responsible for sales tax they often end-up with a huge bill that nearly ruins them.


[deleted]


[deleted]


Don't repeat my mistake to reply to a massively-downvoted comment as people will downvote the reply as well to double-punish you.


Sod 'em. Downvotes don't make you wrong, just in a minority.

Anyway, this HN set-up has more rules than you can shake a stick at. You're better off elsewhere.

"Community" my ass


Agreed! Downvoting ruins everything. Not sure what HN gains from it other than leaving a bitter taste in the mouth after somebody dares to post unpopular opinions!


If you completely ignore the votes life on HN is much better. Remember that most people live in a cargo cult reality and don't even know it or care to recognize it. It is far easier for a person to align with their surroundings than to stick their head out and suggest thoughts or ideas that migh separate them from the surrounding culture and ideology.

History is full of examples of people who see the world differently only to be ridiculed (or worst) and later proven to be correct. From Copernicus to Columbus, the Personal Computer and FedEx. Ideas that were ridiculed and rejected by "smart folks" only to alter society in a major way once proven to be correct.

This, I feel, is what isn't captured by these silly voting systems. The HN version of fora would have burned Copernicus at the stake for daring to suggest that the Earth was not the center of the universe. Similarly, here, today, the voting system does not capture innovative thinking but rather cargo cult. Yes, it generally helps bubble good/correct posts to the surface but it also serves to squash down anything that does not align with majority rule. Which means that the audience is subjected to a positive feedback loop fed by cargo cult mentality rather than allowing the injection of a variety of viewpoints for intelligent independent evaluation.

Again, ignore the voting system. Don't let it get to you. It isn't designed to promote alternative thinking at all, that much is evident.


[dead]


Someone needs to come up with a system that limits mob rule through voting and enhanced the ability of communities to maintain quality user-contributed content while giving equal time to alternative points of view.

This is not easy. These kinds of problems go back to the old USENET days. Of course, there was no click voting system. What would happen is that you'd get piled-on by folks who felt entitled to police specific lists. Horrible nasty flame wars would emerge with people being brutally assaulted online in every way imaginable.

Today things are different, the up/down vote is there. And every site I can think of has mob rule problems. From StackOverflow to HN and everything in between.

Again, not an easy problem to address.


Well something I'd ban is "awesome power" capabilities.

Some sites, after you get more than 30 billion upvotes (or some suitably hyperbolic number), you become a meta-poster with various super-powers and the ability to sling your weight around and punish the noobs. The all time favourite "closed for being primarily opinion-based" is wielded with totalitarian contempt and authority. Absurd really because EVERYTHING is opinion based; sometimes those opinions are backed up by empirical evidence sometimes they're backed up by having 30 billion upvotes.

The whole system stinks and, before a super-user blacks me for "Irrelevant or tangential content", the reason I address this is because the original poster who was screwed by Amazon is just another example of too much power being wielded to suppress dissent.

Further, before I'm accused of a diatribe about a problem without offering a solution, I have a number of proposals none of which will ever be implemented because the all-powerful and mighty may lose their pre-eminent positions as a result.

Status-quo rules KO


Well, one would have to be careful with this. A business has the responsibility and right to present the public persona they think best matches their goals or the image they wish to portray to the public. In that context, treating some user submitted content with a "totalitarian" approach is, well, justified.

As an example, there is no reason for Apple to tolerate racist remarks in their user fora. That sort of things has nothing to do with their company and the image they wish to portray. The right thing to do is to remove such posts and ban the users who post them right away.

How about a political discussion forum? Should they allow racist discussions? That's a stretch. Don't know. The stuff is nasty. However, one could argue it is better in the open than behind closed doors because it could serve to inform, educate and perhaps convince a few people to change their ideology for the better.

This is an extreme example, of course, yet this sort of thing is exactly why I said moderation systems are difficult to implement. I don't know of anyone who's done it "right" (in quotes because we don't really know what that means). There are mod systems that work reasonably well but not all the time. In HN's case some subjects bring out cargo-cult down-voting and alternative opinions are simply squashed down. That's just the way it is.

Keep in mind that these fora don't have to be about freedom of speech. They are private sites with their own ecosystems and rules. I you don't like it you can leave.

My approach on a site like HN is to envision mass down-voters as post-adolescent emotional cargo-cult voters who have been indoctrinated or peer-pressured into thinking in a certain way. They have little life experience as the basis of their opinions and seem to refuse to get past the indoctrination or cargo-cult mentality to actually analyze issues before forming an opinion. In other words, their opinions are given to them, they are not the result of life experience and analysis.

For example, there are plenty of people on HN who will post about business without ever having started or operated one. You can see them a mile away because of how ridiculous their comments are in the context of someone who has launched and operated one or more real businesses. These people will down-vote opinions of someone with experience because they probably sound harsh or foreign to them.

They, for example, don't understand the interaction between taxation and business decisions or government and business growth. And yet you can't fault them because they simply don't have the life experience. These are things that are nearly impossible to teach. You can read about it all you want in a book. Your brain does not "click" into reality mode until, for example, a government official shows up at your business asking you to pay the county a "privilege" tax on your desk, printer, computer, chairs, refrigerator and machinery (this is a real thing, BTW).

Once you transition into considering the source of down-votes none of it bothers you. Just state your position and ignore the down-votes. Life is good.


Amazon has interviewed my cat's mouse toy. And companies never share why they turn you down. I really wouldn't read much into this.


"Never" is too strong, sometimes they do.


Wont let me edit, but I've had companies email me back as to why they didn't hire me. Not sure why you would think they never do this.


Amazon has an 'Andon cord' where any employee can report on any product and the retail manager will review and take appropriate action.

Looks like in this case the interviewer pulled the cord and the seller/category was reviewed and several were banned.

This would most likely have been completely independent of the interview reject.


Consider that you don't have the necessary evidence to come to that conclusion. In particular:

- Fraud is something that happens a lot online, and Amazon is going to be removing stuff they think is fraud constantly.

- Looking through the source of a chrome extension is pretty trivial. An engineer can find the info without asking you, and an hr person has no use for that info.

- Tons of people don't get hired. Many companies don't give reasons for not hiring for legal reasons.


>What stung me even further, and made me believe that the interview was only a sham reason to only know about my app, was the fact that the product that I used as an illustration on the chrome extension store got banned. Not only that, but multiple products from the same seller and other sellers in that product category engaging in review deception schemes also got banned or more in their lingo "Discontinued".

This seems like potential evidence that they became aware of your app and made some changes based on the easy to identify information, but I don't think this is evidence as to why they decided to interview you. Maybe they would have interviewed you if your resume didn't include that app on it.


>potential evidence...

I know you probably didn't mean evidence in a legal sense, but it is circumstantial evidence, and this is a reason why a competent, healthy company would not call in a developer for a fake interview with the intention of stealing his ideas. The costs of potential legal liability and reputational risks would far outweigh the small financial gain. Especially as they could just analyze the app, never contact the developer, and not leave such a big evidence trail

Maybe Amazon is not a competent, healthy company, or maybe a rogue executive inside the company independently arranged this evil scheme, but that seems so unlikely when they could just offer a few 100K, or employment, to get access to his ideas legally.

Anyway, my advice to the developer is: it's possible you were evilly taken advantage of, but it's improbable. What is probable is that if you go down this road of paranoid fear of having your ideas stolen, it's a very unhealthy path to follow, even if you are right a few times. Try to think the best of people, and usually they will return that favor.


Another possibility is that users of the extension reported the fake reviews, even used the examples of the extension page, forcing Amazon to ban the sellers.


People write about Google interviews but my Amazon interview was significantly worse than my Google one. Totally disorganized, confused start times, reinterviewed by people I'd already been phone screened by to that asked me the same questions. I wouldn't assume either way that this had anything to do with your extension, their interviews and interview choice process is pretty bad.


asking the same question twice is not necessarily a mistake, specially if they it has been reformulated.


Was the exact same person asking the exact same question.


You don't want to work for Amazon. All the feedback I have from the place is that it's awful.

I honestly don't know how they retain good engineers.


You know what's worse than interviewing for an amazon job and being rejected? Interviewing for an amazon job and being hired.


Who was taking the interview? Was it just some general HR officer, or a person specialized in some field, like a machine learning expert?


One of our clients sells products on Amazon. The stories i hear from time to time are absolutely incredible.

Amazon's buyer facing persona looks organized, efficient and professional. Amazon's back-end, the side sellers see, is chaotic, totalitarian, irrational, unfair, unprofessional and, generally speaking, an utter mess.

Given what I know I am not surprised to learn that some sellers game the system. When Amazon pulls shit like suspending your product/s only to reach out to your suppliers to sell them themselves the end result is the creation of a mercenary "get what you can as fast as you can" mentality with some sellers. It's a mess.


> the product that I used as an illustration on the chrome extension store got banned. Not only that, but multiple products from the same seller and other sellers in that product category engaging in review deception schemes also got banned or more in their lingo "Discontinued"

But isn't that a good thing? I mean, would you really be opposed to Amazon using your exception to detect fraud?


I've been emailed at least 3 times about interviewing with them, so I think they just cast their net wide and see who does the best on their programming tests. I personally don't interview with companies that hire that way, so I've never responded. I turned to down a Google interview for the same reason. I heard Amazon sucks to work for anyways.


Bummer, I'm loosing trust in Amazon every time I'm browsing and comparing some products when I see clear indications for fake reviews (all reviews by reviewer written on the same day, etc.).


Honestly, had I been interviewing at Amazon, I'd have hired you. But I'm not. :).

But you may have caught a lucky break in not being hired (see comments on work culture).


They dont care about something you have written on your free time. You need to answer questions correctly. You should never contact them for feedback.


Are you accepting pull requests? It doesn't work on amazon.co.uk and seems easy enough to fix without even bothering you.


Sounds like you've been brain raped: https://www.youtube.com/watch?v=JlwwVuSUUfc


Doesn't seem to work on Amazon.co.uk


Sorry to hear this but its their loss.


You "blogging" about this will definitively not get you a job at amazon now (or any other big tech giant for that reason assuming they actually read this)


Nah. People at Microsoft know what Amazon is like. You'll get bonus points for realizing how close you came to making a mistake.

We just hired an engineer away from Amazon. Smart guy, he'll do well. Amazon's loss. What are they thinking?




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: