Hacker News new | past | comments | ask | show | jobs | submit login
The maze is in the mouse: what ails Google (medium.com/pravse)
603 points by npalli on Feb 15, 2023 | hide | past | favorite | 341 comments



Like many have said, this contains a ton of insightful valuable criticism.

That said, I take immense issue with the characterization of the "heroism bad" sentiment at Google:

> There are documents that explicitly and proudly deride “heroism” and assert that not only should product teams not encourage “heroes”, they should actively dissuade them. If someone chooses to work twice as hard as is expected of them, they usually will be prevented from doing so because they have to work with others and doing so would force the others to work harder too.

As it's been explained to me, this is actually a principle primarily around avoiding inefficient hard work to keep a system healthy, more of a "work smart not hard" thing. Being the only person on the team who can keep prod healthy is not valuable when you could get hit by a bus tomorrow, and this behavior doesn't scale well. That's the gist of the argument and I think it is a good one. His criticism of people not taking enough risk is apt but that's not what this particular piece of culture is about.


Disclaimer: I have been employed by Google and my views are my own.

I can also see the value for a large organization in culturally enforcing interchangeability and replaceability of workers.

I always considered this bit of culture (and felt the message this way from coworkers) to be even more focused on on well-being of the would-be hero. It always comes alongside messages about how to deal with burnout or achieve a work-life balance that works for you. That's always been my preferred perspective on it, anyway.

Still, I'm with you in pushing back against the interpretation you quoted, which is at best a weak (and at worst toxically macho) understanding of real motivation behind this anti-"hero" sentiment. It's mildly absurd to say there's a culture of holding back hard workers in order to lighten the expectations for everyone else. Anyone who works "twice as hard as expected of them", broadly speaking, just gets recognized/rewarded/promoted until expectations and output match.

Edit: reorganized order of thoughts


The reason I'm skeptical of heroism is that it hides inefficiencies from view (which often exacerbates them), by papering over them with hard work. I have written about it in the past: https://two-wrongs.com/hidden-cost-of-heroics.html


Amen to this. Years ago I did a contract for a company that was very pro-heroism. Every single promotion email I saw had some anecdote about how the person had, say, stayed at the office multiple nights in a row to save an in-trouble project.

You know what? Every project needed heroics just to get done on time because the place was profoundly fucked up. And each round of heroics left the code in poorer and poorer shape, demanding more heroics next time. Instead of doing a truly brave thing, like telling executives that a schedule was absurd and the team needed more time to do it right, people did the cowardly thing and said, "three bags full sir" to every absurd request.

And that was the right choice for promotion, because everybody higher up had succeeded by heroics.


Yea but then you also disincentivize the one guy who could potentially make an outsized contribution to the innovation of the company.

What you’re saying is a virtue in peacetime and a sin in wartime. Precisely the argument the author is trying to make


Google doesn't disincentivize any of that, they just don't encourage it. Google has mechanisms for rewarding people for doing extraordinary work: peer bonuses, spot bonuses. People who make outsized contributions are compensated, and people who consistently contribute more than others are promoted. But systems that require heroic efforts to continue functioning are fundamentally broken and unsustainable, and need to be made easier to maintain.


I left Google recently, partly over the fact that they strongly disincentivize taking technical risks.

Let's just level set for a second:

* Peer bonuses are a fixed $175 and spot bonuses are usually under $1000, and pretty much always under $5000.

* The coveted "feats of engineering award" (or whatever they changed the name to this time), which has the highest prestige factor of any of the internal awards, is $2000 cash or a trip somewhere.

* A senior SWE at Google makes about $300k. A Staff SWE makes $400-500k. An entry-level SWE makes $150-200k.

What this means is that the only REAL reward on offer (other than a token amount of cash and a serotonin-inducing certificate) is a promotion. Promotions almost always come when you launch products (actually, they changed the benchmark to "landing" products, which seems to always happen about 6-12 months after launch after the bugs are worked out).

Launches at Google are almost always significant efforts - either in terms of engineering around the company's arcane systems that are changing underneath you or in terms of getting through all of the process checks that ensure your service is "googly." Further, to go from a "launch" to a "landing" is mostly a political process: you have to convince enough of your management team that you have met some arbitrary milestone that indicates a stable product. As such, people are not too happy to take significant technical risks if they involve spending more than a few months on a project - if you want to get promoted, wasting time on something that might fail is bad. Why would you want to "land" a risky product when you can "land" something that is already on the roadmap?

Additionally, Google offers pretty much no promotion credit to engineers for "prospecting" - what I will call the process of identifying products that should go on the roadmap. That means that if you go out and do this sort of work, you are actively hindering your career: if you go prospecting, you are going to spend months not "landing" things. Conversely, prospecting seems to be a very good way to get peer and spot bonuses.

This is why Google provides no real benefits for taking technical risks. The only real reward is promotion, and promotions come mostly from following the roadmap, not from rocking the boat. The other awards and bonuses are basically toys by comparison.


Maybe there could be a Prospecting career ladder?

And maybe well paid titles, but where one couldn't hire more people, one just got paid better? To mitigate over hiring?

**

Or what are your other thoughts, about how to solve the problems you noticed? ... In addition to:

> promotion credit to engineers for "prospecting"


I don't disagree with your broader point, but I'll make a small nit that I don't think peer/spot bonuses are a meaningful-enough portion of TC that they matter from a financial perspective (unless the numbers have changed significantly over the years). The 'kudos' part of it was more meaningful to me.


People just want their work to mean something, to be contributing to success. Heroism is the full commitment to that. Of course it’s riskier, and based on people over processes, but again and again it’s the inspired that build the future. Work-life balance needn’t suffer, work just needs to be more than a job.


> Heroism is the full commitment to that.

Definitely not. Heroism is nearly the opposite, in that it wants heroes to be significant, not the work.


Heroism at a corporate workplace is, first and foremost, self serving and egocentric.


I don’t think Big Tech needs to overtax its engineers to deliver innovation. They can afford to hire enough folks to keep the innovation engine humming without requiring heroics from ICs.

I understand there are some exceptions: sometimes during outages/emergencies, you do want folks to fix issues ASAP regardless of how long they are up.


You can just barely story point, Gantt chart, and JIRA ticket your way through routine CRUD development. I don’t think too much innovation is happening that way. Innovation in my experience comes from “off the books” deep dives by individuals, pairs, and occasionally groups as big as 3-5. It comes from going into territory that is not well defined, doesn’t have predictable timelines, and is otherwise anathema to formal BigCo project management and communication structures.


Absolutely, but you can do all that without heroics.


Work done outside the formal assignment and tracking processes is normally what I would consider “heroics.”


I don’t think innovation hums, it bursts.


Mine itches.


The opera singer shatters the wine glass with a humming


Being a genius isn't being a hero. We need geniuses to create, not heroes to paper over our flaws. If you are busy being a hero, you don't have time to be a genius. And what happens when Superman takes a sick day?


> What you’re saying is a virtue in peacetime and a sin in wartime.

interesting! it's precisely the point made at the end of The Caine Mutiny.

https://www.youtube.com/watch?v=Jw6gwGawbXA


The problem is that Heroism is subjective.

as the old saying goes: "fix a production stopping bug after 30 seconds, you're an arsehole, fix it after 10 hours, a hero"

The problem with heroes is that they tend to be single people with a specialised and bottle-neck like ability. They step up because of a systematic failure.


If those heroe-likes are needed more often than in the odd Sev 1-2 bug fixing, I always consider it as a red flag. As you said, they are needed for a reason, and that reason, if not some odd special cause, is more often than not systematic.


This.

Problems that actually require such efforts should be exceedingly rare. If they're not, then there's a deeper issue in the production process that desperately needs fixing.

You don't want developers (or anybody) to be working that hard on a regular basis. Burnout is real, and in the long run the practice will cost the developers and the company dearly.


>If they're not, then there's a deeper issue in the production process that desperately needs fixing.

Five Whys.

https://en.m.wikipedia.org/wiki/Five_whys#:~:text=Five%20why....


I broke something the other day. Before I could even catch up on the messages they found my culprit commit. Oops. But also...yay. Easy rollback. Did not need me at all to figure out what buggery I had done.


>systematic

systemic?


who says that old saying?

The saying I know is "fix an outage => hero; prevent an outage => what are we even paying you for?


That's the DBA and sys admin's lament. If I do my job properly, no one knows I exist. If I let Rome burn and then later save the day, I am a hero.


Keeping the lights on and innovating are two very distinct workflows.

Heroes are a bottleneck in KTLO, but they are a necessity for innovation.

It's not a coincidence Google no longer innovates. They threw the baby out with the bathwater.


This got a lot more comments than I expected. I highly recommend reading https://sre.google/sre-book/eliminating-toil/ (also referenced in a nested reply below) to understand a bit more about the toil-specific aspect of this I was describing.


I think your clarification is important, but also within the context that he painted, it doesn't seem like this is the type of "heroism" that is "staying up all night fixing the bugs", it's heroism to take risk with your product:

> There are documents that explicitly and proudly deride “heroism” and assert that not only should product teams not encourage “heroes”, they should actively dissuade them. If someone chooses to work twice as hard as is expected of them, they usually will be prevented from doing so because they have to work with others and doing so would force the others to work harder too. If someone says they can finish a project in a month, their manager will tell them to be realistic, pad it to four months, and tell the VP it is six months.

To me, that doesn't sound like avoiding all-nighters by lone wolfs so that everyone can support the system when it fails, it seems to me like it's preventing people from giving their all to create valuable products.


^this. I think it belies some of the things I don't agree with in this take. Overall I thought it was good, but I think his is a very old sentiment that leads to more worker burnout which is bad.


I read hero as someone who works hard(er), not the one person keeping things up. I mean, the one person is a hero, but heroes can just be the one doing most of the work. I have a couple of heroes at my current job and they're the ones working 12+ hours a day sometimes weekend to deliver on a NEW project. So it isn't much about bus factor, but trying to deliver even if it means sacrificing personal life.


The "heroism bad" sentiment OP's article is describing within Google's culture is specifically the "one person keeping things up" variety, and the characterization in the article is inaccurate.

https://sre.google/sre-book/eliminating-toil/ is a good public example of this sentiment.


I don't think a hero is someone who works harder. A hero is someone who resolves a critical issue that nobody else could resolve. How many hours a day they work doesn't enter into it.


>> on the other hand, any individual customer you dissatisfy creates zero risk unless it is a mega-customer, so customer satisfaction is just a concept on a dashboard to be trotted out at an all-hands meeting, tut-tutted about, and then forgotten about

From my exposure to GCP from the enterprise side, this rings true. The folks we worked with were polite, but seemed to be asking us about our needs as a one-off / outside the normal process.

With credit to the teams we interacted with, they were helpful and acted on our feedback (things like "As a customer, I need a dashboard that tracks my GCP spending"), but it was apparent this wasn't something they frequently did with customers.

"The maze is in the rat" is a great metaphor.

Execs want certain things ("Realtime visibility into all projects!" or "Stability!") but underappreciate the organizational opportunity cost in requiring them.

Is it more important to have perfectly tracked projects or projects which ship 20% faster?

And if the former, we all understand you're training your people to be like forever, right?


The problem with the article is that every company wants to manage risk; turning risk into money is what a company, any company, does.

Now bigger companies have processes, hierarchies, etc. to manage risk in a distributed way, because well they are bigger. But guess what these companies also have? profits! revenue! multiple products/services that produce that revenue that can be then assigned down at the appropriate level of hierarchy that took/mitigated/managed the original risk.

Google doesn't. It's a single-product company with a single Profit Line and thousands of Loss lines and it's pretending to be something else. That's why they are so busy managing risk all the time; most of them don't have revenues to manage, aim for, use to be rewarded for.

Google is a monopoly, a rentier on the internet. They need to be broken up and repurposed to multiple, actually value-creating companies. If not for the health of the internet, at least for the mental health of its employees it seems.

(I would argue that Google's "free" products, like Android, are the worst thing that has happened to the internet; they cannot be broken up soon enough).


> Google is a monopoly, a rentier on the internet. They need to be broken up and repurposed to multiple, actually value-creating companies. If not for the health of the internet, at least for the mental health of its employees it seems. > (I would argue that Google's "free" products, like Android, are the worst thing that has happened to the internet; they cannot be broken up soon enough).

Yes! I agree with this entirely. Google is the behemoth of mediocrity, the McDonald’s of tech companies. All their products are good enough to deter competition and to keep feeding search, and not an ounce better. Humans and human attention are just grist for their mill.


> It's a single-product company

> They need to be broken up and repurposed to multiple, actually value-creating companies.

These obviously can't both be true. You need to take your pick of what you critizice.


Perhaps there's no drive for revenue due to these services being subsidized by the main income stream.

The real cost of delivering these services is written off by the company as a necessary expense. The value obtained from these services via goodwill or some other metric is currently deemed to be greater than their cost.


> turning risk into money is what a company, any company, does.

I must say that's one of the most unorthodox description of what a company does I've seen.

How is a bread factory or a plumber "turning risk into money"? It sounds like you're describing an insurance company or a bank, not, you know a company like Google who produces free software & services to billions of people in exchange for monetizing their attention. Focusing on risk mitigation in a company is explicitly optimizing for protecting existing income stream at the expense of innovation, customers, and new income streams. It's not what "any company does": it's what uninspired companies who have lost their ways focus on.

It sounds like what a consultant used to "financialize" everything would say to solve Google's problems and slowly turn it into an intangible conglomerate like GE who is just the shadow of its previous self. But maybe this time has arrived for Google?


The bread factory and plumber turn a little bit of risk into a little bit of money. A company like Google or Goldman Sachs turns a lot of risk into a lot of money, if they manage the risk so it pans out, or a lot of risk into losing a lot of money otherwise.

GP's description is actually quite astute. The legal concept of a "corporation" exists solely to pool risk and limit downside; it originally came from shipping voyages in the early age of colonialism, where a significant portion of vessels simply sank with all hands, but one successful voyage would make everyone involved wealthy beyond belief. Basically every business endeavor you do involves some risk, because the future is unknowable. The plumber might fall into the sewers and drown, the bread factory might be contaminated with E-coli and get shut down by public health after getting sued by all the customers it got sick. But certain endeavors, the ones like the plumber or the bread factory, have largely been studied, systematized, and structured to maximize the chance of success. These are low risk, but they're also low reward, because low risk invites lots of competitors. Other endeavors like writing complex software systems or predicting financial markets fail all the time, and that's why succeeding at them is so lucrative.


No, this falsely equivocates risk with innovation and just regular opportunity. It’s not a given that low risk with low innovation required will have high competition. This is especially true the smaller the market.

On the other end of the spectrum, there are very high risk businesses with no innovation and stiff competition (e.g. dealing illegal drugs).

Your argument is just about investment diversity, not about the purpose of a company.


> On the other end of the spectrum, there are very high risk businesses with no innovation and stiff competition (e.g. dealing illegal drugs).

This made me laugh out loud. I'd say drug dealing is one of the most innovative businesses around. At the high level, cartels are constantly inventing new methods of smuggling and money laundering. At a low level, dealers were first adopters for text messengers, crypto messengers, cryptocurrency marketplaces etc. I'd say this makes them more innovative than most startups (who often just re-invent traditional business but done online). Dealers even make profits!


Some dealers do some innovative things sure. But most are just use violence and local neighborhood knowledge to stay hidden.

“Using a burner phone” is a 20+ year old trope and it was pay phones before that. Not exactly innovation.

The people that made crypto currency market places were pretty innovative. The dealers that used them weren’t. They are the equivalent of people who discovered eBay in the 90s. Early adopters, not innovators.


If a market is sufficiently small as to be not big enough for competition, that strikes me as pretty high risk of becoming too small for any players at all. E.g., think of the main street of a small town. My mom lived in a town that had one grocery store, one gas station, one restaurant. All of them were marginal operations. And there were a lot of empty storefronts on the main drag, places that were no longer sustainable and had gone under.


> The bread factory and plumber turn a little bit of risk into a little bit of money.

Plumbers make excellent money, not a "little bit". I don't know about bread factories, but I assume they do well too.


It's relative. A good plumber with his own small business might make half a million a year. A bread factory probably makes in the low millions, if they're anything like the small businesses (eg. box factories, hot tub supplies, auto repair shops) I know. Google makes $60 billion, and Goldman Sachs makes $11B. That's 5 orders of magnitude.

Plumbers and bread factories make good money compared to salaried W-2 employees (even compared to Googlers, sometimes), but this again is a risk/money tradeoff. When you choose to work for a big company, you are trading off the risk that your efforts will be useless vs. a guaranteed payday that lets the company keep all the rewards if they're successful. In software it's trivially easy to make the opposite risk vs. reward tradeoff: just incorporate the company yourself and get acquired, in which case you get nothing if your efforts are unsuccessful but keep the full market value of your product if they are.


A bread factory takes on risk by holding the ingredients for bread (which might expire, and cost money to store), paying bakers to make the bread (who might get sick or do a bad job), and on and on. It takes on and manages these risks, and if it is successful it makes enough bread to turn a profit and if not it goes out of business.


I do not disagree with you, but that's exactly what the author of the blog post emphasizes: focusing on the "risk -> money" is an example of missing the forest for the trees. It's not the company raison d'être (unless you're talking about an insurance), you're just summarizing how a company operates under a very specific lens, the same way you could describe a company as something converting paycheks into human labor. A company makes products satisfying customers: that is its core purpose. Focusing on the process instead of the product is exactly why mega-corporations fail, which was the main point of the blog post.


That's kind of absurd as a construction. It may be literally true that a bread factory accepts various kinds of risk in the ordinary course of business, but it's plainly not the primary reason that a bread factory turns a profit. Does a bread factory that hedges its future wheat purchases with wheat futures have a lower expectation profit than one which does not?

You can think about arbitrarily risk-neutral enterprises that are profitable. For example, what risk is a residential REIT taking, especially one whose properties are all insured? By contrast, you can look at a business like a casino (or a catastrophe reinsurer), where it is legitimately the case that operating income is predominantly the result of risk-taking. But when you put the two side by side, there is not a huge difference in ROIC (Return on Invested Capital), which you might've expected if profits were fundamentally a risk premium.


"For example, what risk is a residential REIT taking, especially one whose properties are all insured? By contrast, you can look at a business like a casino (or a catastrophe reinsurer), where it is legitimately the case that operating income is predominantly the result of risk-taking."

If you actually believe that a residential REIT is zero-risk and a casino is high-risk but they have the same ROIC, you should buy REITs and short casinos and you can make a big profit. That illustrates why there's probably a flaw in your understanding (though not necessarily! you might be able to make a big profit!). The market should have the same logic, and if this is actually true, REITs will be bid up and casinos bid down until the ROIC on casinos is higher than on REITs, appropriately compensating investors.

FWIW, REITs face a lot of significant risks, eg. a regional downturn could lead to all the workers becoming unemployed and vacating or not paying rent, or a rise in interest rates could increase financing costs, or rent control might be enacted and prevent the property management from raising rents as much as financial models predict. And casinos are actually much less risky than assumed: most gambling games have statistical models for how much they pay out, and with millions of games played reality tends to approximate the models very closely (due to the central limit theorem), and they tend to take out insurance on extreme black swan events anyway. I don't know the ROICs on either of these industries in detail, but I suspect that if it's similar, it's because the actual risks to them are similar.


> If you actually believe that a residential REIT is zero-risk and a casino is high-risk but they have the same ROIC, you should buy REITs and short casinos and you can make a big profit. That illustrates why there's probably a flaw in your understanding (though not necessarily! you might be able to make a big profit!). The market should have the same logic, and if this is actually true, REITs will be bid up and casinos bid down until the ROIC on casinos is higher than on REITs, appropriately compensating investors.

No, the return on an investment security (in this case, a share of publicly traded stock) is different from the return on a dollar actually invested in the underlying business (i.e., ROIC). This has a lot to do with the price action that you outline.

The rest of your comment deals with why these are bad toy examples, which is fine but not really all that interesting in context.


The security reflects how investors expect the ROIC of the underlying business to change over time, hence the "risk" aspect. They're forward looking over the life of the security's cash flows, while the company's financials now are a snapshot in time.


You're still confused. The EMH is understood to imply that securities prices are the NPV of future cash flows (or more specifically their best estimate, using all public information), but that has nothing to do with ROIC.

(As an aside, the EMH is obviously false and you don't need to look any further than meme stocks for evidence, but anyway)

For example, suppose you have two businesses, both of them have a future cash flow NPV of $1 billion. However, one of them was started in a garage with $1 million of angel money. The other one is a "fallen unicorn" that got $500 million of VC money before it finally IPOed.

The ROIC of the first company is obviously going to be something like 500x the second, but this is irrelevant to their market caps, which should be the same in textbook-EMH-land, ceteris paribus.


"Does a bread factory that hedges its future wheat purchases with wheat futures have a lower expectation profit than one which does not?"

To the extent that it hedges them rationally, they have exactly the same expectation profit. But the bread factory that hedges its future wheat purchases has a lower real profit than the one that does not, assuming the price of wheat doesn't go up, because buying those futures contracts costs money. That's what it means to turn risk into money: if you are willing to bear the costs of things turning out poorly, you can avoid the costs of avoiding the chance of things going poorly, and increase your profit by the same amount.


I think in general the transaction costs associated with hedging wheat price risk are so small via futures (0.05% or less) that it proves the larger point that profits cannot possibly be due principally to assumption of risk.


Your question about what futures is weird. Yes? It does have a lower expected profit? But a mitigation of downside risk. You seem to think the answer is "no."


That's because the answer is 'no', unless there's an underlying reason to expect that the expectation price of wheat will be less in the future. The only impact to profits is the actual transaction cost of the wheat futures, which is de minimis.


Since this is what you think, you should definitely go into some kind of real inventory heavy business and use futures to hedge against all your inputs going up in price. It'll be a real competitive advantage for you, since you seem to think it's all upside.


A lot of businesses actually do hedge their inputs, this is not a crazy idea I've just come up with. For some industries it's de rigeur (jewelers typically hedge even the value of their inventory and WIP), in others it seems to be a matter of preference (jet fuel for airlines). That's perhaps the single biggest justifying reason for the existence of commodity futures in the first place -- because producers and consumers want to reduce price risk. Agreeing on a fixed future price achieves that goal for both parties. Why would either the producer or the consumer need to pay anything to reach such an agreement? Why would it reduce expectation profits for either party? The futures markets simply provide a low-friction venue.


I agree that lots of businesses do hedge their inputs! Just as lots of people buy insurance. Reducing catastrophic downside risk of something is indeed worth a loss of expected value. But insurance has negative expected value, just like hedging their inputs. If you believe that it's costless or near-costless to hedge your inputs, you should do it literally everywhere to everything that you possibly can, and anyone who doesn't is just leaving money on the ground for you to pick up.

And while lots of businesses do hedge their inputs to some degree, it is not the case that everyone does it to the maximal possible extent.


> If you believe that it's costless or near-costless to hedge your inputs, you should do it literally everywhere to everything that you possibly can

... no? Just because you've eliminated price risk doesn't mean you've eliminated holistic market risk. For example, suppose you're an airline: if fuel prices go up, and your competitors are not hedged, it's no big deal if you're not hedged, because everyone just increases ticket prices. But suppose you ARE hedged, and your competitors aren't, and fuel prices go down, and your competition cuts ticket prices, and... uh, you're screwed, because 1) you have a bunch of fuel locked in at the higher price, and 2) nobody wants to buy your tickets with the old fuel surcharges. So you're forced to take a loss, and the hedge hasn't actually reduced business risk in this scenario. It tends to depend on the game-theoretic context whether hedging commodity inputs actually reduces systematic risk.

Seriously, hedging price risk in commodities is nearly costless, decisions not to hedge almost never have to do with the actual cost of the hedge. In the real world where things are much more complicated than a toy example, many airlines do some hedging, with the aim of reducing sensitivity of profits to short-run volatility in oil, rather than trying to truly eliminate exposure to fuel prices. But that does come as a "free lunch".


This and the responses should be required reading for all the folks who claim that the free market requires perfect information. Well done!


Efficient markets require perfect information. Free market is nowhere near efficient.


> Efficient markets require perfect information

No, they don't. I'm wondering where people get these ideas.


From the definition, if you squint a bit at 'perfect'.


Making up your own definitions of things is creating a strawman.


This is basic economics. Taking on risk in expectation of a reward sometimes pays money, sometimes risk becomes realized and you lose money. This applies to Google and your plumber in the same way.


I agree with your larger point but you exaggerate too much calling it a single-product company. Here's a revenue pie chart https://i0.wp.com/fourweekmba.com/wp-content/uploads/2022/10...

Search is 58% of revenue but I'd still call it at least a 4 product company with the "other" products contributing a decent 11%.


Ads is 80% of all revenue on your chart (search ads + network ads + youtube ads).

If you want, you can stretch their products to ads, cloud, and play store. But ads are still 80% of the whole pie. More if one accepts that some percentage of youtube subscribers are only paying to get rid of ads.


And I would add that the non-ads businesses listed there are money-losers. Their cloud stuff is still in the red, and things like Android and Chrome and Maps are basically about ensuring that there are places they can put ads.


I would consider Youtube and Search and AdSense as completely separate giant businesses.


Imagine if they can't sell ads. How are they making money? I don't think subscriptions, pay per use, or referral fees would work.


They're different because the funnels are different. If Bing were to eviscerate Google Search overnight, YouTube and AdSense (other companies showing Google ads on their pages) will still continue to draw in the clicks and the eyeballs.


No. If Bing eviscerated Google Search, then MSFT could profitably serve and sell ads on video content, so MSFT/Bing would immediately want to set up a video site, and lure content creators off YouTube.


They all were at one point.


For example, it could be fascinating to see YouTube as a stand-alone company. Currently its revenues are masked under the "Google" part of Alphabet. It sounds like it's extremely profitable. It could be interesting to see YouTube perform as an independent entity on public markets alongside other media entities, rather than bundled into a "tech" company.


From what I've heard, and from the decisions Google keeps making regarding revenue sharing, ads, etc. YouTube loses them a lot of money due to video storage costs. I believe they even restrict the quality of uploads for some users now to combat that, but don't quote me.


> In 2022, YouTube's advertising revenue accounted for approximately 11.35 percent of Google's total revenue. That year, the video platform's annual ad revenues amounted to 29.24 billion U.S. dollars, up from the 28.84 billion U.S. dollars in the previous year.

https://www.statista.com/statistics/289659/youtube-share-of-...


For context, the sum total of Google's capex last year (offices, data centers, networking, everything) was around $30B. Meaning they could spend (almost!) every cent of that on YouTube video storage and still come out ahead.


YouTube is profitable.


IMO, anything older than 3 years should be on paid plan. Save the planet, delete your old YouTube videos


Google is famous for basically just ignoring customers. Or more accurately, ignoring users, since users are not customers.

Customers are those spending money posting ads on search. Frankly even they get crap customer support, but at least they are customers.

I'm no googler but it's clear "user support" (and "customer support") are not priorities at google, and that means other people _are_ priorities. So it's not exactly a shock to discover employees optimize to make other employees happy (measured) versus keeping users happy (not measured.)

I factor that in when I decide if I want to be more than a user, if I want to be a customer. (So far the answer is basically "no".) And, as a user, I understand I'm not a customer and Google doesn't care about me, or my gmail account... So I treat my gmail account with the importance it deserves.

So what though? This makes them happy, and they're all paid, so what does it matter what the outside world think or care?


I have been a enterprise customer of google cloud.

There is a chasm between google cloud and microsoft azure. Azure sucks as a product, but they really, really, really want you as costumer. Damn, I get a weekly one-to-one with the guy which was part of the team that created their kubernetes offering, just because I needed someone with expertise in the matter to help us maximize the benefit or ours. NO EXTRA COST.

With Google I got a guy that knows Kubernetes less than me. I sometimes get embarrassed asking them questions because they don't know how to answer but must come up with something to answer because the account manager is in the call. It feels like their poor account managers take a uphill battle just to get someone to talk to us. I feel sorry for them.

Guess what happens? must deployments are in azure, even if the azure CLI sucks, the azure portal is a mess and azure products are inconsistent.

But Google's GKE ingress takes 20 minutes to update (there is a years old bug opened, nobody cares), vs Azure application gateway taking 30 seconds. Both being very bad for us, but I get to talk to the Microsoft the guy who worked on that integration and discussing with him the pros and cons of using ingress-nginx instead.

Google don't want us as costumers, they just want to brag about having a better cloud (they don't).

(as a PS, please microsoft your employees don't like to answer questions on stack overflow. But great to be able to get stackoverflow answers from the product managers).


> Azure sucks as a product, but they really, really, really want you as costumer. Damn, I get a weekly one-to-one with the guy which was part of the team that created their kubernetes offering, just because I needed someone with expertise in the matter to help us maximize the benefit or ours. NO EXTRA COST.

When I was at Microsoft, the highest tier of support contract got you meetings with the lead developers of whatever product you found a pri0 bug in.

Found a way to crash the compiler and simple code changes weren't enough to work around it? A meeting with a member of the C++ compiler team would be arranged.

Microsoft has a history of customer focus, though I fear that was very much diluted when MS got rid of their dedicated test orgs.


How does that scale if there are many customers that need to meet the lead developers like OP get in weekly 1:1?


Sorry to hear about your experience thus far. I'm actually on the GKE team. Happy to find some time to chat and get you in touch with the right folks from the GKE networking team. DM me on Twitter at @garitweets and we can connect.


HN support forum in full force.


That's a new HN tag


if you're on a call with an account manager and a support person, and the support person is clueless, politely shut down the meeting early, and then schedule a 10-minute with the account manager to tell them the support person isn't helping.

As much as I hate personal relations, I frequently have to "herd cats" (contractors and cloud vendors). On the other hand, once in the while I get an absolute superstar and I work to keep them on my projects as long as possible.


Yeah, this is what they can give me. Microsoft people offered us high profile people for free.


I used to work for a big enterprise software company and believe me, their support is the same. Unless the issue is highly escalated, there is no way that the support engineers pay enough attention to it. I used to say, that the best customer is the customer who knows the answer. You are all by yourself most of the time:) But you have to pay support fees without any delays.


My companies have been google customers for years, have spent hundreds of thousands of dollars with them, they’ve never cared about us. Bad service and sometimes impossible to reach a person.


You are not a big customer to Google.


I work for a company that has spent billions of dollars on Google ads in the last decade and it doesn't seem like we're a big customer either.


Sorry to break it to you, but you are not a big customer to Google either.

Let's assume that billions is actually 99B. So roughly 10B/yr. This is roughly 4% of their income in a year(~ 284B in 2022).

Big customers are at least double digit % of their income.


Source: trust me bro


Ah-ah. I am sure even if you had millions of $ in support fees, they still won't care about you. You have to have pay more, get a dedicated accounts team and let them manage issues internally.


Millions? That's not even in the right ballpark for them to notice one way or another.

Google brought in around $284B in 2022, Big customers are at least double digits, so for Google, one needs to spend at least ~ 30B/yr to be considered a big customer to them.


They don't seem to care about their corporate customers either. eg. corporate gmail spam filtering is fundamentally broken and no one seems to be able to do anything about it.


    Is it more important to have perfectly tracked projects or projects which
    ship 20% faster?
It's far more important to have perfectly tracked projects. A perfectly tracked project which is guaranteed to deliver on a particular day is gold. It makes planning for the rest of the organization much easier.

To use a programming analogy, it's like the difference between latency and jitter for real-time systems. Many real-time systems will happily sacrifice considerable amounts of average latency, in order to minimize jitter. It's far better to have a process that completes in 200 ms every single time than it is to have a process that completes in 2ms most of the time, but, occasionally takes 2000ms.

Similarly, from a managerial perspective, it's far better to have a team that gives you good visibility, allowing you to plan for a completion date (even if that date is farther into the future than you'd like) than it is to have a team that mostly finishes projects quickly, but occasionally bogs down and takes a year to finish a project that was initially estimated at two months.

The problem is that far too many organizations have neither. They don't have visibility, and they finish projects late. For these organizations, your dichotomy is a false one — better tracking is how they will ship faster.


Tracking does not guarantee anything. Tracking only tells you have missed the release after all of your plan is already destroyed.

You seem to want estimation. And you will keep doing exactly that, "wanting", because estimation isn't something that scales to big projects or multiple ones.


We're not special [1]. Programming isn't that different from other engineering disciplines. The difference is that, somehow, programmers have developed this anti-intellectual attitude that keeps them from doing the hard work needed to develop the estimation tools that other engineering disciplines take for granted. Step one in developing those tools is tracking.

[1]: https://www.hillelwayne.com/post/we-are-not-special/


We are special in that nobody wants to spend the time to spec software in detail up front and we usually make major changes to requirements in the middle of the process.

If we had something like a detailed blueprint before writing a line of code and the requirements were set in stone we could get a lot closer to other engineering disciplines in terms of predictability.

With the kinds of planning and estimating processes we do actually use you’re lucky to get within a factor of two of reality.


The way I've heard it phrased is "If the physical properties of concrete changed every two years, civil engineering would look a lot different." (forget the source)


I think we're outliers in a couple of ways. One is what you mention -- we're usually both the architects and the construction crews of our projects, and we do both parts at the same time.

But there's also a step back -- how long does it take you to fully design, but not program, a particular piece of software? If you give a general contractor a particular set of blueprints, he can tell you roughly how long it will take to build, both the ideal number (if there are no scheduling or shipping delays) and what it probably will end up being. But if you tell an architect you want a design for a particular size and purpose and style of building, she can also tell you roughly how long it will take to draw that up.

How long does it take to design a particular piece of software? What makes a design take a day or a month to iron out, well enough that you can get a correct estimate of the amount of time it will take to build it?

I don't think we're good at that, as a profession.


> I don't think we're good at that, as a profession.

We aren't. And, as an industry, we have managed to convince ourselves that's a good thing. Agile methodologies, after all, are an attempt at making such efforts unimportant.


Nope, that blogspam article misses the mark by a mile. The major difference in almost all software environments is that the software requirements constantly change, even after the initial version is done.

Estimates in civil engineering are going to look just as bad as software if it was common to keep adding floors of different sizes to a building after it was complete followed by a “pivot” of turning the building into a support structure for a suspension bridge.

Software that is as rigid as tradition engineering projects in the real world can certainly be estimated, this happens in safety critical stuff all of the time. But the estimates are long, and requirements cannot change without massive delays, which is terrible for most software use cases.


You realize that this sort of requirements change happens all the time in construction projects, right? Granted there are limits to this, but the vast majority of construction overruns are caused by changes in requirements.


It’s still a change before it’s done and it’s pretty constrained. Scope changes too big are just completely impossible because of physical constraints, lack of permits, etc.

The requirements changes in construction projects are child’s play compared to the ridiculous stuff in software. “Oh, now that we have this data visualization app finished, please add in support for collaborative visualization exploration with synchronized views and voice chat.”


Requirements change in non-software projects but rarely do they change the project into a completely different category like "I know we started building an office tower and it's halfway done, but now the client wants it to be an airport." This happens in software all the time.


Do you know why construction projects don't get huge last minute changes very much? Because every change request is a billable event.

Software companies don't do this much. I've worked at only one that charged for changes, and -- surprise -- such changes were very rare.


Yup, in fact this is the strategy for profit maximisation for many, many construction companies. You look at the plans/requirements and if you spot loads of missing things you bid a low price with high prices for changes and make loads and loads of money.

Source: this is what my Dad did for a living, and I spent a couple of years doing it in my twenties.


It is also the strategy for profit maximisation for many, many software companies. "Change request" is a big deal in outsourced enterprise software dev. It is so bad that 'honest' software development groups that estimate accurately and don't have a culture of change requests cannot compete.


Major infrastucture and other construction projects are behind schedule and over budget constantly. So I guess I agree that software isn't that special, but I'm a different direction.


Yeah, we are not special. Estimation doesn't scale for any other kind engineering either.


true, but the comparison to other engineering disciplines does not hold up well at all: while everybody understands that planning when building a House is important as once it stands you can only change it at significant cost this does not hold true to software development. here we press a button and the house is constructed and with CD even delivered to the customer. my take: we ARE very special as our problems have not ever be encountered in the course of mankind due to the very nature of software.


It’s hard because a good portion of tasks which software developers need to estimate are not iid hence the law of large numbers doesn’t apply.


> better tracking is how they will ship faster

There's a reason PMs are reviled to mildly tolerated by engineers: they believe the map is the end product, not the territory.

The correct answer to which is more important is "It depends."

There are many businesses where shipping 20% later leads to ceding first mover advantage and losing the game. Largely what's being discussed in the article.

More detailed and accurate project tracking and projection doesn't deliver quicker shipping. Effectively prioritizing outstanding work does.

They're similar but definitely not the same.


    There are many businesses where shipping 20% later leads to ceding first
    mover advantage and losing the game.
Are there? Can you name some examples? Because when I think of technology, first-mover advantage counts for very little. The first successful web browser wasn't NCSA Mosaic. It was Netscape. The first successful portable music player wasn't the Nomad, it was the iPod. The Macintosh long predated Windows, but Windows has by far the larger market share. Same with iOS and Android. Google was far from the first search engine. Facebook was far from the first social network. Amazon didn't invent e-commerce. In automobiles, Ford was first to mass production, but it was overtaken by General Motors by the 1930s, and they both were in serious trouble when the Japanese auto manufacturers, which didn't even really get going until after World War 2, arrived.

So in which business exactly does shipping 20% later lead to "losing the game"? If anything, the real risk is in shipping a half-baked product too soon.


I used to think this.

But as a member of a small-ish company, I remember there was this time the sales VP insisted that we MUST have this product out by a certain tradeshow. Engineering worked hard and delivered, and although the thing had warts, it gave our company an advantage: the current market leader showed up at the next tradeshow a couple months later (e.g. "20%") with a similar product and price point, but our lead in time meant that we were able to exist as a strong competitor. This single product launch and subsequent sequels lifted our company for quite a long time.

So now when the sales guys insist we might need something by a certain date, I carefully evaluate rather than dismiss out of hand - I've learned to trust their role as well.


AdSense, Amazon, Apple II / iPod / iPhone / iWatch, CNN, JavaScript, Netscape, Netflix, PayPal, Roku

The critical window isn't when something is first possible (e.g. when the first product appears), but when the combination of technical abilities, component price points, and market characteristics intersect to permit success.

To use a physical example, the iPod and iPhone were great products, but they were hits because they launched with the features they did, at a specific point in time, at a specific price point.

We know that potential for success infection point existed then, because they did build a working device and achieved success.

Consequently, if they had not completed those devices when they did (say, +20% time), another device could have achieved their success.

Maybe nobody on the planet existed other than Apple who could do it... but the possibility was provably there.

Or in simpler form: Netflix was far from the first streaming video service. They were the one who launched with the right features at the right time.

Nobody cares if you catch a small wave perfectly. What matters is catching the best wave of the day, in the brief window you have.


The reason all those examples you cite became as successful as they did is because they spent that extra 20% to get it right. They didn't just ship some MVP out the door. They spent a huge amount of time and energy to get the product as close to perfect as they could before shipping. Steve Jobs, famously, became concerned about the aesthetics of the traces of the circuit board on the original Macintosh [1], spending $5000 (16,330 in 2023 dollars) and a couple of weeks, to have a circuit board created with better aesthetics. Then they threw that board away because, it turned out that aesthetic traces don't actually correspond to good signal propagation.

That's the reason that Apple, especially, has been so successful. It's not because they launched at some perfect time window. It's because they launched damn good products. If the iPhone had launched in 2008, or even 2009, it would have been just as successful. We just would have had another two years of mediocre Windows Mobile/Symbian OS/Blackberry devices.

[1]: https://www.folklore.org/StoryView.py?project=Macintosh&stor...


I think that's an oversimplification. The original Mac was a terrible computer. It was slow, it had too little memory, it overheated, it wasn't expandable, the keyboard was deliberately crippled by removing the arrow keys, it had a single button mouse, and it required almost endless floppy swapping.

The graphic UI and the case design were distinctive. But what really sold it was an incredibly sophisticated ad campaign that carpet bombed key media outlets with super-expensive exposure.

The problem with Symbian/Blackberry/Palm wasn't just mediocre technology, but a lack of dazzle. The products were functional but mediocre. But they were also marketed in mediocre geeky/corporate ways that just weren't that interesting to most consumers.

The original iPhone was barely more functional. But again, exterior aesthetics and a huge marketing and PR campaign forced open a consumer market for a product that was - like the original Mac - barely finished.

The problem Google has is that its products and its branding are heading rapidly towards mediocrity. It reminds me of DEC - an engineering giant in the 70s and 80s, which forgot how to read the market and innovate in the 90s, and crashed far more quickly than anyone would have predicted.


> Because when I think of technology, first-mover advantage counts for very little.

This. The ideal thing is to be second, or even third, not first. "The pioneers get all the arrows."


> Facebook was far from the first social network.

Oh? By this rule, then Facebook must have been quickly replaced by one of the many competitors who launched later, yes?


Quite likely, if the playing-field was level, or at least they'd have lost huge market-share.

Facebook bought Instagram in 2012 precisely because they were a direct threat. The FTC could have blocked that; or more recently, prevented tighter integration with FB+WA.

Currently they're using lobbyists to try to push TikTok (and WeChat) out of the US market.

Yahoo imploded because it had to pander to the short-term whims of the stock market; Zuckerberg references this frequently when talking about how FB (i.e. he) maintains control of its stock and autonomy.


> More detailed and accurate project tracking and projection doesn't deliver quicker shipping. Effectively prioritizing outstanding work does.

This is it. With the advent of broad, powerful tools you can use to automate off your codebase, there's less and less manual rote work that needs tracking, and a greater and greater percentage of creative, hard to estimate, engineer-driven work. And the best way forward is to plan releases with certain features, and flexible timelines, or plan releases with fixed timelines, and flexible features.


> A perfectly tracked project which is guaranteed to deliver on a particular day is gold. It makes planning for the rest of the organization much easier.

This is such a good example of prioritizing internal desires over customer needs.

> better tracking is how they will ship faster

My long experience is that heavy tracking is strongly correlated with slower shipping. Because tracking is treated as a substitute for actual domain competence.


It's worth noting that AWS is really good with this.

Their paid technical support (the 100-200$ one) is great and responsive, with an easy way to escalate if a response isn't helpful.


For what it's worth, I had similar experiences with GCP's paid support. Callback from a real human within 10 minutes kind of support.


So are most account managers, their paired SAs and escalations into product teams.

Hell I got a sit down with the engineers in Amazon Go (the walk out of the shops and pay automatically thing) because I was curious. As a consulting partner!


One things alluded to but not mentioned explicitly: many Googlers (especially in middle management roles) have work at Google all or almost all of their career. If you left university and went straight to Google, you might have a warped perception of the tech world and what's "normal". I think this contributes to the arrogant culture at Google because if you firmly believe that this company is the best of the best and you've never seen actual industry best practices, you might not even be aware of how weird and bad some of the internal processes and tools really are.


Had the exact same experience in Goldman Sachs. People with 20 year tenures in the bank still advocating for CVS and Ant build system in 2017. They're just stuck in their narrow mindsets and don't know any better. That and the superiority complex made me leave quite quickly.


Don't forget Slang and how it's so superior to every other scripting language ever.


Disappointed Slang != S-lang.


pshh thats everywhere. and yes I know Im shadow banned but I thought it was important to comment on this thread BECAUSE I am shadow banned due to the fact that I bring facts to the discussion but the current "lets disrupt google" forced zeitgeist moment. This "lets disrupt google" marketing push happening on ycombinator right now reeks of bad ideas from people who dont work in search.


You may get out of the shadows and spread your wings, you are officially unbanned.


> pshh thats everywhere

Worked for a few exchanges and couple of investment banks and in my youth also in a big five consultancy and GS was the only shop with archaic tech. But I can now see how you could get shadow banned with comments like this.


It's even worse that these Googlers (managers in particular) are picked up by other companies as a shining example, e.g.: "They'll know how to run a team / organisation."

And usually it's just them doing things like they did before which apparently isn't necessarily a good thing (sometimes is but often isn't). I cannot fault them, given the hiring expectation. But that's the problem. There's this cult that if Google does something ot must be the right way. It's filling books.

It's similar for Amazon hire in my experience.


>> Does anyone at Google come into work actually thinking about “organizing the world’s information”?

This is the poignant question IMO.

The texture of the internet has changed drastically since the golden age of "Googling" for things. I feel like the current search vs. SEO paradigm has become a losing battle. The bad actors have adapted to Google's algorithms and now resemble the holes in Search's strategy like some over evolved contagion. The main issues I see as a lay person are:

- Bounce time and other metrics actively incentivizing content to be obfuscated and waste user's time.

- Content theft being viable and disincentivizing high quality content that can be copied easily.

- Walled garden sites that don't want to surrender their content for ad impressions and aren't easily or impossible to index.

I feel like solutions to the above problems would involve Google killing its own golden advertisement goose.

Maybe there are high influence Googlers that do come into work and think about “organizing the world’s information . . .” but a "in way that makes Google the most money" is inevitably tacked on.


I don't think it's the bad actors winning over the algorithm. It's the algorithm forgetting what the internet was actually about.

There was a major search update a few years ago that emphasized "authority". If your website was considered more reputable or an established brand, you ranked higher.

This is completely against the ethos of the internet. The internet was always about new ways to find and organize information. On the internet, CNN has no greater reputation than some random blog. Yet, if you were a mainstream brand, Google would deem you to be more authoritative than some internet-only website.

You can see this most clearly in medical queries. WebM and MayoClinic top the results, even though they're filled with generic fluff. Internet-only websites and forums dedicated to a specific illness rarely get on the front page, even though they have superior information.


Funnily enough, many people on here have the opposite perception of Google: they argue that search results have been hijacked by no-name blogs and that reputable authorities are further down the page.


That, too, has its origins in Google's decision to focus on authority. That opened the gates to SEOs being able to acquire authority signals without actually being an authority or hosting authoritative content.

The topic-specific forum with thousands of pages of detailed user-generated guides and content doesn't have the social media following, domain authority, etc. that Google considers to be "authoritative". Meanwhile, the SEO-spammed trash can easily acquire backlinks and followers to game the system.

Get rid of these authority markers and go back to a more organic web if you want to save search.


> This is completely against the ethos of the internet. The internet was always about new ways to find and organize information

I disagree this being applicable to Search. Granted, SEO spam is ranking higher, but a lot of the "internet" today is littered with low quality content. It's important to rank higher quality content.

The second problem is misinformation. It's hard to differentiate information from misinformation. Sometimes misinformation can become information with new data.

The question is, how can an algorithm determine which content is higher quality and not misinformation. "Authority" can be one proxy signal for it.

I feel in this stage of the internet, we don't need an index over everything, but just curated content. This is hard to do for Google or Microsoft, because they'd get sued hard. Look at Section 230 case in the supreme court [1].

[1] https://news.bloomberglaw.com/us-law-week/google-case-at-sup...


I don’t believe search engines should decide what is or what is not misinformation. Search engines should focus purely on indexing and discovering information, not arbitrating the truth. Just show me information and let me decide whether that’s true or not.


The web as a whole never came up with an answer to the question "As someone in possession of valuable information, why would I want to allow that information to be indexed, which would allow someone to trivially copy it?"

"Information wants to be free" was fine for ~1990-2010, until Google et al. took advantage of it to build walled gardens they could profit from.

In retrospect, I feel like if the in-web-standards micromonetization efforts had been adopted, we'd be in a better place today, because there would have been better revenue channels than "Whoever controls ads."

And/or differentiate and regulate search as a privileged common carrier-style business class, prevented from reusing their web scraping for other products.


I think a big reason why ads became the dominant way of revenue generation on the web (as opposed to micromonetization) was systemic issues that just took time to solve.

a) early internet adopters were mainly young people who didn’t have a lot of purchasing power yet

b) a complete lack of trusted means for online payment

More recently things have started to trend away from this because these two issues are now solved. You can see this in social media like Discord or Telegram who have a freemium model, movie/tv streaming like netflix or disney plus, new entrants like kagi or the general proliferation of SaaS offerings which can now sustain a premium userbase where previously you would’ve opted for an ads based model (think of the n different todolist providers etc.)


Ads have existed across mediums though, from print, to TV and now on the web. IMO they reflect a fundamental unwillingness of the general public to pay for information.


Users are paying for ads with their time / attention. But I guess more people are willing to part with that than a $.


I think that for the majority, the issue isn't really the money, but the friction. Having to set up an account, or pull out a credit card, is an enormous friction point. The path of least resistance is to tolerate the ads.

A proper micropayment system could greatly reduce or eliminate the friction of payments, but we still don't really have one.


It certainly feels like there are some regulatory loopholes/oversights being abused.

Maybe just make it illegal (or actually just enforce existing laws) to link to websites that violate copyright laws (from pages with monetization) and force the market to sort things out?

It would be the end of an era for the internet in many different ways, but maybe the wild west needs to just end?


There are serious issues around that, though, especially if the restraint is based on copyright violators. Copyright law (at least in the US) is a hot mess and unfair all around.

And there's a clear free speech aspect. Why should I not be able to mention the URL of any other place on the net? If there's a drug dealer in my neighborhood, there's no law (nor should there be) saying I can't tell people where the house is. Why should it be different online?


The other issue is also does "organizing the world's information" fit as the right mission for the company? Company missions change over time.

Larry Page said almost 10 years ago (!!!) that Google's mission probably needed to be updated. That's a long time to be lost in the wilderness.

https://www.theguardian.com/technology/2014/nov/03/larry-pag...


Sure Google is a lot more than search at this point, so it's not the right mission. Though, I would say "organizing the world's information" is at least one of the right missions for the company.


Funny enough - Satya Nadella introduced a new mission statement at Microsoft shortly after he became CEO[1].

It's pretty anodyne, but by design - it's a way to push the company towards different ways of operating by creating a pretext to say "X project is part of the new mission and here's why" from a top-down perspective.

1. https://www.geekwire.com/2015/exclusive-satya-nadella-reveal...


The mission statement in "To “empower every person and every organization on the planet to achieve more.”"

Which is not just anodyne, it's generic to the point of meaninglessness.


Those are just fancy words for "improve productivity for businesses and users", which is not that generic.


It sounds pretty generic for me. I mean, Google sells productivity tools and services. "Improving productivity" is just table stakes, not something that's a useful mission statement. Vague or overly broad mission statements are pretty much the same as no mission statement at all.


This is a good article and it does a nice job of explaining some of the problems at Google. Of course, much of them are overstated and others overfit to the particular group this person was hired into.

As someone who has first-hand knowledge of this person and the project he led, I can say (and I'm sure everyone would expect this): he does a great job of seeing all the things wrong with the org and the company; but he fails to recognize his own mistakes and shortcomings.

I would love to see one of these kinds of blog posts where the author owns up to their own mistakes.


I worked with the author for a couple of years, pre- and post- acquisition, and I have to admit that he drove me somewhat crazy sometimes too. Leaving that aside, I also had an immense amount of personal respect for him as I could see how much he very genuinely cares about what he is doing. And, that's actively doing his best to do right by his customers. I think the author is 110% spot-on with his critique of Google here.


How exactly does having a blog post about the author’s own mistakes affect the validity of his criticisms against Google?


Where exactly does the comment you are replying to state that it does?


So you agree that it was irrelevant? Why interrupt an interesting conversation about Google with a comment about how the author is not perfect either?


Because conversations can and should (sometimes) meander off on tangents. As interested and engaged people, we should not only always confine ourselves to the topic at hand, but wonder about patterns and parallels and what they can teach us. "Hey, I've noticed that a lot of these critical blog posts often show a lack of self-awareness about ones own failings or contributions to the problem. I wonder if this is a psychological pattern that we should be aware of in ourselves?".

To return to the implicit point that helicalmix appears to be making - timmg was not saying that "a lack of self-awareness makes this post invalid" (in fact, they specifically led with "This is a good article and it does a nice job of explaining some of the problems at Google") - it was acknowledging the quality of the article, and then using the form of the article as a jumping-off point to a related observation.

A conversation which remains laser-focused on one particular topic at the expense of all others is (sometimes!) helpful in narrow technical domains - but expanding to broader context is usually more interesting and more illuminating.


Indeed, and additionally the proposed fixes aren’t all that inspiring. Mandating every manager do a meaningless, symbolic one hour stint in customer support isn’t going to change anything.

It’s funny that he cites the Waze blog, which similarly gives the impression of a blameless author


> Mandating every manager do a meaningless, symbolic one hour stint in customer support isn’t going to change anything.

I am of the opposite sentiment. I think it would do wonders. It's very easy in a mega-corp to completely lose track of what the product is, who the customers are. And my intuition is that most VPs at mega-corps think about products in the abstract and focus more on politics & empire building/strategy than actually caring about the customers - and it definitely shows for companies like Google.

Just last week I tried to spawn a GPU instance on GCP, and despite being very familiar with the space (I work on cloud infra), after 20 minutes of fighting the overly complex UI and ridiculously broken flows, I still hadn't my instance up. In the next 3 minutes, I signed up for Lambda Labs, entered a CC, clicked a single button and ssh'ed into my VM.

That's what any start-up focuses on: the product. And that's why they always win over bloated mega-corps focused on internal processes and infighting, whose employees self-select for being complacent about mediocre products as long as the monopoly keeps printing fat paychecks.


It’s an incredibly condescending exercise, both to the managers (lol at a reduction of meeting time, is the assumption that managers go to meetings for fun?), and to the people who actually run support (who get to use already stretched resources to herd untrained, resentful managers).

Google’s products aren’t bad because the VP’s have lost the meaning of holding your customer dear. Maybe their senior managers are stuffed with former startup founders, all visionaries in their own minds, who collect big windfalls to join, play at empire building for a few years, then quit in a huff and blog about how it’s everyone else’s fault.


> (lol at a reduction of meeting time, is the assumption that managers go to meetings for fun?

This assumption that every manager has complete agency over their own meeting schedule is equally flawed. I've never attended a meeting for fun, but I've attended countless meetings that were of absolutely zero value to me just because someone up the food chain from me decided I should be there.

> who get to use already stretched resources to herd untrained, resentful managers

I'd argue that managers being untrained in customer service and, especially, resentful of being forced to do it illustrates the author's point pretty well.


In my opinion, managers with little understanding of the customer experience should be condescended to. If they think it's beneath them to do a little actual work, doubly so.


I have limited knowledge about Google, but this sounds overly simplistic for at least GCP.

Large contracts are locked behind FedRAMP compliance, DoD ILx, and so on, and I happen to know that all large cloud providers listen very closely to customers in this space.

Your harsh criticism is valid under the assumption that GCP is an unsuccessful consumer product. I think it is only partially so and features are mostly driven by larger b2b and governments, where it is successful (in the sense that it delivers most features customers care about).


You're missing the point.

If you think talking to customers for an hour is pointless, then you are part of the problem...no matter who you work for.


No, because its "symbolic". Customer outreach is important, but just talking to customers for an hour may or may not help change anything. Maybe have actual outreach programs other than "one hour, and once".


ex-googler here, who has had similar criticisms but was able to recognize their own flaws and mistakes, chipping in.

Doesn't the culture, as described, exacerbate certain flaws in certain people while hiding flaws of a different kind in others?

At google it's easy to see how a flawed engineer might suffer from impatience, lack of tact, inability to read the room, poor social skills, not being attentive to details or to everyone's needs. It's easy to ascribe flaws to someone who makes mistakes and, instead of writing a lengthy postmortem and installing a process, goes ahead and fixes them while pleading for everyone to move on and keep shipping.

Yet at the same time, the sins of complacency, cowardice, inability to make decisions or take calculated risks, rigidity, and aversion to hard, uncomfortable work remain well-hidden. Sometimes, they are even elevated to praise! At Google, it's better to waste everyone's time or do nothing, than take a risk and ruffle some feathers (and I'm not even talking about taking externally visible risks here--a decision to build a certain piece of infra or shut down a project).

And the cycle repeats. A brilliant but "flawed" engineer realizes they can't work in that culture. They blow up and move on. Everyone says "eh, they make mistakes, can't read the room, and are difficult to work with. Poor culture fit". Well, for them, a bunch of complacent do-nothings is also extremely difficult to work with. But the do-nothings are in charge, and they are not. So they leave. Rinse and repeat.


In every failed relationship there are two sides. Maybe one is entirely at fault, maybe the other, maybe both share blame of maybe there's just a basic incompatibility. This is true for work just like it is for marriage.

In each case, it is easy for one to point out flaws in the other. And in some cases, "the other" is the only one that has flaws. But in most cases it is probably a combination.

Just because a company has culture issues doesn't mean that every employee is blameless or perfect. When someone doesn't work out for a job it is hard to disentangle how much of the blame belongs on each party.

In this case, I'm fairly familiar with a lot of the facts on the ground. As I said above the article makes a good critique of the real problems Google has. But it also blames some of those problems for mistakes/failures the author himself made (in my opinion).


You make good points. I'm not in a rush to ascribe blame to anyone. It's just that sometimes certain culture prompts people of certain mindset to make certain mistakes. Repeatedly and predictably. Is the culture to blame, or is that person to blame (each and every time)? And is it productive to even use the word "blame" in this situation, or should other concepts be used?

Since you're more familiar with the facts of the case, I can contribute nothing more than to offer a different angle to look at this.

And I'll leave the author's self-improvement journey to the author.


> he fails to recognize his own mistakes and shortcomings.

Which in no way impacts how right or wrong his criticisms of Google are, and is unrelated to the topic he was speaking about.


I don't feel articles like this are "wrong". I feel like they fail to go deep enough and if they went one layer deeper then it would be clear why the problems they describe are at best actually features and at worst the "least bad" option.

Specifically, all the issues being discussed are actually just features of Google (and the rest of FAANG really) being a mature company in a mature industry.

Google cannot (it seems) launch and maintain new services. Why? Because it already has a single, ultra successful, profitable service: advertising (primarily via search, gmail, youtube etc). When you have no existing business (say you are a start up) you have an urgent need to get one. But when you have a multi billion dollar core business asset (search), you have no urgency to create another. Instead you "urgently" need to not break your existing asset.

This is the same reason GE and AT&T etc did NOT beat Google to the online space.

This is the natural result of success.

This is the healthy, efficient, economically correct position for a company like google to be in.

People have a weird expectation that Google (etc) will be a start up forever. Or an incubator for start ups. Only thats basically functionally impossible.

So the problem here is people's expectations not being realistic and refusal to accept the reality that google (with 175000 employees) is no longer a plucky 10 person startup...


Yep, the primary distorting effect at a place like Google is the seemingly infinite source of revenue from something which is in large-part fully automated. The ad revenues are a crazy firehose.

Yes it takes a large crew of SREs and SWEs to keep that firehose fully primed, but nothing close to the labour force that Google employs.

When I joined Google at the end of 2011 there was something like 20,000 full time employees. At that point it was already clearly a company that had already transitioned from a disruptor of the industry to a maintainer of the status quo. e.g. they clearly bought the ad-tech company I was an employee at just to make us shut up and go away.

The conservative review and permissions structures in place there that the writer is complaining about are in place to avoid fucking up the firehose. And they're legit important. One of the most intimidating times I had working in my career was on the Ad Exchange release rotation, where I had production access for the deployment of binaries to thousands of machines in many datacentres that produced millions out transactions per second and were responsible for buckets and buckets of revenue. Please Don't Fuck Up was like an airplane banner circling around in my skull the whole time.

Any innovations that happen at Google happen because there are very smart keen people there, and Google is constantly seeking out alternate $$-firehoses. But it's never happened and I doubt it ever will. It's not a culture accustomed to being hungry enough to work aggressively to hunt $$.

Politics is eating everything there.


This reminds me a lot of AT&T and Xerox in their prime: they both had a firehose of seemingly-infinite revenue (phone calls and photocopies), and used some of that money to hire a bunch of really smart people and have them work on research projects, which the company then completely mismanaged and wasted.


Even a hefty FAANG salary is still ~1% of what you can make once you 'escape' and carve out your own software legacy.

Ironically many capable, intelligent and driven people end up joining Google, et al. thinking it's the place for them ...not realizing it's where you go to (mentally) retire.


>Even a hefty FAANG salary is still ~1% of what you can make once you 'escape' and carve out your own software legacy.

Huh? How do you figure? No one makes ridiculous amounts of money just writing software unless they're incredibly lucky. This sounds like typical American thinking: "if you just work hard, you'll be the next Bill Gates or Steve Jobs!" Bullshit. For every guy like them, there's thousands of people who spent countless hours and sacrificing their best years working on stuff that went nowhere; they would have been better off working at a FAANG.


Bunk.

Every offer I've ever received from a series A or seed stage startup has had compensation and equity potentials that -- even when imagining a successful exit via IPO or acquire -- totalled (when amortized over a 5 year period) to 2/3rds or 1/2 of what I was getting at Google. There is literally no financial reason to go to an early stage startup as an employee vs going to a FAANG. The founders and VCs don't give enough equity for it to even be close to a "lottery ticket."

As for forming my own startup means a) having an idea that VCs want to fund b) having connections to said VCs c) foregoing income while in the prototyping phase.

I have a family to feed.

I ended up leaving my Google job simply out of job satisfaction. Finances, nope. Makes no sense.


You're thinking of a particular type of startup here. Most startups don't involve VCs, for instance.

But you're right, there is a period where the founder makes little to nothing from the startup. You need to be able to weather that. And, if you're betting on the startup making you an instant millionaire, you're betting on the wrong horse. I mean, it can happen, but it's not the most likely result. The most likely result is that it will fail, and you'll have to try again with a different startup.

The difference between successful founders and unsuccessful ones is the unsuccessful ones gave up. The successful ones almost always have a string of failures before the one that succeeded.

That said, starting your own company can be much more profitable in the long run than working for someone else. And more fulfilling.

But it's certainly not a path for everyone.


Where, pray tell, does one reliably make $20,000,000 a year, from day one?


Thank you for phrasing the comment I came here to make better than I could.

This article (much like a lot of views expressed on this site) mostly just reads as someone jumping from a startup to large-business environment for the first time, and not grokking the very legitimate and unshakable reasons such an org has for being more conservative and process-heavy. Yes, that kind of thing has to be monitored and constantly worked on to ensure it doesn't grow out of control, but some level of bureaucracy is a feature, not a bug, for a large, successful organization. At Google's scale, that "some level" is quite high.


The author had worked at Microsoft for 12 years before starting the company that Google acquired. So, not only does he have a fair amount of experience from both sides, he's also worked at MS during its "lost decade" i.e. the Ballmer years.

The similarities between what MS was going through then and what Google is now facing is to me the most interesting aspect of the story. Whether you're printing money via OS or search monopoly, it seems like both the direction and timing of what's going to eventually happen to your business are almost inevitable.

MS today is quite different from what it was 10 years ago when the writer left. By getting acquired by Google in 2020, it's almost as he travelled back in time, into another Big Tech company at that same stage of the enterprise lifecycle.


That's quite true; but then again, if the goal is to change nothing, not make waves, and let the ad billions roll in, do they need 175,000 people to do that?


Well now you will be labelled an "activist investor"! :)

I think this is an excellent question.

I think Google has tried to be an incubator etc. And it's management have had a go at new products. That means hiring

I think they have also been pretty big acquirers. That also pushes the headcount up. Cynically people also say Google acquires companies to stop those companies becoming anything. When you do that, you need to keep those employees on the books too (or they will just go re-found the thing you just paid to kill). Not sure how true that is, I leave it to the reads discretion.

When both these sources of new services have failed, they have NOT fired people. Closing Stadia did not lead to firing 90% of the "Stadia Team". Ditto 101 other initiatives and take overs. It was actually a joke on "Silicon Valley" (the TV show) that no one ever get's let go by tech giants. No matter if they are useless or incompetent.

So the head count is probably pretty bloated (I have no idea how many people are actually needed to run Google).

And that brings us to actual Activist Investors and last months lay-offs.

I think investors are finally calling for efficiency not growth. I think management are finally listening. I say finally not because I think I would have done it sooner, only because I think it makes sense in hind sight.


I think this analyses is very apt. It also reminds me of the old saying "small companies make it possible, large companies make it cheap".


I have not heard that before, I will quote it in future, thank you!


> when you have a multi billion dollar core business asset (search), you have no urgency to create another

Tell that to Apple.


I'm going to call out one specific point I disagree with, which I'm curious whether others will or won't agree with me on: google3 and the associated set of internal tools actually are better than what exists "in the real world".

I went from startup world (mostly rails and frontend frameworks of the early teens) early in my career to google3 for about half a decade to the whole suite of public cloud stuff starting about a year ago and I really miss google's internal tooling.

It's not at all that any given component is much or at all better than any given public competitor. Indeed I think the article is right that on an individual component basis there are strong competitors to everything google has internally. But taken as a whole, I found it much easier to figure out what tool to use for a given job and get it working well for my task within google than it is with all the public tools. But it's an integration and analysis paralysis / paradox of choice and sales cycle problem, rather than a technical problem.

Do I go with a fully managed service or self-host? How well does the self-hosting work with my infrastructure? What about cost comparisons? Do these three tools work together at all? Do they support my particular sso setup? It's just so much crap before even getting to the point where the technical capabilities are important. And it is either prohibitively time consuming or just actually impossible to do any sort of objective analysis of different options, so everyone just guesses and cargo cults. "This seems to have the most mindshare in the community."

I experienced variants of some of these same problems with google internal tools, but there were easy and good answers to a large enough set of the questions that it always seemed a lot easier to get an answer and move on.


this is something i've really felt moving from aws to a company that isn't a cloud provider. even when most aws services are third best at best in their category, you still get the following benefits

1. everything works reasonably well together and share the same cross cutting primitives (IAM, VPC).

2. you have service teams and support all under the same roof, so you get deep access to them and can get them to work together on solving your problem

3. you do not get a choice in the matter, so you do not have to waste time deliberating the choice. you also get rock bottom prices guaranteed.

this all made things much simpler to work with, much simpler to debug/get support for, and removed a lot of the churn we would've had if we had to re-evaluate services every N years.


Do you think this is more a reflection on the fact that the more mature company has already made these decisions for you vs the other company having to still figure out this stuff? Your point isn't really saying much about que quality of the internal tools vs the external ones. I see your comparison more along the lines of a company that's already decided how they'll tackle the problem and answered all your questions vs one that's starting to.


> Do you think this is more a reflection on the fact that the more mature company has already made these decisions for you

Not really. There are many competing tools internally too, and you have to choose the appropriate one. One thing that's common though is they all integrate with everything else - monitoring, building, launching, codebase, documentation, etc. This makes it much easier to just make it work.


But the reason that integration works is because at that lowest layer there is pretty much exactly one option for everything, ie. for logging, monitoring, building, launching, deployment and configuration, front-end / load-balancing, storage, code location, service interface, documentation, authn and authz, etc. etc. Sure there are competing tools on the boundaries, but there's so much you can count on existing everywhere.


Sure, but I'd say the benefits outweigh the lack of choice about the infrastructure.

I frequently talk to my friend about work, and I realize most of the problems they face - even at good tech companies - are something I never have to think about. I don't mean the actually difficult problems which any Software Engineer would love to tackle, but the grungy ones.


Absolutely yes. I actually meant to make the point that I think all mature companies have this "a small set of things that work together" to some extent or another! So yeah, maybe the point still stands that this is not a point of unique exceptionalism for google. Though I haven't worked at any other large mature companies so I can't compare their tooling to google's.


Wow. When I read this I was so struck by just how accurately it captured Google culture. Things that really resonated;

The way I see it, Google has four core cultural problems. They are all the natural consequences of having a money-printing machine called “Ads” that has kept growing relentlessly every year, hiding all other sins.

(1) no mission, (2) no urgency, (3) delusions of exceptionalism, (4) mismanagement.

For history, my first big contribution inside Google was criticized for being "not technical enough." (and that was fair because the technology was straight forward), however it had pushed through the organizational inertia of "don't change anything" across several groups to get into product. My contribution was to skillfully push things through the org without activating the organizational antibodies that resist change at all cost. But this was not a skill that was appreciated at the time by the people that mattered.

The second thing was this;

Any disagreement with the management chain is career risk, so always say yes to the VP, and the VP says yes to the senior VP, all the way up.

People who were there when I was often didn't know me personally, but did know "of" me by my calling out management on their bogosity. I was not so enamored with "working at Google" to bury my irritation with bad faith communications and actions. To the point where I got direct feedback from my management chain that they would have an easier time in "calibration" if I was not causing so much friction. :-)

I suggested they might get a lot less friction if they stopped doing the kinds of things they were being called out on. I have never been one of those "go along to get along" people in the presence of basically evil[1] people.

When people ask me if they should work for Google this is the litmus test I give them, "Can you suppress all of your feelings of justice or ethics in the face of senior leaders making unethical choices chasing promotion, market monopoly, or additional profits for the company?" If the answer is "no" then I suggest they look to work elsewhere.

[1] I know that reads hypercritically, I don't have a good neutral way of describing people who make decisions that help advantage them at the cost of disadvantaging others. Especially when that decision is unnecessary or frivolous.


Lots of stereotypical phrases: "Lead with commitment to a mission", "Embrace agile or lean development", "Winnow the layers of middle management" etc., the sort of low-risk generalities that are maybe suitable for expertise-lite consultancies but don't really shed new light.

What truly "ails" an entity that prints billions? Does it take an insider to figure out? Does it take a technologist? If you go back to startup school and try to map the entity into the Business Model Canvas [0] you immediately spot the obvious peculiarity: the incongruous mix of customers (advertisers versus infrastructure users). What is the value proposition, to whom? All the money and brainpower in the world don't help if you have your moral values messed up. Its a soul thing.

[0] https://www.strategyzer.com/canvas


How does this square with Google’s reputation for releasing and then abandoning many, many products? Like their dozen chat apps, Stadia, seemingly every other Alphabet subsidiary, etc.

It seems like Google is pretty good at releasing things, just not at following though on supporting them to become a real line of business. The perception that Google can’t release seems new and odd to me as an outsider.


One of the author's primary critiques is that nobody cares about the users/customers. All actions are aimed at an internal audience rather than an external audience. Thus product releases are done for internal reasons (i.e. impressing senior managers and getting promoted). They aren't done for the sake of external customer/users - hence the lack any long term commitment.


This rings true to me. I worked at Google after being at Amazon for a few years and the customer focus was like night and day.


Amazon must hate it's customers. Otherwise, why would they try to sell me books "in the style of" an author before they sell me the books BY THE AUTHOR when I search on author name?

Hint: I asked Amazonians. They told me it generates higher revenue for them, and so "works as required". I know nobody who wants, or expects this behaviour in a search box.


Obviously, Amazon makes more money doing this. People who really just want books from that author will scroll past the other authors to the rest of the results with that author, but many people will spot something else and look at that (in addition to the author they're actually searching for), and then buy more books overall. And people who get really annoyed by these extra unwanted results will just complain on tech discussion forums, while still buying their books from Amazon anyway.


> Obviously, Amazon makes more money doing this.

Thats a very interesting spin on "more customer service oriented" or some similar view I was responding to.

> And people who get really annoyed by these extra unwanted results will just complain on tech discussion forums, while still buying their books from Amazon anyway.

Guilty as charged. But an Onyx "boox" is in my future, and I'll be able to deal with Google, Kindle, Kobo, and Calibre sourced books through Android readers on a passive display. At that point, I will be much more interested in other sources of reading material which know "Scott Turow" is a person, not a style.


>Thats a very interesting spin on "more customer service oriented" or some similar view I was responding to.

The problem I see with a lot of people in these discussions is that they think "happy customers" => "more revenue". This isn't true in many cases. Many times, pissing off customers will make more money. Just look at Comcast.

The sociopaths who run big corporations figured this out long ago and that's why these companies make money. They're able to easily take advantage of peoples' naivety and assumptions that other people are like them.


100% this. the ARPU goes down as a function of helpdesk? easier not to have one, than fix the underlying problems which cause people to seek one. This is where google excels: no helpdesk! (unfair: there is one, you have to be in paid tier like google one, and they are excellent)


Exactly.

To really understand how corporations work, and why they do some of the things they do, you have to think like a sociopath.


> And people who get really annoyed by these extra unwanted results will just complain on tech discussion forums, while still buying their books from Amazon anyway.

For a while! But I've now made Amazon my second source for things because the user experience has declined so much over the years. Now I buy books via my local bookstore's website. And for anything else, I'll try to buy via the manufacturer or via something found on Google Shopping before I'll buy it from Google.

I still spend money with them, but much less than I used to. And as their devotion to profit first, customers last increases, I expect to keep edging away from them.


Sure, but the single factor of showing you "books like this author" likely isn't driving you away from them all by itself. If everything else were fine, you'd still be using them as your first source. There's a lot of big complaints about Amazon these days, like counterfeit goods, causing people to look elsewhere.


In books, my primary gripe is the one I seeded above. My secondary gripe is the abysmal state of IPR management: I know a book editor/commissioner/rights-rep and the payment contracts for Kindle are scandalous. It seriously de-motivates a lot of authors.

Enough, that you can get this insanity: three forms, all annoying:

a) volume I and II of a 3 part trilogy available, not part III, except in e.g. German

b) volumes II and III of a 3 part trilogy available, not part I.

c) either of a) or b) but with the entire 3 volume set available as one book discovered *after you buy parts I and II (or II and III) uniquely

Now, I know some of this is down to IPR and economy-specific rights management, it's not all Amazons fault, but its seriously annoying.

There is a version of the fraud in Amazon goods: its people selling $1 guides to books under the title of the book concerned, or a $1 review, or a number of scams which pass through the "too much hassle to reclaim" filter.

I've also had Kindle withdraw books from sale, after I've bought them (like the '1984' incident) which is typically because of a major IPR or production issue. Sometimes, they'd rather stop selling than be love-bombed by the spelling and format issues from readers.

I helped somebody publish through KDP and the other side of the deal, doing e-books and print-on-demand is also a nightmare of a different kind. They need you to use abstruse elements of the PDF spec, to set metadata, and positional accuracy of barcode for ISBN is amazingly finickity. All of their production tooling is built around 'most likely path' which means Windows, so doing this via Latex/Calibre/PDF tools in linux is a nightmare. I wound up taking the same work to a print-on-demand specialist I could actually talk to, to resolve most of this. The people who have to live in KDP have all kinds of hack scripts to fix PDF metadata to meet exacting demands, which seem really abitrary at times.


Oh? Fascinating how much you know about how I make choices. If you really can read minds from a distance, maybe try poker?

Sorry to be difficult, but the general deterioration of the search experience from "find best thing for the customer" to "find thing that makes Amazon maximum money" is a huge part of the problem for me. I've never received a counterfeit from Amazon, but every time I try to use it I feel the loss of trustworthiness. Maybe trust isn't a big deal to you, but it sure is to me.


Maybe trust is a big deal for you, but it isn't for most Amazon customers. That's why they make so much money. Amazon isn't in danger of going out of business because you personally don't trust them. Most people are happy to keep using them, despite their search experience not being in the customer's best interest and instead being designed to extract more profit.


I agree. Its not releasing products that's a problem, its having a long term vision and commitment.

I always see two conflicting takes on HN. That Google abandons their products or they haven't done anything recently. Not every product can be a worldwide success, but how do you know it until you try and fail or succeed? Failing means abandoning it.

I'd like it if Google frequently creates new products marked Beta for a long time and making them core-products depending on their success. After that, I'd also like it if we stop blaming Google for "killing" products.

The problem is Google releases new products without a Beta tag, even when they aren't sure if they will succeed or not.


This is valid criticism but … Google faces the very difficult problem of operating a really big organization. In such a place, there is bound to be hyper specialization. An L5 engineer doesn’t worry about customers because they don’t interact directly with them. And this is good.

I think the author is just pointing out the difficulties involved in operating a large organization. There’s certainly ways in which Google can improve, but Im not sure the author has provided any valuable insight into how to fix its deficiencies.

We’ve seen this before several times. The behemoths of yesteryears are todays laggards (IBM, HP etc.). Its the cycle of life for Tech companies.


The author points to Microsoft as an example of company that did not end up like HP. Not all large tech companies have to end up like IBM. It takes a very special CEO to turn things around, but it can happen.

I found the article insightful in that sense.


Microsoft was in that position not too long ago. Satya turned it around. Google also needs someone to turn it around.


Interesting. Has MS in fact turned the corporate culture around? When I was there, the Windows org was full of fiefdoms with, at times, petty alpha nerds running things. The culture at Google, while far from perfect, was more respectful and data-driven.


I’ve never worked at MS but have gone in and out of their ecosystem as a dev over the years.

With Azure and those kinds of moves, a lot of MS tech clearly became more about getting the tech right rather than protecting some random other MS product. At least the .NET stuff did for sure as you saw more and more open source stuff flourish, pragmatic decisions getting made, elegant APIs, etc.

Google seems to be hopeless right now but as the author states, they need their own Nadella. Sundar Pichai seems to be one hell of a dud, clearly a Ballmer-like figure.


> An L5 engineer doesn’t worry about customers because they don’t interact directly with them. And this is good.

Who uses the code then ? An senior engineer interacts with customers via the code they ship. They see the metrics and the bugs they submit


The whole problem is rapid size increase. The whole "grow big fast" mentality led to many tech companies hiring like mad to grab all territory they could, diluting their mission, they basically entered every vertical they could and any time a startup drew attention to an area, they'd rush to hire and occupy it.

Google in particular, took in a huge influx of people from Microsoft and Oracle, and that also ended up changing the culture, but that might be unfair to them (correlation), because they were already big companies, and Google was becoming a big company.

When you add a huge number of people, they're going to spawn thousands of projects, and most of them aren't going to ship, so the probability you're on a team that ships something tends to go down with company size increase.

The monorepo IMHO is not a problem, it's a huge boon. The google infrastructure is fantastic and still has features that you won't get on GitHub. In particular, Code Review and Code Search is much better. The build/test/CI infra is IMHO better than external alternatives (e.g. jenkins/circle/etc) Moreover, when you want to make changes that cross over N different projects, you don't have to checkout N different siloed repos, or worry about different versioning, as Google's repo (mostly) guarantees a single version of everything.

There are external libraries however that are better than the Google equivalents, especially in the world of Web frontends. It would be good for Google if they allowed each team to decide what external libraries they wanted to use for smaller scale projects (e.g. use React/Vue/Next/etc instead of say, Closure Compiler compatible internal frameworks)

The tech stack stuff tho isn't the real issue with Google, as the original essay pointed out, there's no real connection to customers and no urgency to ship anything. There's also a preference for rewriting into new stuff vs maintaining old stuff.


A remarkable piece of writing, and I’m enthralled that the author has taken the lyrics of an extremely famous cover song and made it seem fresh, new and relevant to this very moment.

I will forever hear “Businessmen they drink my wine, plowmen dig my earth None of them along the line, know what any of it is worth”

differently now.

btw, the Waze founder’s (similar) goodbye post is also worth reading.


> the lyrics of an extremely famous cover song

Actually he used the lyrics of an extremely famous original song, which were written by Bob Dylan :)


The version of the song that is most famous is the cover: https://en.wikipedia.org/wiki/All_Along_the_Watchtower


Perhaps, but the article explicitly attributes its quotes to the original.

But I was just making a silly joke.


No, the article attributes the lyrics to the songwriter, which is the same for all versions of the song.


I always wondered why glaring customer facing problems could go years without a fix despite literally thousands of posts. I’m not talking free users, but google apps (workspace) stuff etc. I’d describe support as nice but not helpful. This really explains it.

They also seem to have weird eventual consistency type bugs that can get you into weird states you can’t get out of, I wonder - what tech stack is this? Do they not use sql for this?


I'd assume those are interface (both user- and code-to-code) complexity at scale.

I.e. 0.0001% of accounts end up in a state (across multiple services) that was never expected, and therefore code to handle it never written, and thus is unable to ever transition because there are circular dependencies


For sure. But the path to resolution is weirdly hard at google in these cases.


The question the author doesn't answer is, "Why?". Who the hell cares if Google is innovating and making the world a better place? They jettisoned their idealism with the founders and are a standard company. A standard, ludicrously profitable company.

The more likely and rational approach to the situation described by the author is seeking efficiency in support of the core profit generating business. Google is ripe for huge, painful cuts that further consolidate wealth in the hands of shareholders. If that absolutely massive R&D spend isn't doing much, or doing anything efficiently, cut it.

Personally I hate this approach and would love to see Google to return to its nimble and "Don't be evil" roots, but I have yet to identify sufficient motivation for it to do so.


I think in general it's depressing that a non-trivial number of very capable people are spending years in companies like Google not really benefiting humankind. It's like reading the intellectual history of pre-renaissance Europe and realising how many of the smartest people of their time spent huge numbers of hours (and mental energy) on obscure and ultimately pointless theological matters.


You can't sell the same tech product forever. Do you think the original iPhone if being sold today would make any revenue for Apple?


"delusions of exceptionalism"

Love that description - and of the 4 faults the author points out, that is the one that is going to hurt them the most.

No way a company fixes having 'no mission', 'no urgency' and 'mismanagement' if a large portion of the staff things they are exceptional at everything they do.


What ails Google is its management, starting at the very top. They have created a culture of idiocy that can't be fixed internally. Everyone knows their issues. They just can't fix them. They can't even acquire new companies without killing them anymore. Google's only hope is to find a new leader who can realign their products onto a shared vision that includes basic business realities like giving a flying duck about customers. I don't think they can find that leader, and wouldn't give them the political capital necessary to fix anything if they did. Google has many years of suffering left before the people who matter realize how severe the problem is.


One thing I can't figure out (genuine question) is why they don't have 20% time anymore for innovation. I thought it was a key driver for new products at Google. Does such a thing cause career risk, or political strife?

Also, I'd like to understand if their AI lab, Deep Mind, also suffers the same problem, or does it have a different culture? Does Deep Mind have 20% time?

I'd appreciate it if anyone within the company could explain it please.


I was at Google from late 2013 to early 2016, and even then, I would hear 20% time referred to as 120% time [1]. So 20% time hasn't been a de facto practice for about a decade.

[1]: https://qz.com/116196/google-engineers-insist-20-time-is-not...


That's a great article. To me it makes painful reading because what it means is that some of the most talented engineers are being hired by Google to do just regular enterprise software stuff, but disincentivised to actually do innovation for which they are most able. If they were back in the open market so many great firms could have been founded, which might be the ultimate corporate strategy for Google - to take talent off the market.


It was always a myth. Back in the day, a few people would have 20% projects. Most did not, or did so only once in a while.


I can only speak from my experience, but:

For the decade that I've been at Google it has always been the case that quite a few people around me had 20% projects. This includes myself, my teammates, people reporting to me, people reporting to someone else doing a 20% project on my team and so on.


"Quite a few" is pretty imprecise. Did you ever do a count?

I did, around 2007: 8 or 9 engineers around a table. Maybe 1 or 2 had a 20%.


The corporate environment demands results every quarter, so everyone who cares about career must show measurable progress every 3 months. That's why the corporate crowd looks like a bunch of blind men with walking sticks, looking down precisely 3 feet ahead. They are the type that will walk thru an amazon forest, and their only memories will be mud and potholes on their way.


If I'm understanding it correctly, you are saying doing 20% time on a side project is a career risk as you won't be seen to be "delivering" as much as your peers (because the side project is not valued).

Is it even worse than that - you get rooted out because innovation side projects marks you out as being troublesome (as it does not align with corporate plans/goals)?


Caveat that I don't know what I'm talking about, but maybe 20% time violates the inclusiveness value because it doesn't require/include others' opinions:

> “Respect each other” is translated into “find a way to include and agree with every person’s opinion”. In an inclusive culture (good —it doesn’t withhold information and opportunity) with very distributed ownership (bad), you rapidly get to needing approval from many people before any decision can be made.


The only person whose opinion 20% time, as prescribed, does not value, is your manager's. (As they shouldn't be able to veto it.) Your 20% project is not going to get anything done if you're not taking the opinions of your collaborators/dependencies/customers into account.

IMO, The reason most people don't pursue 20% projects is because it's hard to be the manager, product manager, and main developer on a project that you're giving 1 day a week to. It's really, really hard. Most people don't have the skillset to do that well.

So the path of least resistance to a simple life is to just devote 100% of your time to what your manager wants you to work on, where its her job to manage, product manage/wrangle product managers, etc.


Within the genre of “Xoogler complains about Google” this is one of the better posts I’ve ever read. They really hit the nail on the head in most areas without overstating their points or reducing any of the complex systems to trivial hot takes. If you’ve worked at Google most of this post will ring true.

My main criticism would be the consistent references to the Waze cofounders blog post which I thought was entitled whining and probably the worst entry in this genre I’ve ever read.


Google is already running critical infrastructure of modern world. Of course risk mitigation is paramount. What would be 1000-s in list of risks of fresh startup easily worth full-time employee working at it in Google working exclusively on some bs like optimising talent acquisition reporting pipeline.


I don't claim to have answers, but to be fair some parts of Google are almost a utility by now so I appreciate if they are run as such.

I would not want my electricity company to "move fast and break things", and I like that they reserve loads of their people's thinking power and productivity on boring stuff like "risk mitigation" and "preventive maintenance". Please Google, apply the same to Search, Gmail etc.

What is difficult is how to be a company that is a utility, but that at the same time "needs" to jump aboard hype trains to stay relevant/rich so they can continue to be a utility.


> I would not want my electricity company to "move fast and break things", and I like that they reserve loads of their people's thinking power and productivity on boring stuff like "risk mitigation" and "preventive maintenance".

What about embracing solar / nuclear instead of maintaining the rent-seeking status quo and preventing adoption of renewable energy sources.


> They are all the natural consequences of having a money-printing machine called “Ads” that has kept growing relentlessly every year, hiding all other sins.

I remember way back when Google was a Good Guy. They bought Doubleclick, and most people, myself included, thought that could be an excellent thing. Doubleclick was a nasty company, and perhaps Google will make them into something good, or at least not nasty.

In fact, the influence went the other way. Purchasing Doubleclick sealed Google's fate, and their mindset came to permeate Google, turning it into what it is now.

I consider it one of the great tragedies of the industry.


> In fact, the influence went the other way. Purchasing Doubleclick sealed Google's fate, and their mindset came to permeate Google, turning it into what it is now.

This has always been my view. Google died in 2007, the thing that's still calling itself Google since then is Doubleclick.


Maybe managers like the author are the problem.

Startup founders who cash in, join Google, and are unpleasantly surprised to find that they are now just another middle manager who founded some startup nobody's heard of or cares about.

The empathy for the customer doesn't exactly ooze from the essay ("at the expiry of my three year mandatory retention period" == "now that I am all paid up").

Part one of the fix is vague management cliches, high minded mission statements and war metaphors. I seriously doubt Google lacks these.

And the fix for endless middle manager meddling? Endless reorgs? "Winnow the layers of middle management" (read: reorgs), and mandate that customers, support staff, and managers all waste their time on a weekly heart to heart (you'll note that the author doesn't mention going through the exercise himself).


> Maybe managers like the author are the problem... Startup founders who cash in, join Google, and are unpleasantly surprised to find that they are now just another middle manager..

The author was a Distinguished Engineer at Google and before founding AppSheet he was a Partner Architect at Microsoft. Holds a PhD.

I found the article very well written and would trust it over any other media reports.


This is a pretty insightful article. I would just add that nearly every large company follows this same arc. It used to be said about IBM, back in their dominant days, that their product bureaucracy was such that it would take them nine months to ship an empty box.

Relative to yesterday's comments about "wartime CEOs and peacetime CEOs", he says:

> a soft peacetime culture

Also:

> Within Google, there is a collective delusion that the company is exceptional. And as is the case in all such delusions, the deluded ones are just mortals standing on the shoulders of the truly exceptional people who went before them and created an environment of wild success. Eventually, the exceptional environment starts to fade, but the lingering delusion has abolished humility among the mere mortals who remain.

I summarized this yesterday (quoting someone else) as "born on third base and thinks he hit a triple."


This delusion (of being an exceptional company) is always built on some truth at the start.

And it is sad to see it vanishes. Hewlett-Packard used to be such a company, their products were exceptional on many levels. They had an incredible engineering culture and almost a cult following of users.

Today they make crappy printers and what else?

This is sad but I am not sure this arc can be avoided, success brings money and scale, and those are poison in the long run.


This is so true. I used to notice HP connectors at all the Ultrasound pathology labs I'd go to, they'd engineered plugs for sensor devices to HPIB compatible wiring which worked with nitrile gloves, smeared with Ultrasound goop, at a size anyone could un-do, with knurled screw tighteners. Lots of things about HP didn't work for me but I never yet met an Ultrasound or Xray technician who said their GUI was borked for them.

The market has moved on now but for a while there, if it was on a crash-cart in a hospital or related location, chances were it was HP.


>Hewlett-Packard used to be such a company, their products were exceptional on many levels. They had an incredible engineering culture and almost a cult following of users. Today they make crappy printers and what else?

The company you're looking for is "Keysight" (formerly "Agilent"): it's what's left of HP's famous test & measurement division.


That's the good old saying:

"Hard times create strong men. Strong men create good times. Good times create weak men. Weak men create hard times." ― G. Michael Hopf


Not sure it is a good saying. Brett Devereaux covers it in detail in his "fremen mirage" articles which I find a good read.

https://acoup.blog/2020/01/17/collections-the-fremen-mirage-...


A strawman argument, which no one is actually saying:

> Second: Consequently, people from these less settled societies are better fighters and more militarily capable than their settled or wealthier neighboring societies.

> Third: That, consequently the poorer, harder people will inevitably overrun and subjugate the richer, more prosperous communities around them.

I prefer real history to science fiction, myself. The 30s were indisputably hard times, but they produced the people who won WW II and went to the moon.


The 30’s (and the bad times before) also produced the people that caused WW2.


I'm not sure that follows at all. The people who were growing up in the 30s were much too young to be decision-makers during WWII (which itself started in the 30s, not the 40s, though Americans don't realize that because they entered the war late). They were barely able, if at all, to even fight in WWII. The people who caused WWII probably came of age around or before WWI. Hitler, for instance, was a low-level soldier during WWI. He wasn't a product of the 30s.


That sounds nice but is there a case when 'strong men' created good times? The example that I see people gravitate toward here is how soldiers coming back from WW2 in the US 'created' a society of unprecedented prosperity. But this of course ignores almost every single external factor that precipitated this prosperity, ignores that the prosperity was for a minority of people (both in the US and /especially/ globally), and the fact that war does not in fact make people stronger but tends to break them down. Ask your nearest vet.

This just sounds like a factoid upholding an antiquated ideal of masculinity.


Why is everyone here so worried about masculinity?

The "strong men" in that quote are those with strong will. Physical strength is secondary. The weak men are those with weak will. A successful enterprise, be it a company or an entire nation, always has a few of strong willed founders, with a vision and ability to inspire others. It creates prosperity for members of that enterprise. And every time such enterprises wither and die in the hands of weak willed risk-averse mediocrity.


It's the meme version of Strauss-Howe Generational Theory: https://en.wikipedia.org/wiki/Strauss%E2%80%93Howe_generatio...


Masculinity is not an antiquated idea. It is an identity for a huge amount of the population and it is quite nice when you embrace it.


The comment you replied to didn't say that masculinity is an antiquated idea. It said that an ideal of masculinity is antiquated; that is, one particular ideal of masculinity, not the idea in its entirety. You may disagree with that too, which is fine, but it's a different thing than you responded to. Different people see themselves in different ideals of masculinity.


Strong men also cry. Strong. Men. Also. Cry.


> their product bureaucracy was such that it would take them nine months to ship an empty box.

They didn't ship an empty box though, did they? That's what the bureaucracy is partially designed to prevent. Can you imagine the reputation loss if some rogue company element actually shipped a branded empty box?


It's a metaphor to mean the bureaucracy is so bad it takes a long time to do nothing, not that they literally shipped an empty box by accident.


I've seen branded empty boxes being shipped before. There were good financial reasons for it.


Probably the most famous such event amongst this crowd would be the original Star Wars action figures.

https://www.retrojunk.com/a/tlNWXQ9PQo/star-wars-figures-a-h...


I think you missed the point there.


> "the stated core values of the company are rock solid"

What is Google using after "Don't be evil"?

> "... problems. They are all the natural consequences of having a money-printing machine called “Ads” that has kept growing relentlessly every year, hiding all other sins."

Right. Google has only one product that generates real profits, and it has one main user entry point. So they have to be very cautious and not break what happens at that entry point. That fuels the culture. (The other products: [1]. All either lose money or are small markets relative to ads.)

For the first time in decades, Google now faces a real threat - somebody else has technology that can disrupt their position in search. Yes, ChatGPT produces some bogus results as an answer engine right now, but a year from now? Microsoft is willing to spend a few billion dollars on that.

[1] https://en.wikipedia.org/wiki/List_of_Google_products


> Don’t bother being innovative or doing something that wasn’t in the official plan set six months ago, because even if you did, your managers will not line up the associated dev, PM, Pgm, UX, docs, legal, and marketing resources to make it launchable anyway.

A six month planning cycle does seem slow, but this use of "being innovative" appears to mean "stealing resources from some other project".


It's odd reading this because none of it is surprising. Despite never working there and doing absolutely nothing to research the culture. It's obvious because it is everywhere, every company and government is so risk adverse as to be useless. Why? That I have pondered significantly.

My current thought process leads to virtual organizations formed using the existing employees as members of a virtualized democratic business. The CEO is voted in, the employee is the citizen, the managers are voted in.

I believe it would be different than the government we have because the government we have is possibly too large to function as it did closer to founding. For example, Walmart has more employees than the USA had people when the USA was founded.


Companies are not democracies, and companies that are democracies do not work at scale. Google is struggling precisely _because_ there is "too much democracy" and not enough leadership.

In a democracy it's not important to have happy customers, or ship product, as long as internally everyone is popular. So we spend all our time doing politics and getting nothing done.

>> It's obvious because it is everywhere, every company and government is so risk adverse as to be useless.

clearly this is not true - there are plenty of companies, and startups, that are very much not risk adverse. Large companies become risk adverse because bad outcomes affect huge numbers of people.


Is Google struggling, though? I think only in comparison to a particular set of expectations or aspirations that people have for it, right? Personally I share those aspirations for Google - which I believe is still one of the shining lights of our industry in my working lifetime - but there is nothing fundamentally wrong with large risk-averse stable businesses.

The author of this article clearly prefers the excitement and constant breakneck forward momentum of startups - and that's fair enough for him! - but that doesn't imply it is the objective ideal way for a company to be.


> Is Google struggling, though?

It depends on what you're measuring. I think Google is struggling to produce and maintain quality products. They don't seem to be struggling in terms of producing revenue.


The issue is exactly that Google is not struggling, which allows for this culture to grow and thrive. One day though, the music stops.


> Google is struggling precisely _because_ there is "too much democracy" and not enough leadership.

As an example, if Google had stronger product leadership, they would have one messaging/chat strategy instead of a dozen competing chat apps. Other Google products would integrate with and enrich that one messaging solution, providing more value for users and creating a Google suite that is more useful than the sum of its parts.


"Every company" was definitely poor wording, a seemingly qualifier should be there.

Perhaps democracy is a poor word as well?

My thinking is on changing the hierarchy in a way that results in positive impacts to productivity, innovation, and employee satisfaction. Perhaps in a way similar to the formation of the USA.

The top down method currently used seems to have a rather negative impact. It is still a popularity contest, the only difference I see is where that contest is focused.

Is the preference not to want to work and make things better? Is that gone? Is the new model do what you're told and find another 10% effort job or five? Possibly. Maybe people like that, maybe they don't.

Though I prefer in life to look at potential solutions than at problems. I realize that's not normal


> It is still a popularity contest

The point of the focus on bottom line profits is because it cannot be gamed like a popularity contest.

Banks would never add money, or subtract money, from a bank account just because of someone's fame or popularity, so they serve as the neutral arbiter.

It can of course be gamed in other ways such as prioritizing quaterly profits by neglecting longer term potential.


Are you saying co-ops don’t work? Mondragon is “at scale”. The US is failing at [affordable] health care compared to a country like Cuba. Worker unions are closer to democracies and work well too.


Thanks for that. I didn't know about Mondragon, but given the size it's a subject I am now very interested in.


I’m still interested too. If you find anything solid on it, let me know if you can, email is in bio :).

I was told about it by a European but otherwise have not heard of big worker coops without looking for lists.

This coop is bigger than any organized crime like Yakuza. The town where it was founded in is entirely resident owned. I can’t go anywhere in the US without there being corporate landlords.


Mondragon is gigantic. ~200,000 people in cooperatives in 30+ countries. It produces almost everything. It spawns cooperatives in other countries and it also helps new cooperatives to come to being.

https://www.commondreams.org/views/2012/06/25/yes-there-alte...


This doesn't necessarily track, many of Google's greatest mistakes can be directly traced to "too much leadership", G+ being the prime example.


> Google is struggling precisely _because_ there is "too much democracy" and not enough leadership.

I don't see any real evidence that this is the case. I think it has more to do with Google being an enormous corporation than anything else.


Sounds like you’d be interested in a co-op!


This is dead on. When I worked there I summed the culture up as code bureaucracy. Truly awful place to work for someone who likes to build. It taught me what I don't want in a company I work for or run.

Side note, I really enjoyed the interspersed poetry excerpts in this article. Refreshing from normal articles whose call outs just have you reading the same sentence twice.


> From what I saw at Google Cloud, they could do a lot better identifying and nurturing talent, moving talent to the best fit roles, and overall optimizing the people already in the company. Instead, the pattern seems to be wait till someone is unhappy and leaves, then just open a req to replace them.

Way back in time, when employment was a lifetime gig and jumping between companies was rare, IBM invested a lot of effort in an elaborate internal mobility computer system that did this sort of thing. The system could do succession planning, training needs analysis and much more.

Companies talk tht talk on this stuff nowadays but hardly anyone does it effectively because of the core problem - when talent is scarce and employees have no loyalty, what's the point of training someone up only to see them jump ship to a competitor who gets the benefit?

This simple economic fact also underlies the strange anomolies in the marketplace for talent, such as your best bet for a big pay raise being to jump to another company rather than to strive at your current gig. Over the years, job hoppers (as long as it's not taken to excess) will do much better than loyal employees who stick it out.

I don't know if things are any different for Google. Perhaps the great pay, the gifted colleagues and the opportunity to work on the very biggest systems make Google special, the sort of place that can invest heavily in internal development and internal talent mobility.

I suspect not though, making it just as hard for Google to meet up with the article's lofty recommendations as any other mega corp.


What's the point of being loyal when you get more money for job-hopping, and your current company will hire a new person for much more money than they're already paying a long-time loyal employee doing the same or more advanced work? If they want loyalty, they should demonstrate it themselves first.


It pays more to jump ship. Until that stops being the case (employers pay their existing "loyal" employees more to retain them) that will continue happening. Unfortunately, it seems that tech companies value fresh grads willing to do unpaid overtime more than retaining mountains of knowledge. We are witnessing the sowing of not valuing domain knowledge by businessfolks whose domain knowledge starts and stops at 'synergy' and 'growth hacking'.


> This simple economic fact also underlies the strange anomolies in the marketplace for talent, such as your best bet for a big pay raise being to jump to another company rather than to strive at your current gig

This doesn't appear to be true. The average time in job at FAANGs isn't low because people move around, it's because they hired so fast that the average person has been there less than a year, as the article said.


> employees have no loyalty

lol. wonder why?


Things were already pretty screwed up atleast a decade ago when I was there for a short while, this was around the time Google+ was being "dogfooded", so it wasn't even quarter the size it is now. I was only an intern but the other older programmers I was working with were all bored and doing minimal work, with no sense of pride or purpose, treating it like a government job with a good lunch program and free massages.

The pay is high and work relaxed, so a lot of 'local maximizers' tend to seep in, the type of people who want to do just enough and avoid any sort of extra effort or experiment with anything new. The kind of people who would choose courses based on how easy it is to get a high grade and not based on how interesting or useful it would be.

For people to innovate constantly, they need to feel a sense of pride in service to customers and a sense of purpose as to why they are doing their work. For an organization to innovate they need fear that they will go extinct if they don't. As long as the firehose of revenue that is search keeps going, they will keep sucking at everything else.


This bit jumped out at me (about hiring):

> The problem and negative impact lies in the manager ranks and intensifies at the director level and higher. Hiring interviews at this level are entirely subjective and the quality of the interviewers matters. Google Cloud in particular has grown rapidly by hiring mid-level and senior talent from every enterprise company around. In most cases, the skills needed to become a director at not-so-elite enterprise company X are not aligned with the skills needed to become an effective director at Google. And when people are hired from an elite tech company Y, is it really because they were killing it there but still got lured away, or it is because they ran out of runway there and Google was a good place to land.

Once you start hiring bad middle-managers and directors, you might as well bid the company goodbye. Like a parasite, they will intertwine themselves in the various processes to make themselves indispensable.


There’s only so many good managers/directors with that sort of experience. So either you have to promote from within or lower your standards a bit.


This is a lot of detail without a lot of business substance that matters. It's not true insider information, it's opinion-based, and it's not really all that relevant to whether Google is "in trouble."

The premise is that people are catching up to Google while Google mismanages. Microsoft is coming out strong and refreshed (and, I agree, they are seemingly very well managed), and small competitors are nipping at their heels.

The intro of this article touts the new Bing AI search engine as a major threat to Google. But...is it? Microsoft released what is essentially a proof of concept piggybacking on OpenAI's work.

So is Google really in trouble? Let's look at this through the lens of revenue [2]:

- Google is essentially a search monopoly. It's impressive that Bing has gotten anywhere, but it's too early to say if gaining 4% marketshare in a year [1] is the sign of a lasting trend. The fact that Bing and Edge are persistent defaults with constant nags in Windows 10/11 as well as being integrated into Windows search and 90%+ of people still switch their browser and search to Google tells you a whole lot about consumers' preferences.

(On this note, remember that the better product doesn't always "win" in capitalism. For example, Microsoft Teams has more active users than Slack by far [3], but that's not because it's the better app - that's because it's part of an ecosystem and a migration path for Microsoft's army of business clients)

- GCP will be a cash cow forever, just like AWS and Azure.

- Android and the Google Play store are also forever cash cows. Android and iOS are a forever duopoly with no chance of disruption.

- YouTube: another cash cow with both ad and subscription revenue with no sign of disruption.

Sure, if Google Search fails, the company is basically less than half the size. But the idea that a company like Google is going to screw up on search in the long term isn't based on any sort of evidence in my mind.

[1] https://www.statista.com/statistics/216573/worldwide-market-...

[2] https://fourweekmba.com/google-revenue-breakdown/

[3] https://kinsta.com/blog/microsoft-teams-vs-slack/


I would point out

> - GCP will be a cash cow forever, just like AWS and Azure.

GCP is still losing something like a billion dollars a year.


> Decide which (few!) products need legal review and let the others run faster.

That is unfortunately not really possible. At the scale of Google, you have to keep up with a ton of different regulatory environments - the US and EU as large blocks which lead with regulation like GDPR, but also the 150+ other countries that have their specific demands. On top of that come all the diversity issues - something completely innocent and expected in the US and EU can become a criminal offense in other countries (e.g. Saudi-Arabia and women's or LGBT rights, China/Russia and anything democracy, India and running afoul of the BJP).


It's curious how HM conventional wisdom is "Google is too powerful" and "Google needs to work harder" at the same time.


Just like Microsoft in the 90's, they're too powerful and one consequence is that they can get away with inefficiencies and slacking.

Like a landlord who doesn't work because he's getting rent money every month, and don't even make sure the appartments are in a good condition, and ignore tenants calls because he knows that if they leave he'll find new tenants anyway.


Also "doesn't respect privacy" but "too much bureaucracy and privacy reviews".


> Risk mitigation trumps everything else

Yet, Google has no problem shutting down services that millions of users use daily (greader), and worse, tens of thousands of customers use (IoT Core). It seems their reward-and-punishment system, aka culture, has some issues.


Google with its highly concentrated pool of galaxy brains has the potential create world-changing products at the same level of SpaceX or Tesla.

Its a pity, I recall the days when I was so excited to use Google Cloud or just watch their keynotes. Regrettably, as the years went by it got more and more diluted.

Unlike Microsoft, the obstacle for Google is not greed or hubris, its tolerance. I hesitate to elaborate further, as the specifics are likely to attract scrutiny or censure.


lots of people here piling on google over the past 2 weeks, interested to see how it goes


As a Googler: Not just the past 2 weeks, pretty much every Google-related article on HN is a dogpile. And that's fine, I even agree with like 95% of this article (minus the negative characterization of the No Heroes mantra, that exists for good reasons). Just important to note the general (understandable) anti-FAANG bias on HN.


How do you think Google will fare in the world of AI? From the outside it feels like Google has the lead in tech, but reading this article makes me question the management/if they can use that advantage to win in the long run


I don't work anywhere near AI, but the talent is here to do it. Just have to fix the organizational issues that are pretty severe at the moment.


I see that too and wonder if this will lead to an over sold stock and a similar Microsoft lost decade which may be a few years in. Google overall is very profitable and just needs 2-3 wins over the next few years and they have the cash to do it.


"This is a closed world where almost everyone is working only for other Googlers, and the feedback loop is based on what your colleagues and managers think of your work."

That is no divergence, in other words: div u = 0, no influx or outflux, a self contained, closed system.

The bane of such organisations, not mentioned in the article, is groupthink: a powerful force that pulls you into the center of mediocre sameness. Imagine if IRS solicited feedback from yoir neighbors to determine how much taxes you pay. A religious neighbor across the street knows that you don't go to church, so he writes a negative feedback to IRS. Eventually, you're either forced to behave, or the group kicks you out. That's groupthink.


I think all of this is just a symptom of the fundamental problem - Google employees have been told they're special and coddled so much they believe it. They genuinely think they are inherently superior to the rest of us - either customers or even just other practitioners at other companies.

I saw a talk about an upstream change to submodule initialization in Git being made by a Google engineer and she was asked about the specifics of how submodules ordering would work for the default use case. Her response boiled down to "I don't know, how we do it is we <XYZ> and we're more interested in our use case".


tl;dr Acquihire founder is shocked when the giant behemoth that did the acquisition is motivated to protect its billions of quarterly profit at the expense of empowering all the brainpower it employs to do innovative and inherently risky things.

Really good piece of writing though, it never loses the plot despite being a longer read.


“it never loses the plot” - great assessment. it really does hold your attention throughout.


Why do you position this as a binary option?

Google must have tens of thousands of people not directly working on ads. What exactly is so "risky" about this "subsidized" surplus working on risky bets?


but they do lots of risky bets.


Your comment is spot on, and the line you wrote summarizes perfectly the article.

If you are wondering about the downvotes, it's because HN'ers hate when you state the truth about the world being larger than the web startups microcosm.


This article speaks to me.

> But very few Googlers come into work thinking they serve a customer or user. They usually serve some process (“I’m responsible for reviewing privacy design”) or some technology (“I keep the CI/CD system working”). They serve their manager or their VP. They serve other employees. They will even serve some general Google technical or religious beliefs (“I am a code readability expert”, “I maintain the SWE ladder description document”)

From my short time there, this is absolutely spot-on and was a driving factor behind Google being the only place I've worked where I legitimately hated my job.

> You don’t wake up everyday thinking about how you should be doing better and how your customers deserve better and how you could be working better. Instead, you believe that things you are doing already are so perfect that they are the only way to do it. Propaganda becomes important internally and externally. When new people join your company, you indoctrinate them. You insist on doing things because “that’s the way we do it at Google”. Never mind if most people quietly complain about the overall inefficiency and incompetence

When I got into Google, our team was using a unified and centralized logging system for everything. This system made sense, though it took a bit of time to grok.

By the time I groked it a few months in, I learned that this logging system was getting deprecated and that we shouldn't use it.

The alternative? It wasn't in production yet.

Deprecating something in favor of something else that hasn't even shipped was CRAZY to me. So much value wasted.

At the time, I felt like there were examples of this EVERYWHERE. Despite having the world's largest monorepo, there was SO. MUCH. DUPLICITY. Bike-shedding to bike shed the bike shed in hopes of chasing that promo to P4 or whatever (which, let's be real, everyone's chasing for the RSU grants).

> At the junior levels, Google has a challenging interview process and the general caliber of hires is good. Most of this raw talent is wasted and their skills gradually atrophy (but enjoy some free massages to help get over that!).

The Leetcode interview they foist onto candidates is completely unnecessary and is, I believe, a major driver behind the rot that they are experiencing.

When you over-index on hiring devs who can solve LC hards, you get devs who are very good...at solving LC hards.

They'll build hella interesting data structures and algorithms that have been built, like, seven times before. But building boring "soft" stuff to help drive adoption, like documentation or bugfixes? Not impactful enough. (Documentation was not weighted heavily in promo decisions when I was there, and it showed.)

I am particularly salty about this because I was down-leveled due to a single question I didn't answer well (despite nailing everything else) on a topic that I never EVER used during my time there. The guy that asked it was a nice guy, but it was definitely trivia.

> Google Cloud in particular has grown rapidly by hiring mid-level and senior talent from every enterprise company around. In most cases, the skills needed to become a director at not-so-elite enterprise company X are not aligned with the skills needed to become an effective director at Google.

If I had to guess, these might be strategic hires to build deeper roots into their prospective/current customers to help proliferate GCP. I think AWS and Azure use the same strategy.

> And finally, for all the employees, don’t spend your time on memegen. It is a wallow chamber and all that internal finger pointing doesn’t help anything.

I wasted so much time on Memegen. I agree with Praveen. It's a huge time sink and (at the time) was about as FUD-laden as /r/popular.


> The Leetcode interview they foist onto candidates is completely unnecessary and is, I believe, a major driver behind the rot that they are experiencing.

Even worse than a company's obnoxious gatekeeping chickens come home to roost..

Think of the last ~20 years of so many CS undergrads spending discretionary time training for "the coding interview".

To the exclusion of building/exploring things that they want to make or are interested in.

So much shared zany student projects, open source, startups, piqued research interests, and personal enrichment that didn't happen.


Hard agree on the interview focus. I think Google's interview culture has optimized heavily for missing forest for the trees, where the person will be extremely good at solving hard but well defined problems. But general customer empathy, releasing things that matter, long term maintenance are not favoured at all. I never worked at Google. But had a senior product manager who joined a startup where I worked. We were building an SMB focussed product for developing world. At one point of time a pissed off customer was on the call and the account manager begged the xoogler to join the call. The guy was astonished at the suggestion and blurted out that "we don't talk with customers, we build". The product doomed, I moved on. But that one incidence has had lasting impression on me.


I've been at Google for 8 months and this is all true. The ads machine keeps pumping out money but the organization is dying before my eyes.


> trapped in a maze of approvals, launch processes, legal reviews, performance reviews, exec reviews, documents, meetings, bug reports, triage, OKRs, H1 plans followed by H2 plans, all-hands summits, and inevitable reorgs.

Sounds like any large corporation after 20 years.


Turns out that's about the natural lifespan of the Polyhomo corporaticus


I can't remember where it's from, but one thing I read put it something like this: as a company grows, the proportion of people working to further organisation's goals shrinks compared to the proportion working for the organisation.


I’ve been thinking about this a lot lately.

I think once a company is past its garage phase (a group of engineers in a room + a pizza), think Amazon/Facebook/Microsoft, its velocity gets reduced drastically.


This isn't a very insightful observation though, velocity is not the be all and end all of everything.


Very well written and insightful. Thank you for sharing.


> 175,000+ capable

capability is measured on output, and if they are not producing much, then they are not really capable. Potentially capable more likely


Capable literally means having the ability to do something. Doesn’t actually mean you must do it. There are capable hackers who don’t feel compelled to take systems down.

There are plenty of trust fund babies who are intelligent and can output economic value. Doesn’t mean they do.

In Google’s case, the individuals can be capable but the org may not be. The sum is worst than the parts.


"capability is measured on output"

No, it isn't. That's effectiveness or impact. As an example, I'm capable of running 10 miles per day but can't be bothered.


> I am a code readability expert

Can someone explain why this is religious?


I built and launched a fairly simple project at Google- a web site for the upcoming North American solar eclipse. At some point I had to do a legal review to launch the website and come up with a "GDPR narrative" for EU users. But our users were almost 100% american and the entire project was centered around an event occurring in the US. SO I am very open to the idea that Google needs to relax its process around its lower-impact projects.


Google erased more than $100B in shareholder value with a single botched demo. I imagine events like this will only further increase their risk aversion.


I have sympathy to both sides of this problem because the truth is, ALL the GPT do this, and what google botched was the message. I don't understand why it wasn't a similar share price plummet in Bing, OpenAI when the lies sold as truth surfaced there.

In part, and I know this is 'blame the victim' I think shareholders truly are dumb, if they thought it was AGI and some god given uplift to the cloud-mind: it was never going to do what they wanted, and rather than 'Google erased' I'd say google communications/marketing erased: they really didn't prepare this package for release well.

Too much infeasible community expectations on something which was incapable of doing what they wanted.

No matter what the $100b is gone. I'd say the buyers at the bottom picked up a bargain btw.


> I don't understand why it wasn't a similar share price plummet in Bing, OpenAI when the lies sold as truth surfaced there.

Because Bing isn't a material profit generator for Microsoft right now, AI search is a lottery ticket for Microsoft while Google is playing defense for their main revenue stream.


> I don't understand why it wasn't a similar share price plummet in Bing, OpenAI when the lies sold as truth surfaced there.

Maybe most consumers ultimately core more about the improved search capacity of Bing than that it might say weird or offensive stuff in some prompt-engineered worse cases. Plus it doesn't need to be 100% accurate, just no less accurate than the average person's SEO-laden Google search results.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: