One time I printed out all the code--at that time ASP, HTML, CSS, and Javascript--that got executed for one page load of the homepage of my employer's primary website. I taped the pieces of paper end-to-end and hung them on my wall.
It made a great conversation piece with my coworkers. Non-technical folks (most of them) were astounded that so much text was being interpretted and executed every single time they loaded the homepage (in less than a second).
What was the point? It helped set a certain emotional tone to our conversations. Folks found it a lot harder to demand their project be done "right now, it's easy" when directly confronted with the complexity behind a single page load.
Likewise, stories that highlight the immense speed and complexity of high frequency trading help set an emotional tone of alienation and fear. It helps trigger the same reflex Frankenstein and The Terminator played off of: "maybe we're unleashing technological forces that no one can control."
But of course if you are well and truly versed in a technology, that feeling goes away. I knew that our crappy brochure website was not very complicated as websites go.
As an ops-guy (interestingly enough, at an HFT company), I used graphviz to draw out a diagram of all the network interfaces and routes that were being used when trading on a single exchange for one single instrument.
It was a huge, big, complex, ugly thing. We laughed. Good times.
I really like that. Did you print libraries and the like, or just the stuff you wrote? I could see value in having a bound version of jQuery if it wasn't on the wall, "I didn't write this, but I know what is in it and how to use it."
This predated the popularity of js libraries like jQuery, so it was all code that we had written ourselves.
Into a text editor, I pasted the HTML source of a rendered page as presented to the end user, then went back and replaced every call to an external js or css with the actual contents of those files. Then at the top, above the doctype declaration, I pasted in the ASP bootstrap code that ran on every page load. I did not include any representation of the compiled code behind the site, like SQL Server, IIS, etc.
If were going to do this now, I would definitely include js libraries like jQuery. The point for me was to illustrate just how complex websites are, not to take personal credit. If you wanted to illustrate it more precisely, maybe you could use different font colors for your code vs. library code.
If there was a similar video showing all of the electronic sensors of a modern airliner flowing into the central flight control computer would it would engender the same sort of trepidation about air travel? Should we be afraid of something just because it's "complicated" to someone unfamiliar with the state of the art?
There are a lot of valid criticisms you can make about modern financial markets, but claiming that we are using computers to do things better than we did 10 years ago is a bad thing isn't something I'd expect to see here on HN.
> but claiming that we are using computers to do things better than we did 10 years ago is a bad thing
But they are not using those computer to do something better, they are using those computers to do something that was impossible 10 years ago.
The problem I have with HST is what purpose does it serve, other than offer another way to gamble on stock price movements.
Now there is nothing new about gambling on stock price movements but with HST it takes the control out of the market and puts it into the hands of a bunch of computer programs.
And to say that can't cause problems, you have to look no further than the hoax bomb at the white house tweet that wiped out $130 billion in market value in the matter of seconds.
Without those HST computers system all trying to out do each other, that event would not have been so dramatic.
If you can trade faster, the market can react to information faster. Stocks dropped almost as soon as the tweet was released, without needing to wait for a few major news channels -- and recovered in five minutes after people stopped panicking.[1]
The question is: Does fast trading provide a net positive to society?
Real investment decisions - as in, decisions of which factories to build, which products to develop, who to hire, and so on - are made on a time-scale of weeks or months. Having the stock market react on a sub-second time scale certainly has no effect at all on those decisions.
To gain some perspective, consider if trading operated on an hourly-auction type system. The stock price would react slower and in a different manner that it does today, and that could change the income distribution among traders. But honestly, why should anyone care?
When it comes down to it, there is no upside to trades going that fast to anyone outside of the myopic circle of professional traders. Even those professional traders only have an upside as long as they participate in a vicious arms race. However, there are downsides.
One downside that many people argue is that the resulting distribution of income is not just, because HST firms suck a revenue stream out of the economy without building anything real.
The more important downside (in my opinion) is that HST sucks intelligent people away from sectors of the economy where they would positively contribute by developing and improving directly useful technology.
Why do you assume that those intelligent people would not engage in some other little value add activity that can make them a lot of money. How much value add do most web social startups provide? The main feature of capitalist economy is that it allows people to work on whatever they want and not on something that some higher authority deems to be "useful"
The main feature of capitalist economy is that it allows people to work on whatever they want
Completely off-topic to the original discussion, but assuming that you intended to imply the quantifier that I think you implicitly intended to imply - i.e., "all people", or even "most people" - you must be living in a completely different world and/or a very cushy bubble. [1]
I expect many people on this site are lucky enough that they can work on whatever they want - either because their interests happen to align with what's currently in demand by the market (as in my case) or because they were lucky enough to be born to rich parents or win the startup lottery.
But take a step back and look outside of that world. Consider, for example, the many people working as cashiers or cleaners. Do you really think that all or even most of them work those jobs because that's what they genuinely want to do, given a choice? It seems much more likely that the main reason why most of them work in those jobs is that they have to make ends meet somehow, and those are the kinds of jobs available to them.
As for the more on-topic part...
Why do you assume that those intelligent people would not engage in some other little value add activity that can make them a lot of money.
I don't. There may be other talent-wasting sectors in the economy (and I guess you always get some geniuses spending their time on whatever the equivalent of card counting of the day is). I have simply pointed out that HFT is one of them (and I do believe that finance in general is the worst offender at this time).
[1] If you intended to imply the quantifier "some people", I apologize for my misinterpretation - though in that case, I would wonder what the point of the statement was. Certainly it doesn't help paint capitalism in a positive light, because every economic system allows some people to work on whatever they want, while the rest tend to have the same superficial choice of job that they do in capitalism. (E.g., you were not simply assigned a job in communism either.)
There is no money in doing really useful things. As long as that's true, lots of smart people will instead find debatably somewhat useful things to do that pay more money.
As opposed to what? We know that fast trading is being judged against non-fast trading. Are you asking us to judge webapps as opposed to non-web apps (for which anyone could give you a detailed response), or are you just trying to insult webapp developers?
> Are you asking us to judge webapps as opposed to non-web apps (for which anyone could give you a detailed response), or are you just trying to insult webapp developers?
I'm (I would have thought quite obviously) wondering aloud if everything we do needs to provide a net positive to society.
> The question is: Does fast trading provide a net positive to society?
Why is that the only or most important question? How do you even define "a net positive to society"? Are we talking about utilitarianism, and if so, are we trying to maximize the total utility, or the average utility, or perhaps the minimum individual utility? Does my eating a candy bar provide a net positive to society? And even if something can somehow be shown to not provide a net positive to society by some metric, should it therefore be prohibited by the threat of violence (i.e. made illegal)?
Firstly, the people who run/own those markets make money on every trade (i.e. ever buy/sell) so they'll make money if the market is going up or down.
Secondly those manipulating the market will be in the know so they'll be in a position to take money away from those people/organisations that are on the outside.
You only have to go back to 2007 to the GFC to see how easy it is for impotent governments and greedy bankers to screw the world.
Do you think any of those corrupt GFC bankers are suffering now?
I don't see any comments here critiquing HFT simply because it's complicated. Rather, they seem related to whether it's actually a net-positive for society.
Every description of an HFT algo seems to fall into one of three categories:
* Acting on public information, milliseconds before anybody else - which helps everybody else about as much as insider trading does.
* Acting on trading information gleaned from "bid stuffing" (making and canceling orders really quickly) - which helps everybody else about as much as front running does.
* Detecting the presence of large trades about to go through or going through and capitalizing on the price movements they cause - i.e. imposing a tax others making large trades in the stock market.
In return, they flood the market with liquidity when it is least needed and withdraw it suddenly when it is (e.g. when prices are diving).
Acting on public information, milliseconds before anybody else - which helps everybody else about as much as insider trading does.
"They can do it faster, therefore it must be illegal."
Acting on trading information gleaned from "bid stuffing" (making and canceling orders really quickly) - which helps everybody else about as much as front running does.
The only people that notice this behavior are...other people capable of doing this behavior. Why should it matter to you, the long-term investor, the trading tactics computers employ at the millisecond scale?
Detecting the presence of large trades about to go through or going through and capitalizing on the price movements they cause - i.e. imposing a tax others making large trades in the stock market
This happens in any market at any timescale. Everyone capitalizes on trends.
You are replying to the wrong points.The question is not are these things illegal, or does everyone do them.
question is, do they benefit the market as a whole? Traders do not have a right to perform HFT, and if it destabilise markets, we can take steps to reduce it (of course, there is then the issue of how to take steps without causing different problems)
How else would you connect the exchanges? Or you don't want major exchanges to be connected, and say, if you dump a lot of stock at one exchange you don't want that information to propagate to other exchanges?
Benefits of having HFT traders, is that at the cost of having them around you can have fair and level ground. So if you come to one exchange to do a transaction, you don't have to think much about exchange intrinsics, like liquidity available there, fee structure, etc. Because these differences are being arbitraged away by HFT traders.
And again, what is the alternative? Exchanges that are connected by human traders making phone calls?
The real question is: Why are there multiple exchanges for the same papers to begin with?
In the case of stocks, for example, there has to be one ultimately authoritative copy of who owns which stocks anyway. So why not just do all the trading in the place where the authoritative copy is stored?
That would certainly seem to be more efficient from the perspective of minimizing the overall social cost.
Why are there multiple exchanges for the same papers to begin with?
Because it allows the exchanges to compete on features (latency, order types) and pricing (transaction fees, connectivity costs).
In the case of stocks, for example, there has to be one ultimately authoritative copy of who owns which stocks anyway. So why not just do all the trading in the place where the authoritative copy is stored?
For equities, trading and settlement are two separate steps. Trading occurs on the exchanges and, for U.S. equities, settlement is handled by the DTCC, the central counterparty for all U.S. equities trading. Handling all the specifics and details of what happens after a trade is executed is a massive industry.
For some products, trading does occur only on one exchange. Typically in futures trading, an exchange will develop a product (a contract) and that contract can only be traded on that exchange which also handles settlement.
> So why not just do all the trading in the place where the authoritative copy is stored? That would certainly seem to be more efficient from the perspective of minimizing the overall social cost.
And what if trading on that exchange will stop for a couple of days for technical reasons? What kind of problems can that create to stock of large company, that can be traded only on that exchange? Or what, if the whole exchange will go out of business? Or decide to charge arbitrary large trading fees?
Competition and diversity is generally a good thing. Tend to increase efficiency and minimize overall costs. That's valid for exchanges as well.
The reason there are multiple exchanges is the same reason you can buy the same pair of shoes at 10 different places: it is competition.
Also, what is the social cost you are referring to? There are a lot of people here saying that HFT doesn't provide "social value". Does it somehow provide less social value than traders screaming at each other in the pits? Similar types of trading always existed, except now it's done by computers. For what it's worth, HFT provides well-paying jobs for a lot developers and ops people and often is very supportive of the engineering community.
If you try to design a system of publicly traded companies from first principles, then the purpose of exchanges should be to provide a service to publicly traded companies. That service would be maintaining the authoritative record of who owns how many shares of the company.
Given this notion, competition is a good reason for the existence of multiple exchanges, because it means companies can change which exchanges their shares are traded over. However, it is not a good justification for the fact that trading of the same stock happens on multiple exchanges.
As for the social cost, you do realize that HFT does not come for free to society. At a minimum, society must somehow pay for those well-paying jobs to developers. And what do those developers give back to society? Before you answer, please consider whether you should distinguish between algorithmic trading and HFT. I do believe that algorithmic trading is useful to society (because it can do the job that screaming traders used to do better and cheaper), but the subset of HFT is not useful.
The only things anyone ever seems to be able to answer for HFT two-fold: one, that stock prices change faster, and two, that the spread is smaller. But one point one, nobody in the real economy cares about that, and to point two, the decrease in spread also doesn't matter to anybody in the real economy, because what you really care about there is the fluctuation of the share price over a larger timescale such as one full day. I have not seen any evidence that this fluctuation is affected by HFT in any way.
If you try to design a system of publicly traded companies from first principles, then the purpose of exchanges should be to provide a service to publicly traded companies. That service would be maintaining the authoritative record of who owns how many shares of the company.
I don't think there's any reason to think that exchanges' main purpose for existence is to provide service to publicly traded companies. Exchanges are just a store, and their purpose is to buy/sell stuff and make a profit. So, in that sense, having multiple exchanges selling the same stock is the same as having multiple bike stores selling the same bike...it's competition and there aren't many downsides to it.
As for the social cost, you do realize that HFT does not come for free to society. At a minimum, society must somehow pay for those well-paying jobs to developers. And what do those developers give back to society? Before you answer, please consider whether you should distinguish between algorithmic trading and HFT. I do believe that algorithmic trading is useful to society (because it can do the job that screaming traders used to do better and cheaper), but the subset of HFT is not useful.
Nothing comes for free to society. Funding a never-ending number of failing start-ups doesn't come free to society either. What is that giving back to society? Your implication is that HFT trading is somehow taking something from society that it doesn't deserve. What is it taking? Also, in terms of making distinctions: HFT is the superset and AT is the subset, not the other way around. All AT shops are HFT shops, but there are actually quite a few HFT shops that don't run algorithms and instead run based on inputs controlled by traders.
The only things anyone ever seems to be able to answer for HFT two-fold: one, that stock prices change faster, and two, that the spread is smaller.
This is the crux of the whole thing. Why does anyone have to answer for HFT? This is implying that HFT is hurting people however you haven't not given any proof of this (besides that it doesn't add value). If anything, I think HFT's biggest crime (as someone else has mentioned) is that sucks some really smart people into working on problems of a rather limited scope.
This is actually how most of the European equities markets start and end the trading day. During the auction period, anyone can submit an order at a given size at price. When the auction ends, the exchange matches at the price that maximizes the number of shares traded. The rest of the trading day operates in what is referred to as a "continuous auction" where orders are matched continuously based on price/time priority.
To be clear, the way (most) exchanges solve this problem now is by what's called "queue" priority. The longer an order has been resting at a level the higher it's priority is.
This means that those who can respond faster can get into a price level sooner. Breaking this out to minute bounds doesn't mitigate their advantage in any way shape or form.
It is hard to know what the results of a change like this would be. I suspect it would make the markets much less stable as there would be less information to make accurate prices, causing huge variances on minute long ticks.
Show me a market where such a restrictive view is mandated and I will show you a failed market. This notion that "trading should benefit the market" is complete and total nonsense propagated by people with no understanding of liquidity. Trading is adversarial by definition.
1987 was caused by portfolio insurance from major funds, not HFT (which didn't really exist then as it does now). HFT also didn't cause the mortgage crisis. That was long term consumer financing & Gov mortgage buyers & pension investors. HFT was definitely involved in the flash crash, but what were the long term implications of that? Zero. The most recent blip was caused my dissemination of bad news via a source that had been compromised. Again, not HFT.
Want to hate HFT (I do!)? Hate it because it isn't profitable (which is why I left in 2010) and because it still sucks up engineering talent like a black hole of despair.
These anti-HFT articles that occasionally come out are hilarious because the money that put HFT on the public radar simply isn't there anymore. Look at GETCO.
The question I have is why is the public so willing to accept disinformation? Residual banker hate?
> Detecting the presence of large trades about to go through or going through and capitalizing on the price movements they cause
Large trades move the market, full stop. That's a feature, not a bug. Moving a lot of size changes the market's estimate of the value of whatever you're moving. Splitting up large orders into smaller pieces is attempting to hide that information, why should that be a privileged operation?
You forget that for every buyer there is also a seller.
If HFTs push the markets higher slightly faster because of new public info then while it might be bad for you if you are buying on that news, it's great for whoever already owns the stock and is the one selling to you.
The same applies to your 3rd point. It might be a tax on whoever initiated the large trade, but it's a benefit to whoever is on the other side of the trade. HFTs put new information into the market much faster than humans ever could making them more efficient. They're also doing it at a lower cost than human market makers ever did.
Would you rather have a person or a machine serve as the market maker?
If anything, HFTs have made it cheaper to trade. Because of the way exchanges are setup, the man in the middle will always be making a cut of the trades. Now though that cut is measured in pennies rather than what used to be often 1/2 dollar spreads.
Sure some of the predatory algorithmic trading serves no benefit to anyone, but you will always have people gaming/attacking the system if there's arbitrage potential.
All the critiques of HFT are a century old. When telegraphy was invented, it was feared that the ticker-tape would create devastating waves of speculation, by speeding up the markets beyond human comprehension.
When markets went over to computerised trading, it was argued that the human element of open-outcry trading was vital in preserving a culture of honesty and integrity.
Critiquing HFT is myopic, because it's based on a meaningless definition of "high frequency". HFTs are doing what traders have always done. There's a legitimate argument against speculation, but it's pointless to single out speculators that deal in the very short term. Singling out the newest technology is just a cheap shot, there's no fundamental difference between trading on a millisecond horizon or a minute or hour horizon.
Never heard anyone arguing HFT is terrible because the trading floor died either. These are straw men constructs designed to paint HFT critics as luddites.
I'm undecided about HFT's ability to provide liquidity in the market. There are certainly some drawbacks (e.g. you have to have high capitalization to afford HFT colocation), but there might be some tangible long-term benefits as well.
But I'm more concerned about how much of a waste it all is. Jeff Hammerbacher famously quipped that "the best minds of my generation are thinking about how to make people click ads," when referring to developers pounding at the doors of google's and facebook's recruiters. HFT is similarly unfortunate. Somewhat useful maybe, but overall a depressing use of brilliant minds.
It is a common misconception that you have to have high capitalization to afford colocation. There are many firms providing shared colocation for monthly costs on the order of high end web hosting (though with the rise of cloud hosting web hosting is coming down rapidly in price).
As someone who works in HFT, you have hit the nail on the head about the real problem with it. It isn't front running, or instability, or unfair trading or any of that. It is simply that so many very smart people are working on it, instead of other more useful ventures. Of course, I feel the same way about data mining social networks.
> Never heard anyone arguing HFT is terrible because the trading floor died either.
It seemed fairly clear to me that the parent wasn't saying that at all. What he was pointing out was that discussion of, and concern about, faster access to information, decision making and execution causing volatility in the market isn't new. That's not a straw man at all.
There have always been market makers. The fact that we've replaced a whole lot of market makers with a smaller number of people programming computers to act as market makers means that we're now probably devoting less human resources to this job.
Also, as an aside, it's worth nothing that Hammerbacher only said that after making millions working at Facebook. I'm pretty sure that makes him an asshole.
There are ways of providing market makers without quite as much waste as the existing system of HFT. For example, instead of having the first trade order to arrive win, group them into generations of, say, one second, and execute them in a deterministic* order that does not depend on the time of submission (provided the trades arrived within the one-second window). You can still provide liquidity via automation, but you get rid of the latency arms race by providing a floor, below which improving reaction times doesn't win you anything.
* - For fairness, you could execute trades within a generation in a pseudorandom order determined by a random key, which is cryptographically committed to prior to the opening of trading, then reveal the key after the market closes to prove that you executed them in the correct order.
There are some big problems with that plan. If I want to sell 100 shares, but I think that you also want to sell 100 shares but there is only 150 shares of demand then I'm incented to put in an order to sell 200 shares so that I capture 2/3rds of the demand.
But you're incented to do the same thing! So if you're going to put in an order for 200 maybe I should put in an order for 400? You can see where this is going...
People worry about HFT destabilizing the market. It seems to me that would be a much greater risk if you're incentivizing people to put in crazy orders that they don't actually want to do just to grab the percentage of demand that they desire.
What happens if we aggregate both the supply and demand over a second (and don't allow price resolution smaller than a cent), then each seller gets to sell a portion of the demand proportional to the amount of this stock he owns?
This seems to disincentivize putting up for sale more than the seller wants to sell, and to also disincentivize "Sybil attacks" where the seller has an incentive to create false identities for himself. (Just a thought experiment, would be happy to know what I'm missing here :-)
2) The little dots represent price changes, not trades.
FWIW, some more context around this would be-
All the major exchanges stream their best prices to all the other exchanges.
This is required because US exchanges must execute trades at the National Best Bid or Offer, or NBBO [1].
So how do you track the NBBO. In theory, by having all the exchanges send their best bids and offers to a central Securities Information Processor, or SIP (the 12:00 box) which then disseminates them (which you can see by the waves of stuff it sends out)
In practice, it's slow to go through the SIP on every price movement and the exchanges want to have the best possible information, so the exchanges mostly stream prices directly from the other exchanges (hence the fanout effect on every price movement)
Most of these prices movements don't result in trades, they just represent somebody entering or leaving the market at the BBO.
This feels like a distinction that could have been made better, rather than just saying "yeah, this stuff's complicated."
I'm still having a very hard time understanding what kinds of events would cause so many rapid price changes. So many dots in just half a second -- even when time-stretched to 5 minutes! Are those price changes meaningful at all?
Thanks, that was a good explaination. If you look carefully, the timing between exchanges is identical, so hopefully they at least chose some representative latency between exchanges.
It is incredible engineering and it has incredible downsides, not the least of which is the ability to destroy a market in seconds, due to a blip in information, with cascading domino effects.
Assume you are referencing the flash and twitter crash? I always wondered why people never mention how fast it recovered... the ability to heal a market in seconds. The '87 crash was a cascade much more severe and actually involving the whole market that happened without HFT.
Also the incredible focus on these two events, considering all the other turmoil in the financial markets, has always struck me as a clear case of scapegoating with Luddite underpinnings. Pretty soon, we will all believe that the recession was caused by HFT's.
I agree. The speed at which markets respond to news reveals how efficient the system works. Flash-crashes and what not are either caused by human programming errors or it is simply the right reaction to new information about the environment. We want the new price to be discovered ASAP.
How long before someone (a hacker no doubt) games the system to create a selling spiral, just waiting to take profit of the rebound.
If it´s well planned the one causing the dive is not going to be the one taking the profit (at least that it can be proved).
We need not wait for that to happen. Such shenanigans have been observed and documented already, such as in the book "Reminiscences of a Stock Operator." It was written in 1923, and worth reading today.
Well, it's been a common enough movie plot (cf. Casino Royale where the Antagonist engineers terrorist attacks on high-profile companies whilst short-selling their stocks).
I don't know if "destroy" is the right word, although that can happen. It has the ability to act extremely quickly, which is actually what we want. We want markets to respond to new market conditions quickly so that we know the information has been disseminated throughout the markets. The faster it behaves, the more efficient it is. The problems we see come from human programming errors, not from a mis-networked market. This is incredible engineering.
Imagine if HN had an army of animatronic robots run an arm-wrestling tournament every hour to determine which stories reach the front page. That would also be an impressive feat of engineering, but it wouldn't tell us anything about which stories deserve to be on the front page due to their inherent value, so it'd be a huge waste of resources, and make HN worse for readers.
HFTs are not publishing a lot of useful results in AI or game theory. They are in a zero-sum game against each other as well as all legitimate investors, and all their profits come at the expense of people trying to better route society's resources.
If we eventually decide that all of this ridiculously fast bid/offer blitzing by our HFT overlords is a destabilization risk to the economy [1], couldn't we start taxing these transactions, or the bids/offers themselves? This level of high-frequency noise being thrown into the market can't reasonably go on increasing forever, right... at some point we just bury ourselves in a never-ending war of inscrutable, difficult to predict machine trading algorithms, and nobody will be able to translate market movements into anything linkable to reality, right [2]? Shouldn't either market operators or the government at some point in the future start dialing back the traffic with penalties on the sheer number of actions taken?
... or is that just an insane non-starter, since it affects too many rich people in the finance sector and their colleagues rotating through the current regulatory structure?
I think it's an interesting long-term problem faced by society to decide whether we are OK with investment markets becoming completely impossible for "normal", human investors to navigate. It's already rapidly going that way--the capability to profit is already wildly tilted toward firms that act at HFT volume. If a poker site became overrun by bots to the extent that it was no longer fun for humans to play, they would fight back against the bots (as most do to some degree). But with investments... we may be getting to the point where the average day trader needs a 3000U server farm to compete effectively, and then I question whether we've lost sight of why we subsidize and spend money regulating that market at all. It's like a chess league where the grandmasters get to use computers as aids, and the newcomers have to play blindfolded.
[1] Nothing catastrophic has happened yet, but there have been a few flash crashes that have necessitated trading to be shut down, and having to "roll back" trades is never perfectly equitable and only decreases confidence in a market.
[2] Some of those flash crashes were traced back to one overzealous seller that threw HFT's for a loop (read http://en.wikipedia.org/wiki/2010_Flash_Crash -- it is quite interesting). I shudder to think of a day when the market fluctuates wildly and the data is literally too complicated for regulators to trace it back to any identifiable cause. That day is closer than anybody in finance is likely to acknowledge.
> we may be getting to the point where the average day trader needs a 3000U server farm to compete effectively
Yes. That's actually a bit of a problem. It is perfectly all right that day traders are being out-competed by HFT firms, by itself that's fine. Humans replaced by computer, nothing bad about that. What is not good, is that a successful entry into arbitrage market nowadays require a lot of infrastructure and technical skills.
That increased barrier reduces a number of players on the market. That reduces diversity. And that increases risk. That's bad.
A simple example how that increases risk. Imagine that a single HFT firm had managed to out-compete all others. And now owns perfect infrastructure with nanosecond level latencies, speed-of-light channels between the exchanges and trading algos without any bugs and teams of quants maintaining them. Obviously no day trader will be able to compete with teams of PhDs. And no new newcomer HFT firm will be able to compete. But as a result diversity of day traders will have decreased to exactly one. And any glitch in the operation of that firm (sorry, a box that was trading SPY just crashed) will be creating flash-crash artifacts without easy resolutions to them.
So yes, an increased entry barrier into day trading is bit of a problem.
The cost of entry into the markets has gone down not gone up. It is orders of magnitude cheaper to set up an electronic trading operation than it was to be on the floor.
Further, successful entry into arbitrage markets always required specialist infrastructure and skills. They used to be good old boy networks, brightly colored vests, and arcane hand signals. Now it is programming and networking.
In the previous world there was not "NASA" effect at all. Now at least the skills can be transfered to other industries.
What's stopping you from making lots of money by successfully predicting next year's stock price for Apple, IBM or Ford? Normal human investors can obviously keep doing normal human investment.
That was a not very helpful response to a fairly obvious question. HFT is taking advantage of arbitrage over a very short period of time (seconds). What effect does it have on long-term prices? If you hold stock for longer than 0.01 seconds (or 1-2 days in the case of a fat-fingered-algorithm), why should you care?
That wasn't my point. Countering HFT with "well you can still pick stocks the old-fashioned way!" is borderline moronic. Over 95% of trade volume is HFT; retail investors can't compete.
I think HFT is ridiculous and the epitome of capitalism. If you outlaw'd it, a new form of lightning fast arbitrage would arrive.
My point was that if you call apple increasing over the course of 1 year, you might double your money if you're lucky. It's much more likely that the HFT operators will outperform you, as they have over the past decade.
>My point was that if you call apple increasing over the course of 1 year, you might double your money if you're lucky. It's much more likely that the HFT operators will outperform you, as they have over the past decade.
These results don't seem related at all. You buy stock at price A and sell and price B (B = A+X, hopefully). What does it matter to you that other parties made money (perhaps more than X) while the stock was going to B? Institutional investors have always been more savvy about the market than retail ones. I don't see how them making money around the edges changes the calculus for "the rest of us."
On the flip side, maybe in the future computers take the money out of the finance industry. As things become automated, the function Wall Street provides, allocating capital, should in theory become cheaper relative to the rest of the economy. Say one day maybe computers will replace VC's: instead of pitching, you plug your information into a web page and get an answer as to whether you're getting funded.
> couldn't we start taxing these transactions, or the bids/offers themselves?
Yes, but that tax would just be passed on to "regular investors" in the form of higher spreads. Market makers are providing a real service. That service has a cost. FWIW, that cost is now much smaller than it used to be due to the fact that computers are doing it now instead of real humans. Automation FTW!
It seems that the counter at the bottom counts all updates, and ends up at 2380, so the overall rate would be something like 4760/second, or 17M/hour. Note that the rate has slowed down considerably before .25 seconds have passed, and this was recorded within 10 minutes after NYSE opened, so I suspect this is a bit above the average rate. Also, these are bids and offers, not actual trades.
Light bulb: tax all tradings with a tax percent increasing with the number of transactions per second, in a continuous way (even for less than 1 t/s) that would not make any difference for regular traders (and have a tweakable taxing formula that could regulate a market's stability and sensitivity to information by letting more or less HFT happen by setting the 100% taxation limit - the HFTs will have all incentives to stop trading when they are taxed 100% or beyond - i.e. when they are "fined")!
Why is the video showing redundant details? It looks like for each event it shows a packet going to every server.
If they arranged the machines on the horizontal axis, time on the vertical axis, and showed 'packet sent' events it would look much simpler. Maybe simple enough to add in details about the trades, like dollar values, instead of pretty expanding explosions.
I believe that part of the actual infrastructure is you send the same message along multiple physical cables; one to each exchange. You also have to account for the delay that the message takes to be received by each exchange. (The speed of light isn't "instant" when you're working on the ms level.)
If you want to buy/sell at a price, and there's no one ready to sell/buy at that price, a speculator (of any stripe) coming in and making that deal with you means you got the price you asked for. Maybe you could have got better - that's what the speculator is hoping - but you're no longer taking that risk. Statistically, the money going to the trader is similar to an insurance premium then.
That's all "in principle" - whether the details work out right is a much deeper question.
Aren't these speculators constantly entering and withdrawing these orders from the market on the order of microseconds?
It's not like the order book for Johnson and Johnson is completely empty and there is absolutely nobody out there willing to sell shares. If I understand it right, the HFT machines are poking numbers around the current price trying to step ahead of a regular order before it comes in.
HFT machines don't get to know about regular orders until it is too late to preempt them. If an order takes liquidity, the first sign of it that an HFT machine will see is the trade executing. If an order adds liquidity, the HFT machine will see the order appear on the book. Assuming that the venue uses time priority, which nearly all of them do, once the HFT machine is aware of the order it cannot get "ahead" of the order because the order has already received a timestamp that is lower than the present timestamp.
There may be some very minute portion of the industry that actually dedicates a lot of time to trying to predict specific actions of other market participants, but this seems like an awful idea to me. It would be much easier to try to predict the future price so you can avoid accumulating a large position in the wrong direction (as a market maker) or grab a big position in the right direction (as a speculator). It is also pretty easy to perform arbitrage, although this corner of the industry is harder to break into, since it requires more in the way of pricey hardware and data services and less in the way of strategy and predictive power.
Yes. That's what it does. If you, as a human, try to trade like this, the computers will destroy you. That's why people shouldn't trade like computers and they should use their experience and judgment to guide them.
Market makers have always taken a small profit for providing liquidity. The HFT machines take a much smaller profit than the humans who used to do this by hand because, like in many many other places in the economy, computers are cheaper than humans.
It's the same sort of automation that we've seen in many many other places.
I'm speaking for the majority of people that can't afford racks of servers and custom-laid transatlantic fiberoptic lines. I'm speaking about typical americans that have their money in 401(k) accounts or maybe buy stocks from an online broker to try and fund their kids' college accounts.
These people are all being scraped, very slowly but very surely, by HFT. That's the point I'm making.
At least we all admit that the modern stock market has absolutely no connection to the economy or to the interests of long-term investing or capital building. It's just a very large and very legal casino.
I'm speaking for the majority of people that can't afford racks of servers and custom-laid transatlantic fiberoptic lines. I'm speaking about typical americans that have their money in 401(k) accounts or maybe buy stocks from an online broker to try and fund their kids' college accounts.
Barriers to entry. Cost of business, etc... It's really not a concern to people who actually understand HFT and trade in their own way despite. They generally really don't mind the added liquidity.
These people are all being scraped, very slowly but very surely, by HFT. That's the point I'm making.
Buy in at $40. Sell at $80. Where does the computer scrape money from the transactions? It doesn't. Like I said, you're only losing if you're trying to trade like a computer. It's like trying to out-robot a robot on an assembly line.
At least we all admit that the modern stock market has absolutely no connection to the economy or to the interests of long-term investing or capital building. It's just a very large and very legal casino.
I disagree to the first part, and I think the second bit is an oversimplification.
It obviously matters, or else people wouldn't be upset by HFT or claim that they're losing money to it. We also have to consider the fact that pretty much all money comes through the bond and stock markets at exchanges. The exchanges are price arbitration centers for the economy. Paying attention to them matters because the exchanges and what happens there matters.
A casino is a place you go to lose money. It's all games and the odds are stacked against you. Everything we do in life is a gamble. An exchange is a place for people to make informed decisions about the prices of goods and financial instruments. Everyone loses and wins some.
I do relate to the long-term investing/capital building. The central banks keep printing money which funnels into the bond and stock markets. This in turn signals an abundance of actual economic capital, which there isn't. With the communication that there is plenty of excess capital for the long term, we (and especially people dealing in finance) act as if it is the case and start consuming capital. Eventually, facts catch up and we get some sort of terrible economic downturn. As a result of the long-term economic irregularity, actors act for the short-term because the long term is just too undependable.
To get the perspective of different participants in the market watch this video from The Milken Institute featuring Bart Chilton (regulator), Terry Duffy (exchange), Jamil Nazarali (retail execution), and Lou Salkind (proprietary trading).
They address a lot of the common criticisms of modern markets discussed here. It provides a good perspective of what people within the industry see as the current state and future of trading.
The radiolab podcast is well worth a listen for a bit of layman's insight into HFT. The conclusion at the end makes it clear what the implications are.
In the Netherlands, there is a yearly list of the most rich people called "The Quote 500". Of those 500 richest dutch, I think about 15 are HFT owners and employees.
A good amount of HFTs fail. I've heard numbers ranging from 70%-90% of new HFTs fail within their first 2 years. Very similar to startups when you think about it.
Also, HFTs are most definitely taking profits from each other. In fact, in a lot of cases the faster, more successful HFTs kill off the new ones to the market. Not to mention there are a good number of predatory HFTs who exist solely to game other HFTs
It's hard to know how profitable HFTs are on the whole as for the most part they are very private. That said some very big names on HFT have recently laid folks off.
As someone who hires and interviews in this space, HFT firms seem largely the same as old trading firms were. Boom bust cycles that comer and go as profitable trades shelf life expire.
It made a great conversation piece with my coworkers. Non-technical folks (most of them) were astounded that so much text was being interpretted and executed every single time they loaded the homepage (in less than a second).
What was the point? It helped set a certain emotional tone to our conversations. Folks found it a lot harder to demand their project be done "right now, it's easy" when directly confronted with the complexity behind a single page load.
Likewise, stories that highlight the immense speed and complexity of high frequency trading help set an emotional tone of alienation and fear. It helps trigger the same reflex Frankenstein and The Terminator played off of: "maybe we're unleashing technological forces that no one can control."
But of course if you are well and truly versed in a technology, that feeling goes away. I knew that our crappy brochure website was not very complicated as websites go.