This entry was posted on Sunday, July 15th, 2007 at 7:47 pm and is filed under Education, market myths. You can follow any responses to this entry through the RSS 2.0 feed. You can leave a response, or trackback from your own site.
In this post I am going to try and convey to you a concept that is so critical to system traders but so thoroughly misunderstood by many active traders. The problem that I continually face when I engage in conversation with other traders is that what they call a system is invariably an entry mechanism. Many of these are when some moving average, Fibonacci, overbought or oversold condition has been reached. These are obviously only a few of the many many more conditions that that this “trader” has seen on his charts that look so obviously profitable.
But are they profitable? As a backtester I can test concepts and see what in very general terms seems to “work”. But what of those people that don’t test? Do they know what “works”? Trust me I get emails from and this week met in my chatroom people that are doing things that I know do not work. As a matter of fact virtually all of the commonly held axioms of trading are dead wrong. How do I know? I’ve tested it. John who also writes for this blog has amazing programming skill which have allowed us to test more complex theory’s then I would have ever thought imaginable. So I know when I hear a “system” that does not work. But again they almost invariably mention the entry. Which leaves me shaking my head because having tested hundreds of thousands of concepts across millions of bars of data, entry is of no value when testing a system without exit logic.
When creating a system I need exit rules that will be applied across all of the data - entirely mechanical. I can give you a good example of something that happened in the chatroom of Thursday afternoon. The chatroom is mine and I have made it my goal to destroy the illusions of what works and try to reprogram people to look at the market in ways that do work. In a systematic type fashion. The reason most active traders under-perform the major indexes is because they are invariably doing things that don’t work. Anyway this visitor walked into the chatroom on Friday and said “
12:20 Al
12:21 dayvejohnson
12:21 Al
12:21 dayvejohnson
12:21 dayvejohnson
12:21 Al
12:21 dayvejohnson
12:21 Al
12:22 dayvejohnson
12:22 dayvejohnson
12:23 dayvejohnson
12:23 dayvejohnson
12:24 Al
12:24 dayvejohnson
12:24 dayvejohnson
12:24 dayvejohnson
12:24 dayvejohnson
12:25 Al
12:25 dayvejohnson
12:25 Al
12:25 dayvejohnson
12:26 Al
12:27 dayvejohnson
12:27 dayvejohnson
12:27 Al
12:27 dayvejohnson
12:27 Al
12:27 dayvejohnson
12:28 Al
12:29 dayvejohnson
12:29 dayvejohnson
12:29 dayvejohnson
12:29 dayvejohnson
12:29 dayvejohnson
12:30 Al
12:30 dayvejohnson
12:31 Al
12:31 dayvejohnson
12:33 Al
12:33 dayvejohnson
12:35 Al
12:36 Al
12:36 dayvejohnson
12:37 dayvejohnson
12:37 dayvejohnson
12:37 dayvejohnson
12:37 dayvejohnson
12:37 dayvejohnson
12:37 Al
12:37 dayvejohnson
12:38 dayvejohnson
12:39 dayvejohnson
12:39 dayvejohnson
yellow area denotes Al’s magic area
So basically thats the conversation. Can you guys understand how useless what he stated was? It was not really “tested” because there is absolutely no exit logic. So what happened? Well we hit 49.68 late in the day on Friday. Now what? Is the trade closed end of day Friday? Is it stopped out because he said the beauty of the system is that it takes “small losses”? Did it already take a few cent profit? It could possibly be a fantastic system. But what is the system? What I am trying to convey here is I hear this baloney all the time. It is of zero value to me - ZERO. This sort of nonsense is rampant on message boards, chatrooms, and blogs.
I have challenged people in the room this week based on a variety of criteria they believe make a viable system. I can prove they are not. I am going to continue to do that. My lesson here is a system is not entry logic alone. Start to test those exits not based on when you think you would get out of the trade but based on a solid consistent set of rules. While in the trade whole bouquets of emotions can and do affect trading decisions
On my old blog I posted the signals for a swing trade system that I had tested in various market conditions over a variety of years. I posted these before the market opened with simple at the open market orders. In the year that I posted these we made 40%. Not bad. But the beauty of this is that before the test was started I posted what the average winner, average loser, and average holding period would be. At the end of the year those numbers were right on the nose. Amazing? How did I know? Because I had seen in backtesting over 250,000 trades and what they looked like through all trade conditions. Nothing magical but just basic standard deviation in price of the holding period I would be holding based on historical precedence. This is powerful stuff.
After dispelling many of these hokey “systems” I usually get asked “So what does work?” For now I will keep that part simple. The goal of this blog is to start covering the varying concepts that do work in very basic form. But what works is the opposite of conventional wisdom. I know thats so hard to grasp because it hits the core of many active traders belief systems. But it is without question why the vast majority of active traders underperform the major equity indexes.
So please feel free to stop in my chatroom. I have been posting my intraday trades for a particular system that is making major reversal calls. This system generally triggers about 2 signals per day. I trade this on both the SP futures as well as the Dow futures. This system is somewhat different than in the live videos I post but uses similar techniques as those. We had a great week trading and in the end I think many that were there have learned a bit having been there. So feel free to stop in but please leave your market myths at home. (the permanent link is the upper left hand part of the page)
Have a Great Night!
Dave Johnson
July 16th, 2007 at 12:48 am
[...] reading this post, I like where he is going with it. He is also posting calls for a futures system that he uses, and [...]
July 16th, 2007 at 2:58 pm
I have a question related to backtesting. How do you model slippage? I’m trying to develop an intraday system for trading e-minis. My slippage model is to use the worst price for the 15 seconds after the order decision is made. This results in an average slippage of about 4-5 ticks per trade (2-3 per order). I have managed to develop lots of systems with about 2-4 ticks of profit average per trade, but with my slippage model I can’t manage to make anything consistently profitable. It seems likely that I am overestimating slippage, but I would rather overestimate it and throw out marginally profitable systems than underestimate it and start trading a marginally losing system.
July 18th, 2007 at 7:40 pm
JKW:
As I could write a book on this subject alone and delves into some rather technical parameters I will email you directly. You should here from me soon. So so busy….
July 18th, 2007 at 10:25 pm
Hi Dave,
May I ask what platform you use for back testing? TradeStation, eSignal, or something fancier?