u/WizWit76

Automation bias: favoring automated system suggestions over contradictory information from other sources. This shows up constantly in financial behavior. The investor who follows their robo-advisor despite knowing their situation has changed. The trader who overrides their own read because the model says otherwise.

The extreme version played out in August 2012. Knight Capital deployed misconfigured trading software and within 45 minutes had executed millions of unintended orders. $440 million gone. The kill switch existed the entire time. Nobody used it because the system was supposed to be the authority.

What I find underexplored in the literature: automation bias doesn’t just cause people to trust flawed systems. It atrophies the independent judgment that would have caught the error. The more reliable a system is 99% of the time, the more catastrophic that 1% becomes, because you’ve stopped watching.

I think this is even more relevant as AI automation moves into this space.

Has anyone come across research on automation reliance and erosion of judgment over time, specifically in investor behavior? The Parasuraman and Manzey work is the most cited but it’s aviation-focused.

A New York Federal Reserve report published last week found that in states where sports betting is legal, credit delinquencies rose roughly 0.3% overall. But when you isolate the 3% of the population who actually took up betting after legalization, delinquencies spiked over 10%. Online access specifically correlated with a 10% increase in bankruptcy likelihood and an 8% increase in debt collection amounts outcomes that typically appeared two years after legalization.

The data is striking, but the mechanism behind it is what I find more interesting. Most coverage frames this as a willpower problem or an addiction story. I think it’s more accurately an illusion of control problem.

Ellen Langer’s original 1975 research showed that people systematically overestimate their ability to influence random outcomes when skill-adjacent cues are present, choosing your own lottery numbers, rolling dice yourself, being given information before placing a bet. Sports betting is essentially a masterclass in manufacturing those cues. You’re not just picking a number. You’re analyzing stats. You’re watching film. You’re tracking injury reports. The interface is designed to feel like research.

The brain interprets effort as influence, influence as control, and control as reduced risk.

It isn’t. The house edge doesn’t move because you spent three hours studying the spreads. But the felt sense of competence makes the bet feel fundamentally different from a coin flip, even when the underlying probability is structurally similar.

What I find most interesting about the Fed data is the two-year lag before bankruptcy and collections appear. That’s consistent with the illusion of control driving escalating commitment, each loss interpreted not as evidence that the system is random, but as a signal to refine the strategy. The skill frame makes quitting feel like giving up rather than accepting reality.

Curious whether anyone has looked at this through the lens of the hot-hand fallacy in tandem with illusion of control — they seem to compound each other in sports betting specifically in ways I haven’t seen well documented.