麻豆淫院


Prediction or cause? Information theory may hold the key

(麻豆淫院Org.com) -- "A perplexing philosophical issue in science is the question of anticipation, or prediction, versus causality," Shawn Pethel tells 麻豆淫院Org.com. "Can you tell the difference between something predicting an event and something actually causing an event?"

Pethel is a scientist working at the Redstone Arsenal in Alabama. Along with Daniel Hahs, he set out to identify a method of distinguishing anticipation from causality from information theory. 鈥淎ny process that has to react in real time can improve its performance through anticipation, and in studying such processes it is important to find new ways to quantify causality鈥 Pethel says.

The question of anticipation versus causality is one that has real-world application in a number of areas. Pethel points out that this issue has implications in covert operations, as well as in financial areas, especially with regard to the development of bubbles. 鈥淚s there a way, from passive measurements, to tell what鈥檚 driving what?鈥 Pethel and Hahs try to answer this question in 麻豆淫院ical Review Letters: 鈥淒istinguishing Anticipation from Causality: Anticipatory Bias in the Estimation of Information Flow.鈥

鈥淚f a system is generating information, it鈥檚 like a fingerprint that can be used to figure out where the information is coming from and where it is going,鈥 Pethel explains. 鈥淎 quantity called transfer entropy has been used since 1990 to measure information flow in experimental data from neuroscience, finance and even music.鈥

鈥淲hat we were interested in,鈥 he continues, 鈥渋s the anticipation issue. We wanted to look at that using transfer entropy, and see if we could discover what鈥檚 predicting and what鈥檚 causing.鈥

In order to set up the situation, Pethel and Hahs used chaotic systems, which produce information. They were careful that their model would be connected in only one direction. 鈥淲e set it up so that we know the causality 鈥 that x is causing y, but y cannot cause anything for x. However, we designed the y system to be able to predict x to some degree. We then collected data and used transfer to tell us which was the causal system.鈥

When analyzing the results, Pethel and Hahs found something rather interesting: Even though the response system, y, wasn鈥檛 the cause, it looked very much like it was under many different test conditions. 鈥淭here is an anticipatory bias. It鈥檚 a very strong effect, the more anticipation there is, the stronger it will be. There is a huge bias going on in some cases, and it is giving the exact wrong answer. The system that was only predictive was indistinguishable from the cause.鈥

The good news is that Pethel and Hahs also noticed that there are some signs that indicate that the presence of a bias. 鈥淓ven if you can鈥檛 pinpoint what the causal source is, you can see some behaviors that provide clues that you need to be on the alert for anticipatory dynamics.鈥

Pethel wants to take this further, though. 鈥淲e鈥檝e studied the one way system, and now that we know there is a bias, we can account for that, and study systems that have mutual back and forth coupling.鈥

Hopefully, the work will provide helpful clues in understanding how causality can be indentified using . 鈥淭here鈥檚 a level of broad interest,鈥 Pethel says, 鈥渟ince you can deduce causal mechanisms from data. Particularly interesting are financial markets and biological systems where anticipation plays a large role in allowing systems to adapt to a changing environment.鈥

More information: Daniel W. Hahs and Shawn D. Pethel, 鈥淒istinguishing Anticipation from Causality: Anticipatory Bias in the Estimation of Information Flow,鈥 麻豆淫院ical Review Letters (2011). Available online:

Copyright 2011 麻豆淫院Org.com.
All rights reserved. This material may not be published, broadcast, rewritten or redistributed in whole or part without the express written permission of 麻豆淫院Org.com.

Citation: Prediction or cause? Information theory may hold the key (2011, September 30) retrieved 21 May 2025 from /news/2011-09-theory-key.html
This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no part may be reproduced without the written permission. The content is provided for information purposes only.

Explore further

Don't have all the information? In the quantum world, that doesn't matter

0 shares

Feedback to editors