Big data really needs a 'big mechanism,' DARPA says — Defense …

Big data really needs a 'big mechanism,' DARPA says — Defense …

Defense IT

Big data really needs a ‘big mechanism,’ DARPA says

By George Leopold
Aug 06, 2014

A Defense Department research program seeks to leapfrog advanced big data analytics by developing automated search technologies that could help explain the causes and effects that drive complex systems.

The Defense Advanced Research Projects Agency launched its “big mechanism” initiative earlier this year with the goal of developing automated tools that could uncover causal models hidden in big data.

The classic example of a big mechanism is the 1854 map of London showing the association between a cholera outbreak and a polluted public water pump—a discovery that overturned the prevailing opinion that diseases travelled through the air. Now, the relentless waves of scientific data make it nearly impossible to bridge the gap between tracking associated data points and discovering the cause-and-effect mechanisms behind big data.

“Having big data about complicated economic, biological, neural and climate systems isn’t the same as understanding the dense webs of causes and effects – what we call ‘big mechanisms’ – in these systems,” DARPA Program Manager Paul Cohen said in launching the research effort in February.

“Unfortunately, what we know about big mechanisms is contained in enormous, fragmentary and sometimes contradictory literatures and databases, so no single human can understand a really complicated system in its entirety,” Cohen added. “So computers must help us.”

DARPA’s Information Innovation Office released a preliminary request for proposals earlier this year to help develop technologies that could be used, for example, to scour research papers to extract details that could eventually be used to explain cause-and-effect relationships.

The DARPA office plans to initially use big mechanism tools to study the complex molecular interactions that cause cells to become cancerous. The proposed methodology includes using computers to scan research papers on cancer biology to extract data on cancer pathways. The data fragments could then be assembled into complete pathways of “unprecedented scale and accuracy,” the agency claimed, to determine how pathways interact.

In the last step, automation tools could help determine causes and effects that could be manipulated to develop potential cancer treatments.

View the original here – 

Big data really needs a 'big mechanism,' DARPA says — Defense …

Share this post