[null, {"document_url": "http://www.embedded-computing.com/processing/managing-big-data-moving-analysis-back-to-the-edge", "unformatted_src": "http://content.cdntwrk.com/mediaproxy?url=http%3A%2F%2Fshare.opsy.st%2F57e57548280d1-IMAGE1.jpg&size=1&version=1499280698&sig=7757a792b0283fc096190a171194966c&default=hubs%2Ftilebg-blogs.jpg", "src": "http://content.cdntwrk.com/mediaproxy?url=http%3A%2F%2Fshare.opsy.st%2F57e57548280d1-IMAGE1.jpg&size=1&version=1499280698&sig=7757a792b0283fc096190a171194966c&default=hubs%2Ftilebg-blogs.jpg", "alt_text": "The amazing ESP8266 Wi-Fi module"}, null, null, null, {"document_url": "http://www.embedded-computing.com/processing/managing-big-data-moving-analysis-back-to-the-edge", "unformatted_src": "http://content.cdntwrk.com/mediaproxy?url=https%3A%2F%2Fcontent.cdntwrk.com%2Ffiles%2FaHViPTYzODY3JmNtZD1pdGVtZWRpdG9yaW1hZ2UmZmlsZW5hbWU9aXRlbWVkaXRvcmltYWdlXzU5ZTYzNDczOGNhNGIucG5nJnZlcnNpb249MDAwMCZzaWc9Y2Q0NjgzOWRlYjc5ZWRjZGQyMWJjZWE2MDIwMTZkZTk%25253D&size=1&version=1508269145&sig=f3c51869ee1e219b77b917939a2bd55a&default=hubs%2Ftilebg-blogs.jpg", "src": "http://content.cdntwrk.com/mediaproxy?url=https%3A%2F%2Fcontent.cdntwrk.com%2Ffiles%2FaHViPTYzODY3JmNtZD1pdGVtZWRpdG9yaW1hZ2UmZmlsZW5hbWU9aXRlbWVkaXRvcmltYWdlXzU5ZTYzNDczOGNhNGIucG5nJnZlcnNpb249MDAwMCZzaWc9Y2Q0NjgzOWRlYjc5ZWRjZGQyMWJjZWE2MDIwMTZkZTk%25253D&size=1&version=1508269145&sig=f3c51869ee1e219b77b917939a2bd55a&default=hubs%2Ftilebg-blogs.jpg", "alt_text": "Using software to find hardware bugs"}, null, {"document_url": "http://www.embedded-computing.com/processing/managing-big-data-moving-analysis-back-to-the-edge", "unformatted_src": "http://content.cdntwrk.com/mediaproxy?url=https%3A%2F%2Fcontent.cdntwrk.com%2Ffiles%2FaHViPTYzODY3JmNtZD1pdGVtZWRpdG9yaW1hZ2UmZmlsZW5hbWU9aXRlbWVkaXRvcmltYWdlXzU5ZTYzMTFlOTRiMjAucG5nJnZlcnNpb249MDAwMCZzaWc9NzFiNGU1OTNmNGQ4ZTczYzA5ZWI1NGI5MDc1MzBmN2Y%25253D&size=1&version=1508258498&sig=349fae386df395164e0e88599a2d21ed&default=hubs%2Ftilebg-blogs.jpg", "src": "http://content.cdntwrk.com/mediaproxy?url=https%3A%2F%2Fcontent.cdntwrk.com%2Ffiles%2FaHViPTYzODY3JmNtZD1pdGVtZWRpdG9yaW1hZ2UmZmlsZW5hbWU9aXRlbWVkaXRvcmltYWdlXzU5ZTYzMTFlOTRiMjAucG5nJnZlcnNpb249MDAwMCZzaWc9NzFiNGU1OTNmNGQ4ZTczYzA5ZWI1NGI5MDc1MzBmN2Y%25253D&size=1&version=1508258498&sig=349fae386df395164e0e88599a2d21ed&default=hubs%2Ftilebg-blogs.jpg", "alt_text": "The role of heterogeneous systems"}, null, {"document_url": "http://www.embedded-computing.com/processing/managing-big-data-moving-analysis-back-to-the-edge", "unformatted_src": "http://content.cdntwrk.com/mediaproxy?url=https%3A%2F%2Fcontent.cdntwrk.com%2Ffiles%2FaHViPTYzODY3JmNtZD1pdGVtZWRpdG9yaW1hZ2UmZmlsZW5hbWU9aXRlbWVkaXRvcmltYWdlXzU5ZGZmZTIyNTEwN2YucG5nJnZlcnNpb249MDAwMCZzaWc9MTMxYjc3NTE4ZDk0YTg2YjQwYzg4NGY3MjBhMjM0N2Q%25253D&size=1&version=1508178209&sig=280f0bbabf043dd28b4ca6c5b88cf498&default=hubs%2Ftilebg-blogs.jpg", "src": "http://content.cdntwrk.com/mediaproxy?url=https%3A%2F%2Fcontent.cdntwrk.com%2Ffiles%2FaHViPTYzODY3JmNtZD1pdGVtZWRpdG9yaW1hZ2UmZmlsZW5hbWU9aXRlbWVkaXRvcmltYWdlXzU5ZGZmZTIyNTEwN2YucG5nJnZlcnNpb249MDAwMCZzaWc9MTMxYjc3NTE4ZDk0YTg2YjQwYzg4NGY3MjBhMjM0N2Q%25253D&size=1&version=1508178209&sig=280f0bbabf043dd28b4ca6c5b88cf498&default=hubs%2Ftilebg-blogs.jpg", "alt_text": "Trusted MCUs for IoT applications "}, null, {"document_url": "http://www.embedded-computing.com/processing/managing-big-data-moving-analysis-back-to-the-edge", "unformatted_src": "http://content.cdntwrk.com/mediaproxy?url=https%3A%2F%2Fi1.sndcdn.com%2Fartworks-000244775745-yjnt50-t500x500.jpg&size=1&version=1507754103&sig=574991d1901c6b8b16085901d32aeaa9&default=hubs%2Ftilebg-blogs.jpg", "src": "http://content.cdntwrk.com/mediaproxy?url=https%3A%2F%2Fi1.sndcdn.com%2Fartworks-000244775745-yjnt50-t500x500.jpg&size=1&version=1507754103&sig=574991d1901c6b8b16085901d32aeaa9&default=hubs%2Ftilebg-blogs.jpg", "alt_text": "Embedded Insiders - Episode #32 - You\u2019ve chosen MIPS? Uh-Oh!"}, null, {"document_url": "http://www.embedded-computing.com/processing/managing-big-data-moving-analysis-back-to-the-edge", "unformatted_src": "http://content.cdntwrk.com/mediaproxy?url=https%3A%2F%2Fcontent.cdntwrk.com%2Ffiles%2FaHViPTYzODY3JmNtZD1pdGVtZWRpdG9yaW1hZ2UmZmlsZW5hbWU9aXRlbWVkaXRvcmltYWdlXzU5ZDU2ZDAxYzg0ZmUuanBnJnZlcnNpb249MDAwMCZzaWc9MTAyNTIzNWQ1NGI0NjFlOTkyNzM0NDIxNTQyNzVkMDY%25253D&size=1&version=1508195206&sig=b9f4a9fabda9352116d4b444be4a41e3&default=hubs%2Ftilebg-blogs.jpg", "src": "http://content.cdntwrk.com/mediaproxy?url=https%3A%2F%2Fcontent.cdntwrk.com%2Ffiles%2FaHViPTYzODY3JmNtZD1pdGVtZWRpdG9yaW1hZ2UmZmlsZW5hbWU9aXRlbWVkaXRvcmltYWdlXzU5ZDU2ZDAxYzg0ZmUuanBnJnZlcnNpb249MDAwMCZzaWc9MTAyNTIzNWQ1NGI0NjFlOTkyNzM0NDIxNTQyNzVkMDY%25253D&size=1&version=1508195206&sig=b9f4a9fabda9352116d4b444be4a41e3&default=hubs%2Ftilebg-blogs.jpg", "alt_text": "Save Time and Money with Microchip\u2019s SuperFlash\u00ae Technology"}, null, null]
Home » Processing » Managing Big Data: Moving analysis back to the edge

Managing Big Data: Moving analysis back to the edge

July 20, 2016 OpenSystems Media

With all the gadgets we use each day, it’s easy to lose sight of the fact that many of these devices have processing power equal to the old computer towers from just a decade ago. Add the Internet of Things (IoT) to the equation, and we’re generating a mind-blowing amount of data every second of every day.

According to Cisco, the world generated about two exabytes of data altogether in the past 2,000 years. Now we generate that amount of data daily.

The IoT relies on data — and massive amounts of it — to fuel connected devices and give us drastic advances in monitoring and automating our environments. With the information that the IoT provides through these devices, businesses and industries can know sooner and with more accuracy how the business is being affected by external factors. For example, in an industrial setting, IoT sensors are used to monitor and regulate the humidity of a manufacturing facility when dealing with a sensitive material. Data collected by a sensor triggers various action scenarios by the device.

Big Data also is being leveraged by businesses to better understand their customers and drive efficiencies. For example, the use of item-level RFID tags by retailers raises inventory accuracy from an average of 63 percent to 95 to 99 percent, according to the RFID Lab at Auburn University. Item-level RFID also can provide real-time data that can fuel more integrated shopping experiences by helping merchants track inventory status, purchase data, item popularity, and shopper movement.

With so much data being generated so quickly, data management becomes a challenge. Questions arise about the value of all the data, and how to best sort through it effectively so the data becomes actionable.

One solution is to develop more advanced network technology at the local level. With the cloud being a big source for the analysis of IoT data, moving the process back to the device itself could drive efficiencies. This process is called moving toward the edge, or more simply, edge IoT analytics.

Moving toward the edge is a simple idea: the sort of computations and data sorting that used to require a server can now be accomplished on the connected device itself. Moving analytics closer to the edge provides a number of benefits. Chief among those is cost savings. Bandwidth costs money, and the growing amount of data that will be sent via sensors and other devices will continue to grow. Edge analytics reduces the amount of back-and-forth needed to process the data.

Products that can monitor and synthesize information locally also are preferable because they naturally will have fewer latency issues. They can act quicker and with a higher data reflex.

As businesses and institutions look to IoT to become more competitive, the issue of how they process the vast amount of data these devices generate will be a serious consideration. The old method of relying on servers for the analytic and decision-making process will be replaced by more modern edge technologies that increase reliability and reduce costs.

Adam Justice is general manager of Grid Connect, developer of the ConnectSense line of wireless sensors. He can be reached at email@example.com and on twitter @adamjustice.

Adam Justice, Grid Connect
 The amazing ESP8266 Wi-Fi module

[Photo Credit: By Zeptomoon - Own work, CC BY-SA 4.0, Wikimedia Commons] If you enjoy automating physical t...
 

If you listen hard enough, you can hear the sighs of millions of parents worldwide fretting about the futur... 


The power of intelligence at the edge

Basic principles of voice UI

Qoitech Tool Helps Increase Battery Life of IoT Devices
 Using software to find hardware bugs
 The role of heterogeneous systems

CommAgility processing module adds flexible RapidIO to increase bandwidth

High performance DSP in AMC form factor

CEVA and LG Electronics Partner for Smart 3D Camera Solution
 Trusted MCUs for IoT applications

Avnet Opens Registration for Global MiniZed SpeedWay Design Workshop Series
