Prototype microscope teaches itself the best illumination settings for diagnosing malaria
Engineers at Duke University have developed a microscope that adapts its lighting angles, colors and patterns while teaching itself the optimal settings needed to complete a given diagnostic task.
In the initial proof-of-concept study, the microscope simultaneously developed a lighting pattern and classification system that allowed it to quickly identify red blood cells infected by the malaria parasite more accurately than trained physicians and other machine learning approaches.
The results appear online on November 19 in the journal Biomedical Optics Express.
“A standard microscope illuminates a sample with the same amount of light coming from all directions, and that lighting has been optimized for human eyes over hundreds of years,” said Roarke Horstmeyer, assistant professor of biomedical engineering at Duke.
“But computers can see things humans can’t,” Hortmeyer said. “So not only have we redesigned the hardware to provide a diverse range of lighting options, we’ve allowed the microscope to optimize the illumination for itself.”
Rather than diffusing white light from below to evenly illuminate the slide, the engineers developed a bowl-shaped light source with LEDs embedded throughout its surface. This allows samples to be illuminated from different angles up to nearly 90 degrees with different colors, which essentially casts shadows and highlights different features of the sample depending on the pattern of LEDs used.
The researchers then fed the microscope hundreds of samples of malaria-infected red blood cells prepared as thin smears, in which the cell bodies remain whole and are ideally spread out in a single layer on a microscope slide. Using a type of machine learning algorithm called a convolutional neural network, the microscope learned which features of the sample were most important for diagnosing malaria and how best to highlight those features.
The algorithm eventually landed on a ring-shaped LED pattern of different colors coming from relatively high angles. While the resulting images are noisier than a regular microscope image, they highlight the malaria parasite in a bright spot and are correctly classified about 90 percent of the time. Trained physicians and other machine learning algorithms typically perform with about 75 percent accuracy.
“The patterns it’s picking out are ring-like with different colors that are non-uniform and are not necessarily obvious,” said Horstmeyer. “Even though the images are dimmer and noisier than what a clinician would create, the algorithm is saying it’ll live with the noise, it just really wants to get the parasite highlighted to help it make a diagnosis.”
Horstmeyer then sent the LED pattern and sorting algorithm to another collaborator’s lab across the world to see if the results were translatable to different microscope setups. The other laboratory showed similar successes.
“Physicians have to look through a thousand cells to find a single malaria parasite,” said Horstmeyer. “And because they have to zoom in so closely, they can only look at maybe a dozen at a time, and so reading a slide takes about 10 minutes. If they only had to look at a handful of cells that our microscope has already picked out in a matter of seconds, it would greatly speed up the process.”
The researchers also showed that the microscope works well with thick blood smear preparations, in which the red blood cells form a highly non-uniform background and may be broken apart. For this preparation, the machine learning algorithm was successful 99 percent of the time.
According to Horstmeyer, the improved accuracy is expected because the tested thick smears were more heavily stained than the thin smears and exhibited higher contrast. But they also take longer to prepare, and part of the motivation behind the project is to cut down on diagnosis times in low-resource settings where trained physicians are sparse and bottlenecks are the norm.
With this initial success in hand, Horstmeyer is continuing to develop both the microscope and machine learning algorithm.
A group of Duke engineering graduate students has formed a startup company SafineAI to miniaturize the reconfigurable LED microscope concept, which has already earned a $120,000 prize at a local pitch competition.
Meanwhile, Horstmeyer is working with a different machine learning algorithm to create a version of the microscope that can adjust its LED pattern to any specific slide it’s trying to read.
“We’re basically trying to impart some brains into the image acquisition process,” said Horstmeyer. “We want the microscope to use all of its degrees of freedom. So instead of just dumbly taking images, it can play around with the focus and illumination to try to get a better idea of what’s on the slide, just like a human would.”
The Latest on: Machine learning microscope
- How is machine learning advancing cancer research?on January 20, 2022 at 8:36 am
Novel DNA repair proteins discovered by combining machine learning technologies and high-throughput microscopy, furthering cancer research.
- Any Single Galaxy Reveals the Composition of an Entire Universeon January 20, 2022 at 7:25 am
In computer simulations of possible universes, researchers have discovered that a neural network can infer the amount of matter in a whole universe by studying just one of its galaxies.
- What does the emergence of Trellix mean for the channel?on January 20, 2022 at 2:00 am
The combined forces of McAfee Enterprise and FireEye should provide opportunities for partners states the operations CRO ...
- The Symbiosis Of People And Technologyon January 12, 2022 at 4:30 am
Technology is built by people for people, and it needs to be as close as possible to people in order to better serve them.
- Machine learning tech tests nuclear componentson January 11, 2022 at 10:02 am
A new machine learning platform instantaneously detects and quantifies radiation-induced defects in parts and testing materials in nuclear reactors. The technology demonstrated by University of ...
- From hunting terrorists in satellite images to cancer cells in a microscopeon January 11, 2022 at 6:27 am
Avi Veidman is the CEO at Nucleai, the provider of an AI-powered oncology platform that utilizes machine learning to offer insights into cancer biology.Prior to his work in the medtech field ...
- This AI Software Nearly Predicted Omicron’s Tricky Structureon January 10, 2022 at 4:00 am
New algorithms that decipher complex sequences of amino acids offered an early view of the coronavirus variant. They could point the way to future drugs.
via Bing News
The Latest on: Smart microscope
- 2 Reasons Activision Shareholders Shouldn't Be Quick to Sell Ahead of a Microsoft Dealon January 21, 2022 at 6:11 am
Microsoft's (NASDAQ: MSFT) proposal to buy top game publisher Activision Blizzard (NASDAQ: ATVI) is far from a done deal. On Tuesday, the software giant agreed to pay $68.7 billion, or $95 per share, ...
- Smart windows can significantly reduce indoor pathogenson January 19, 2022 at 10:29 am
Daylight passing through smart windows results in almost complete disinfection of surfaces within 24 hours while still blocking harmful ultraviolet (UV) light, according to new research.
- OPPO smartphone captures record breaking microscopic arton January 18, 2022 at 7:13 am
Thanks to the 60x magnification microscopic lens on the OPPO Find X3 Pro smartphone the record-breaking microscopic artist Dr. Willard Wigan MBE has been able to record the results of his amazingly ...
- Using Your Phone As A Microscope On The Electronics Workbenchon January 17, 2022 at 4:00 pm
I’m guessing that almost any smartphone made over the last few ... so why does a real 2D LCD microscope not have this problem? I am theorising when I say this, but I suspect that the solution ...
- 10 Best Digital Microscopes January 2022on January 14, 2022 at 2:06 am
Product Name Popularity Score Quality Score Sentiment Score Sales Volume; 1: Plugable USB Digital Microscope with Flexible Arm Observation Stand Compatible With Windows, Mac ...
- 5 of the best microscopes for kids in 2022on January 13, 2022 at 10:00 pm
Encourage your kids' curiosity about the natural world with these microscopes designed with young science lovers in mind.
- Upcoming OPPO Find X5 Pro may be a OnePlus 10 Pro in disguiseon January 13, 2022 at 9:15 am
As we're nearing closer to the release of the OPPO Find X5 Series, we keep getting more information about the specifications of the upcoming flagship series, which may have some familiar ...
- Red Routes and Smart Motorways Come Under the Logistics and Road Haulage Microscopeson January 12, 2022 at 7:32 am
Two different road types which are almost bound to always prove controversial are red routes, those areas where no parking is permitted under any circumstances, and smart motorways, blamed for several ...
- Forensic Microscopes Market Share 2022 Industry Size, Latest Trends Analysis, Top Manufacturers, Drivers, Segment Forecast to 2027on January 10, 2022 at 4:00 pm
Forensic Microscopes Market includes breakdown data by manufacturers ... Future Trends and Forecast to 2025 Smart Tracker Market Share 2022-2025: Top Leading Players, Size, Global Growth Analysis, ...
- Leica SP8 Confocal/Multi-Photon Microscopeon January 8, 2022 at 11:18 am
The Leica SP8 is a dual purpose visible confocal microscope and multi-photon on a single platform. The confocal microscope is equipped with 4 detectors, one of which is a highly sensitive hybrid ...
via Bing News