‘Democratizing chemical analysis’: FSU chemists use machine learning and robotics to identify chemical compositions from images

A microscope image of potassium nitrate. (Courtesy of Oliver Steinbock)
A microscope image of potassium nitrate. (Courtesy of Oliver Steinbock)

Florida State University chemists have created a machine learning tool that can identify the chemical composition of dried salt solutions from an image with 99% accuracy.

Oliver Steinbock, Cottrell Family Professor of Chemistry
Oliver Steinbock, Cottrell Family Professor of Chemistry

By using robotics to prepare thousands of samples and artificial intelligence to analyze their data, they created a simple, inexpensive tool that could expand possibilities for performing chemical analysis. The work was published in Digital Discovery.

“We are living in the age of artificial intelligence and big data,” said co-author Oliver Steinbock, a professor in the FSU Department of Chemistry and Biochemistry. “We thought that if we used sufficiently large databases with enough pictures of different compounds and stains, we could maybe use AI to determine what the composition is.”

The research could make possible cheaper, faster chemical analysis that could be used in space exploration, law enforcement, home testing and more.

 

HOW IT WORKS

This paper builds on a previous study from Steinbock’s lab in which researchers used machine learning to identify the chemical composition of salt stains from photos. In that study, the researchers analyzed about 7,500 samples, which they prepared by hand.

This paper amplifies that work by using a robot to process samples that were later analyzed by an improved machine learning program. Instead of hand-pipetting samples, the researchers created what they named the Robotic Drop Imager, or RODI, which is capable of preparing more than 2,000 samples per day. That allowed them to build a library of more than 23,000 images — more than three times as large as their original study.

After preparing samples and taking photos, the researchers simplified each image by converting them to grayscale, then extracted 47 features, such as pattern area, brightness and other attributes, which they used in their analysis.

With additional images, the accuracy of their machine learning program increased from around 90% to almost 99%. The researchers also analyzed the initial concentration of the salt solution at five different levels and trained their machine learning program to distinguish among them. The program reached 92% accuracy in identifying the concentration of the solution and the salt’s identity.

“The accuracy demanded in different analyses will vary depending upon the situation,” said paper co-author Amrutha S.V., a postdoctoral researcher. “From my experience, I know that some types of spectroscopy and other analysis methods are expensive and require specialized technical expertise to operate. That’s why I’m excited about the possibility of a simple method — just taking a photo to determine chemical composition. That would be incredibly useful.”

WHY IT MATTERS

Most chemical analysis methods focus on the molecular level, examining atoms, molecules or crystal structures.

“That works great if you have good samples, a few hundred thousand dollars for the instruments and no weight restrictions,” Steinbock said. “But if you want to go on a space mission and ship things to a moon of Saturn, for example, every gram matters. If you can do chemical analysis with a camera, that’s a game changer.’

The project was developed for NASA, which was looking for inexpensive, low-cost, low-weight methods for determining chemical concentrations. Instead of transporting samples to Earth, an extraterrestrial rover equipped with a simple chemistry lab and camera could analyze the chemical composition of materials on site.

Along with space exploration, the method developed in Steinbock’s lab could be used to provide chemical analysis for other applications. The testing relies on minute sample amounts — just a few milligrams — making it valuable in scenarios where obtaining large samples is difficult. Law enforcement could run preliminary tests on suspected drugs, laboratories could test spilled materials for safety, and hospitals without access to a full chemical analysis lab could use it to aid diagnoses for patients.

“This is important because it could democratize chemical analysis,” Steinbock said.

The Robotic Drop Imager, or RODI, that Steinbock's lab used to prepare samples for analysis. The robot can prepare more than 2,000 samples per day. (Courtesy of Oliver Steinbock)
The Robotic Drop Imager, or RODI, that Steinbock’s lab used to prepare samples for analysis. The robot can prepare more than 2,000 samples per day. (Courtesy of Oliver Steinbock)

AI: A NEW TOOL FOR RESEARCH 

Artificial intelligence promises to transform what is possible in research. Faculty at Florida State University are engaging in innovative projects that push the boundaries of this rapidly developing tool.

FSU’s artificial intelligence efforts are providing tools and insight for faculty in teaching and researching.

“I think it’s very helpful to be at a place where you get this kind of support, and it doesn’t necessarily have to be money, but just appreciation for trying new things,” Steinbock said. “AI is changing how we approach scientific discovery. What once required expensive equipment and specialized expertise can now be done with a simple camera and the right algorithm. This opens up new possibilities — not just for space missions, but for medicine, forensics and beyond.”

Additional co-authors on this paper were Bruno C. Batista of FSU, Jie Yan of Bowie State University and Beni B. Dangi of Florida A&M University. This project was supported by NASA.