May 3, 2018

The AI farm experiment

Illustration: Rebecca Zisser/Axios

Major companies are bringing together new machine learning algorithms, better and cheaper sensors, and increased computing power in hopes of addressing growing global demand for food and agriculture's diminishing labor force.

The big picture: Alphabet's X and John Deere, startups and universities are looking to AI-based agriculture to address these problems. But farming presents hard problems for AI that, if solved, could ultimately help it be deployed in more structured places (think: homes).

What's happening now
"We are at the stage where maybe Henry Ford was in the [early 20th century] with farm automation. There will be a lot of incremental advances that will snowball into massive changes."
University of Illinois' Girish Chowdhary

Machine learning is used to analyze data collected from farmers' fields, satellites and drones and inform decisions about planting and fertilizing, to spot disease, and to try to predict crop yields.

  • For example, growers using The Climate Corporation's Climate FieldView tool (to decide the rate, density and location for planting corn) saw a 5-bushel-per-acre lift in 2017 compared to farmers who wrote their own planting plans, says Steven Ward, the company's director of geospatial sciences.

On the ground: AI-enabled equipment is on the market and under development.

  • John Deere combines come with an option that uses machine learning to coordinate their spouts with grain-collecting carts to minimize spillage. Another model uses it to assess the quality of grain going into the bin— though still with human oversight.
  • Fruits and vegetables are more difficult and labor-intensive crops to harvest. Harvest CROO Robotics is working on a strawberry picker that recognizes and picks ripe fruit — with limited success. "We really take for granted how good humans are at performing fine manipulation tasks. Our bodies provide us with a rich set of data about our environment, and our brains synergistically fuse this sight, touch, smell, and sound with prior experience in a way we're still struggling to understand," Carnegie Mellon University's Tim Mueller-Sim says.
  • Chowdhary developed and is testing a robot that can move through rows of plants and use computer vision to measure their height and stem width.
    • If precise, that information could be used by breeders to speed and standardize the process of screening thousands of plants in search of genetic combinations that give rise to desirable traits.
The challenges

The big field test for AI, though, is whether it can abandon following a script and be trained to adapt to a dirty, messy and uncertain life on the farm. "If you can deploy it in an unstructured environment, it will work in a more structured one," says Mueller-Sim.

Data: Success in computer vision has largely come from deep learning, an AI technique that relies on data with detailed labels and tags. "The challenge is we don't necessarily have that supervised data for ag," Chowdhary says.

  • But it's surmountable, Mueller-Sim says, pointing to soon-to-be published work on generative adversarial networks (GANs) that, trained on 40–60 images, can detect features of sorghum, grape vines and cannabis flowers in the field.
  • Brett Drury, head of research at Brazilian startup Scicrop, says another approach is to use Bayesian networks that can reason with incomplete information and deal with uncertainty. He's using them to build models of crops to try to estimate yield and risk for pests and disease for individual farmers.

Uncertainty: Robots struggle with change. Soil texture, glare, clouds and other variables can all interfere with movement and computer vision, particularly as it tries to move towards driverless tech.

  • "We're trying to put robots in environments that aren’t meant for them," Chowdhary says. "Cars are meant to be on roads and even that is hard to make autonomous."
  • Driverless tech is making components for automation more accessible, but agriculture has unique challenges. It's off-road, and the machines are much bigger.
  • "The winners in driverless tech aren’t necessarily the winners in ag," says Alex Purdy, head of John Deere Labs.

Variation: Another challenge for AI in agriculture — and more broadly — is developing it to be accurate within and across different fields.

  • "Not every plant looks the same, even when planted side by side. So when it comes to the task of manipulating a robot arm for harvesting fruit or cutting a vine, the challenge is working in an unstructured environment," says Carnegie Mellon's Abhisesh Silwal, who is working on robots to prune grapes and harvest apples.
  • One possibility is develop algorithms that account for the differences between where they were trained and where they are operating. "That sounds okay qualitatively but to get it into the mathematics we still have a lot to do," Chowdhary says.

Adoption: Farmers often rely on generations of knowledge about their land. So, new — and often expensive — technologies will have to prove their worth.

  • "Today [planting is] largely decided on heuristics and knowledge by growers who really know their land," Purdy says. "They are doing an awesome job at it... so the bar for automation is going to be high."

Go deeper

Coronavirus dashboard

Illustration: Sarah Grillo/Axios

  1. Global: Total confirmed cases as of 2 p.m. ET: 1,464,852 — Total deaths: 85,397 — Total recoveries: 315,105Map.
  2. U.S.: Total confirmed cases as of 2 p.m. ET: 402,923 — Total deaths: 13,007 — Total recoveries: 22,717Map.
  3. State latest: New York Gov. Andrew Cuomo issued an executive order for New Yorkers to vote by absentee ballot for June 23 primaries.
  4. Federal government latest: The U.S. has begun to see "glimmers of hope" despite its highest recorded number of deaths in 24 hours, Dr. Anthony Fauci said.
  5. Business updates: Roughly one-third of U.S. apartment renters didn't make April payments — The Fed will lift Wells Fargo's asset cap to help small business lending.
  6. 🎧 Podcast: The battle over billionaire coronavirus saviors
  7. What should I do? Pets, moving and personal healthAnswers about the virus from Axios expertsWhat to know about social distancingQ&A: Minimizing your coronavirus risk.
  8. Other resources: CDC on how to avoid the virus, what to do if you get it.

Subscribe to Mike Allen's Axios AM to follow our coronavirus coverage each morning from your inbox.

Sen. Kelly Loeffler liquidates stocks after uproar over coronavirus sell-off

Sen. Kelly Loeffler. Photo: Madnel Ngan/AFP via Getty Images

Sen. Kelly Loeffler (R-Ga.) and her husband Jeffrey Sprecher are liquidating their stock portfolio and moving holdings into exchange traded funds (ETFs) after coming under fire for purchasing and selling roughly $1.4 million in stock just before the market crashed in response to the coronavirus pandemic.

Why it matters: Loeffler, who faces a competitive reelection fight in November, is one of several senators under fire for selling shares shortly after a private briefing on the coronavirus — sparking accusations of insider trading.

Sanders: "While this campaign is coming to an end, our movement is not"

Addressing his supporters via livestream after suspending his campaign, Bernie Sanders congratulated Joe Biden on his presumptive victory in the 2020 Democratic presidential primary while making clear that his fight for progressive ideas will not end with his candidacy.

What he's saying: "While this campaign is coming to an end, our movement is not. Dr. Martin Luther King Jr. reminded us that 'the arc of the moral universe is long, but it bends towards justice.' The fight for justice is what our campaign has been about. The fight for justice is what our movement remains about."