~/Blog

Brandon Rozek

Photo of Brandon Rozek

PhD Student @ RPI studying Automated Reasoning in AI and Linux Enthusiast.

Identifying Plants With iNaturalist

Published on

Updated on

2 minute reading time

Seek by iNaturalist (android) (apple) is a great app for identifying plants and animals. It uses a computer vision model to provide the hierarchical classifications. In fact they run yearly challenges with their dataset on Kaggle as well as publicly host their dataset on AWS (instructions).

What makes the experience so interesting, is the identification process is somewhat interactive. For example, look at the following screenshots of when I was trying to identify a plant near my workplace.

First we start off with the dicot class. This is roughly equivalent to it saying that it has identified a flower.

Screenshot showing Dicot Class for the Flower

To get a better classification, we need to get closer to the plant and try different angles, notice how the classification updates the get closer and closer to the species of the plant. That is, white snakeroot.

Screenshot showing Family designation for the FlowerScreenshot showing Genus designation for the FlowerScreenshot showing Species designation for the Flower

Fun fact, white snakeroot is the most common flower in New York.

Once you get to the species level, you can take a picture and the observation is saved within the Seek app. This by default is only saved locally and not shared with the community. If you’re up for some citizen science, we can upload it separately! If you like to use your phone for that you can use the iNaturalist app (Android) (Apple).

Within the app, create a new observation and select “choose image”. Then navigate to your Seek folder and select the image you want to upload.

You should then see a screen similar to this one:

Screenshot showing new observation page where the user can fill out the species information and other notes.

If your image contains geotagged information then it will use that to populate the location field. You can also change the location visibility to obscured or private instead of public if you’d like. If you’re not in a park or preserve, but instead at a garden or other areas with hand-placed plants you should mark it as cultivated. Though if you need more detail, the iNaturalist FAQ explains it in depth.

When you click on “What did you see?”, you’ll see a new screen with the level of depth they were able to identify it at and nearby organisms that are visually similar.

Screenshot showing most specific classification made and visually similar and nearby species.

Once you select the species you’re ready to publish the observation! This will generate a unique URL for the observation. For example, my white snakeroot observation. If another community member agrees with your classification and the observation has enough supporting metadata, then it could become research grade!

Research grade observations gets used by scientists for research which may also help improve the image classification algorithm for all. Happy identifying!

Reply via Email Buy me a Coffee
Was this useful? Feel free to share: Hacker News Reddit Twitter

Published a response to this? :