iOS Local Animal Identification App

Offline recognition, online encyclopedia, creating a new intelligent animal identification experience.

Background

My graduation project is “Development of an AI-Powered Mobile Application for Animal Identification and Information”. The goal is to develop a mobile app that can identify animals. After discussing with my advisor, I decided to use Yolo as the deep learning recognition model. The mobile app is developed natively for iOS, using Swift and SwiftUI in XCode. I have always been interested in iOS development, so I took this opportunity to learn native iOS development thoroughly.

Development

Technical Route

Model Training

The dataset is Open Images V7 Animals YOLO, which contains 11 animal classes with 50,000 images.

I chose this dataset because it has YOLO format labels, but after completing the training, I found that the dataset is not very good. It is very imbalanced, as shown in the figure below, with nearly 27,000 images of “dogs”, but others average only 2,000 images. However, I still tried to train the model to see the results.

I used YOLO11m to train the model, which is the latest version of YOLO. I trained it with default parameters, setting epochs to 200, and I did not verify overfitting issues.

.pt Model Performance

The system shows the image below, where the model is embedded in my small system, automatically inferring images from the system camera.

.pt Model Performance

CoreML Model Export

Because I wanted to deploy the model on iOS, I needed to export the model to CoreML format. I followed the command in the official tutorial to export the model:

from ultralytics import YOLO

# Load the YOLO11 model
model = YOLO("yolov11m.pt")

# Export the model to CoreML format
model.export(format="coreml", nms=True)  # creates 'yolo11n.mlpackage'

After successful export, a file named yolo11m.mlpackage was generated. Next, I could embed it into my iOS project. In XCode, I could preview the mlpackage, and the result is as follows:

CoreML Model Preview