Using the app

The app allows you to

• label data (upload videos, extract frames, annotate keypoints)

• train and evaluate models

• run inference on new videos

Additionally, the app comes with an example dataset if you want to explore, without needing to label your own data.

The following docs detail how to launch the app and describe the individual tabs; for more information on specific workflows, see the User guides.

Launch the app

Once you have opened the Lightning Pose App Studio, you will see the following:

Make sure you are connected to a GPU machine for non-labeling tasks.

First, open a terminal by using the drop-down menu at the top left and select Terminal > New Terminal.

To launch an app from the terminal, first move to the Pose-app directory:

cd Pose-app

and run:

lightning_app run app app.py

Note

If you see the message “lightning run model is deprecated…” on the command line after trying to launch the app, you are running a newer version of lightning. In order to launch the app, instead run lightning_app run app app.py.

Note

You may get a message alerting you that a new version of Lightning is available. There is a possibility that upgrading will cause breaking changes, and you can always decline. If you do upgrade and an error occurs, please notify the maintainers by raising an issue.

Once the app launches you will begin to see printouts in the terminal. Navigate to the app output by clicking on the “port” plugin on the right-hand tool bar (see image below), type in port number 7501, and click “update”.

IMPORTANT! You will need to click on the “Share” button, which will open the app in a separate browser window. This is crucial to getting all of the components visualized properly. In the original browser page you can return to the terminal to see printouts by clicking on the VS Code icon in the right-hand tool bar.

Click on the links below to find more information about specific tabs.

App tabs:

• Manage Project
• Extract Frames
• Label Frames
• Train/Infer
• Train Status
• Image Diagnostics
• Image Viewer
• Video Diagnostics
• Video Player

Close the app

To shut down the app: return to the terminal/VS Code view of the Studio by clicking on the appropriate icon in the right-hand tool bar (see image below), and type “ctrl+c” in the terminal.

To shut down the studio: click on the compute icon in the right-hand tool bar and then click the power button.