picoLLM: Android local LLM setup tutorial

This tutorial, uploaded on May 27, 2024, walks through the picoLLM Android chat demo. It shows how to run models locally on an Android device using Android Studio and a model downloaded from the Picovoice Console. The source gives no recording date or software version, so the steps describe the setup shown in that upload.

The presenter starts by downloading Android Studio and cloning the picoLLM GitHub repository. The repository shown includes separate Android demos for chat and prompt completion; this walkthrough uses the chat demo. Before deploying it, the presenter copies an access key from a Picovoice Console account and downloads a model described as roughly one gigabyte.

Android Studio's Device Explorer handles the model transfer to the device's Downloads folder. The presenter then pastes the access key into the indicated placeholder in the demo's main activity. Once the transfer finishes, they deploy the app to the Android device, select the uploaded model file when prompted, and enter a chat question.

The walkthrough demonstrates an on-device chat setup, but it does not specify an Android version, minimum RAM, or device hardware. It also provides no performance measurements or test of offline operation.