Setting up PICO4Enterprise from initial setup to Face and Hand tracking

If you have any problems, ask on the owomushi server.

Warning:I will not be held responsible if you are unable to do what is described in this article or if it breaks due to the cause.

◎Do it with PICO4E

1. Download firmware and apk on PICO4E side (download on PC or PICO4E side browser)

https://www.youtube.com/watch?v=0K-KFUmc2t8

Check OS version and OEM or Non OEM

Download Pico Multi tool Pc App 5.12.0 and run main.exe

Device→Check OEM State and Check OEM or Non OEM

Download Global Pico 4 global 5.12.0 (OEMor non-OEM) from here

Download Pico Connect apk from here

(If you want to use hand tracking, please use PICO Connect 10.4.5 at the bottom of this page.Hand tracking is not available in the latest version)

Then transfer Global Pico 4 global 5.12.0 (OEMor non-OEM) to the "dload" folder

If there is no "dload" folder, create a folder in the root directory

Pico Connect Transfer the 10.4.5 apk to the "Download" folder

2. PICO4E system update

Select offline update in "System Update" in PICO4E settings

https://scrapbox.io/files/67811da549313692b0d1f9e8.png

The system update will run at this point

Once the update is complete, proceed to the next item

3. Install apk in PICO4E

Launch the file manager

Select PICO Connect in the apk item

Install

4. Display PICOConnect on the home screen

https://scrapbox.io/files/678124d0530e585402eee5d2.mp4

Settings → General → About device → Tap software version about 10 times

Developer mode will be enabled

Developer → Business settings → System apps → Enable Connect in Customize library

"StreamtingAsstant" will appear in the library (success)

5. Start PICOConnect

https://scrapbox.io/files/678123d3ec153e2051982798.mp4

When you start it for the first time, it will ask you to log in, so press Cancel

Once you've done this, the next step is to set up your computer

◎Do it with PC

1. Download and install PICO Connect

From here, Pico Connect Download the Chinese version of 10.4.5(or Newer Version)

(If you want to use hand tracking, please use PICO Connect 10.4.55 at the bottom of this page.Hand tracking is not available in the latest version)

Install

Launch it once installation is complete

2. Update PICO Connect(If necessary)

When you launch PICO Connect on the PICO4E side

It will say that the versions are inconsistent

https://scrapbox.io/files/67812c37668a9ee405283987.jpeg

The PC screen will also say that it is inconsistent, so update it

Once the update is complete, you can connect like this

https://scrapbox.io/files/67812ccac025165110e8a79e.png

3.Tweak the settings

As each person is different, please use it as a reference.

Games

Resolution

Refer to the value of your graphics card. If you are not sure, high quality is recommended as it is 100% resolution.

Bitrate

Increase to the maximum

Refresh rate

Set to 90Hz

Codec

If you do not have any particular preference, AVC (H.264) is recommended.

Frame Interpolation

Disabled

Frame buffering

Enable

Video Super-resolution

Enable

Audio

Microphone

50%(If you turn it up too much, the sound will distort.)

Audio output device

Headset

Lab

Hybrid

This completes the initial setup of PICO Connect, next we will set up face tracking.

Face tracking settings on the PICO4E side

https://scrapbox.io/files/67812f0becf5dd09189dcc33.mp4

1. Enable the following items from Settings → Lab.

90Hz mode

Quick see-through mode

Hand tracking

Eye tracking

If you haven't calibrated it yet, do so.

Face tracking

PC side face tracking settings

https://scrapbox.io/files/6781342bfd68b123a48f562f.mp4

1. Download VRCFT

2. Install

3. Install "Pixo4SAFTExtTrackingModlue" from ModuleRegistry

4. Rewrite the PICO Connect file

https://scrapbox.io/files/6781367a614638c00891aa81.mp4

Rewrite "faceTrackingTransferProtocol" in the following file from 0 to 2

C:\Users\{YourUsername}\AppData\Roaming\PICO Connect\setting.json

This is the end of the settings, thank you for your hard work.

All that's left is to enable OSC on VRC and if Sending is enabled on VRCFT (and reflected on the avatar), then you're good to go.

PC side Hand tracking settings

0. Downgrade PICO Connect（If your PICO Connect version is newer than 10.4.55）

If your PICO Connect version is newer than 10.4.55, you will not be able to install the apk.

In that case, you can install it by uninstalling the update.

Download and Install setting.apk

Open setting→Apps&Notifi…→SteamingAssistant→Top right 「︙」→Uninstall Update

https://scrapbox.io/files/67e33b18ea3ca60af41b0d54.mp4

1. Download and install PICO Connect 10.4.55 (Global)

Download and install PICO Connect 10.4.55 from this link

*If you have the Global version, the FaceTracking item will not appear in Lab, but if you can receive data on VRCFT, there is no problem

2.SteamVR binding settings

https://scrapbox.io/files/67aa93dba7c03baa6b5562e1.mp4

The default binding is set for HandTracking, but if you are using a custom binding, this may not be possible.

In that case, the settings are:

1. Select "Controller Binding" on the SteamVR screen

2. Make sure that "Manage Controller Binding" is "VRChat" and select "Edit this Binding"

3. Set the skeleton items to "skeletonlefthand" and "skeletonrighthand" for each one

Once you have set this up, let go of the controller and show your hands where the camera can see them to check if they are being tracked.