What is built,and what comes next.

A running log of the project: what we have shipped since September, what we are working on now, and where PinPoint is going.

How we got here.

  1. Late September

    The live skeleton

    MediaPipe pose detection on the phone, a step counter and a phase detector. Measured at 15 to 23 poses a second on our test phone, with the GPU doing the work.

  2. Early October

    Milestone 1

    Invite-only accounts, video upload, this website, and a pipeline that builds, tests and deploys every merge. Handed in on 7 October.

  3. Mid October

    The ball path

    A lane tracker that finds the lane, follows the ball and saves every shot, tuned on real alley sessions. Alongside it: email verification, backups that copy the database off the machine, and alerts to the team’s chat.

  4. 21 to 31 October

    3D

    Recording and replaying the approach as a 3D figure, a rigged human model driven by the recorded joints, and 3D poses for the seven phases built from reference photos.

  5. 26 to 28 October

    Training drills

    1, 2 and 5 step drills with a start-position check, spoken corrections and a finish check. The live coaching moved here from Live Analysis.

  6. 29 October to 1 November

    A new look

    The app was redesigned from the Figma prototype: Home, Analysis, Guides and Profile, a Ball and Form camera, ball path analysis and saved lane calibration. This website was rebuilt at the same time.

Built, in progress, and next.

Built

  • Live skeleton, step counter and seven-phase detection
  • Joint-angle comparison against a built-in or your own reference
  • Lane finding, ball tracking, Track Session and the shot library
  • 3D replay with a human model, and the 7 phases in 3D
  • 1, 2 and 5 step drills with spoken coaching
  • Accounts, verified email, uploads and My videos
  • Automatic build, test and deploy on every merge

In progress

  • Errors and a written description for each frame in Post Analysis (in review)
  • Making 3D replay work for every recording, including short or empty ones
  • Polishing the skeleton after a recording: it works on a laptop, and the phone’s speed is still to be measured
  • Retuning the ball-at-the-pins detector on more lanes

Next (ideas, not promises)

  • Left-handed bowlers and other approaches
  • Saving every analysis to your account and comparing sessions
  • Password reset by email
  • Moving videos to cloud storage with direct uploads
  • Showing the form errors on the 3D replay

Who it is for, and what it covers.

Anyone who can bowl. We are getting the core coaching loop right before we broaden it.

In scope

  • Five-step bowling approaches, plus 1 and 2 step drills
  • Right-handed bowlers
  • A phone side-on for form, or behind the bowler for the ball
  • Starting position and finishing position correction
  • Android phones

Not yet

  • Left-handed bowlers and approaches other than five steps
  • Saving step, phase and angle results to your account (videos already upload)
  • Automated scoring against a reference model
  • iOS