Back to Insights
    Technology & AI

    How AI Analyzes Biometric Landmarks: The Science of Machine Vision

    January 8, 20256 min readBy Robbie Andrew, Founder, FaceRating.ai

    To a human, a face carries emotion, identity, and personality. To a computer, a face is a dataset — pixel intensities that software can turn into coordinates, angles, and scores. Analysis tools do not "see" you the way another person does. Classic landmark software applies computer vision to measure the geometry of your features; a vision model instead looks at the whole image and estimates. Here is how the classic pipeline works, step by step, and where FaceRating.ai differs.

    Step 1: Detecting that a face exists

    Before measuring anything, the system must locate the face in the image. Early detectors — like the Viola-Jones algorithm that powered 2000s digital cameras — scanned for simple light/dark patterns (eyes are typically darker than the forehead). Today, convolutional neural networks trained on millions of images find the bounding box of a face reliably across lighting and pose. Detection just answers "is there a face, and where?" — the measurement comes next.

    Step 2: Mapping biometric landmarks

    Once a face is found, a landmark model projects a mesh of landmarks onto it. The long-standing academic standard is the 68-point scheme from the iBUG 300-W annotation set — points 37–42 outline the left eye, 49–68 the lips, 28–36 the nose, 1–17 the jawline. Modern 3D pipelines such as Google's MediaPipe Face Mesh push this to 468 points. The influential method for placing these points fast and accurately is Kazemi and Sullivan's 2014 "ensemble of regression trees." A landmark pipeline ignores skin tone, makeup, and background — it works purely from the (x, y) coordinates of these anatomical anchors.

    Step 3: Turning geometry into numbers

    With landmarks placed, the software computes relationships: ratios (is mouth width ≈ 1.618 × nose width?), angles (the nasolabial angle at the nose tip), and symmetry (how far do left and right landmark pairs deviate when folded across the midline?). Many systems build a Delaunay triangulation over the points to make these calculations stable. This converts subjective "beauty" into reproducible measurements — the same photo yields the same numbers every time.

    Step 4: Correcting for head pose

    A major challenge is pose variance: tilt your head and one eye appears lower and smaller even on a perfectly symmetric face. To handle this the system applies an affine transformation — rotating and scaling the face until the eyes are level and centred (aligned to the Frankfort horizontal plane). This normalisation is why a landmark tool can return a consistent result even if a selfie was not shot at a perfect straight-on angle.

    Where the computation happens

    One important aspect of modern AI analysis is where the heavy computation happens. Simple face detection can run in the browser, but the deeper analysis behind a detailed score — running a large vision model — requires far more computing power than a phone or laptop browser can provide on its own. So when you upload a photo to FaceRating.ai, it is transmitted over an encrypted (HTTPS) connection to our secure servers, where an AI vision model assesses the photo and returns your results. It does not place landmarks or run the geometric steps above: it looks at the image and estimates each score — symmetry, golden-ratio compliance, proportions and the individual features. The model runs at temperature 0, so repeat scores for the same photo are stable, and re-uploading the identical file to the same account normally returns your stored result. We process your image on trusted infrastructure and handle it in accordance with our Privacy Policy.

    Putting it into practice

    When you run our face rating analysis, what you see is a vision model’s assessment of one photo — not a judgment of you, and not a ruler. The AI face rater returns the twelve feature scores alongside the model’s symmetry and golden-ratio estimates. The same kind of vision model powers our celebrity lookalike matcher, which looks at the features in your photo and names the celebrities it judges closest to you. If you want to see how the resulting scores distribute across real users, our average face rating score study puts individual numbers in context.

    The takeaway

    Classic face analysis is applied geometry: detect, landmark, measure, normalise. A vision model like ours reads the photo and estimates instead. Either way, the output speaks to proportion and symmetry and is silent on everything it cannot see: expression, charisma, and the life behind the face. Understanding how the number is produced is the best defence against over-reading it.

    Try a free face rating

    Start with your overall rating, basic shape and symmetry. Explore the sample report before choosing optional full access.