Skip to content

P2-1.1 What Math Does in AI Computation

Section ID: P2-1.1 Version: v2026.07.20

In Part 1, we viewed AI on a broad map of rules, models, learning, generation, and service structure. Starting in Part 2, we recover the foundations needed to read that map. The first question is how much math you need in order to relearn AI.

The answer in this section is not simple. You do not need to prove all the mathematics. But if you cannot read at all what mathematical notation is trying to express, you keep getting blocked whenever you read models, data, loss, probability, optimization, and embeddings.

So here, mathematics is not treated as an exam subject for getting the right answer. It is treated as a language, structure, and compressed notation for reading AI computation.

The reason to revisit mathematics here is closer to recovering literacy for reading expressions such as X, y, loss, and metric in Part 3 and Part 4 than to preparing for a test that solves problems. Once this standard is in place, it also becomes easier to read why vectors, derivatives, probability, and optimization are grouped into one part later on.

Here, we reorganize again the role of math, computational language, compressed notation, loss, and optimization. Before later sections and later chapters fully separate individual symbols and math topics, this section first clarifies why mathematics must be reread as part of AI computational literacy.

One Shared Scene to Hold First

Chapter 1 keeps reusing one small data scene. Suppose the study hours and quiz scores of four students are as follows.

Student Study time x Quiz score y
A 1 hour 55
B 2 hours 65
C 3 hours 80
D 4 hours 90

This scene reappears later through several questions.

  • If you compute the mean, you can see roughly where the center of the scores lies.
  • If you look at x and y together, you can read the relationship between input and output.
  • If you attach a model, you can turn the scene into a prediction problem: "How does the score change as study time increases?"
  • If you attach loss, you can calculate with a number how different the prediction is from the real score.

So here, mathematics is not a separate subject for learning difficult symbols. It is a tool that makes you reread a small table like this in the language of mean, function, error, and optimization. If a reader is not to get lost later when meeting sigma, vectors, and derivatives, they first need the standard that math is ultimately a language for reading, comparing, and adjusting data like this.

Core Criteria: What Math Does in AI Computation

  • You can explain why math is needed in AI from the viewpoint of expression and computation rather than proof.
  • You can treat a formula not as something merely to memorize, but as something to recheck through code and data.
  • You can explain what purpose each math topic in Part 2 serves.
  • You can reduce the burden of "not knowing math," while also understanding the limits that appear if mathematical notation is skipped entirely.

Three Criteria

What is needed first here is not proof, but a distinction of roles.

Criterion Why It Matters Required Understanding in This Section
Math is a computational language, not an answer test This gives you a starting point for reading documents even if you cannot solve every formula. Understand that formulas are tools that compress computational structure.
Math explains the shape of data and the direction of learning This connects why vectors, matrices, loss, and gradients appear in the same part. Understand that math checks what is represented and what is being reduced or changed.
Formulas must ultimately be checked again through code and results In AI learning, reading formulas alone is not the end. Understand that a small code example is used to read what computation is being checked.

Math Shows Computation in Compressed Form

In AI documents, mathematics compresses a long computational procedure. For example, when there are many data values, the idea of taking a mean can also be explained in everyday language. If you expand the procedure into words, you add all the values and divide that sum by the number of values.

A formula writes that procedure more briefly.

\[ \mathrm{mean} = \frac{x_1 + x_2 + \cdots + x_n}{n} \]

With sigma, it becomes even more compressed.

\[ \mathrm{mean} = \frac{1}{n}\sum_{i=1}^{n}x_i \]

This compressed notation can feel unfamiliar. But in AI and machine-learning documents, formulas mostly play this role. They write long repeated calculations, many data points, many parameters, sums of losses, and products of probabilities in a short form that humans can read.

You can unpack a formula by asking the following questions.

  • What does it take as input?
  • What does it add or compare?
  • What is it trying to reduce or increase?
  • Into what variable does the result appear in code?

If you return to the study-time and quiz-score table above, the mean score is the computation that adds 55, 65, 80, 90 and divides by the number of students. The formula writes that repetition briefly, and the code in a later section unfolds it into an actual procedure. What the reader should hold here is not the symbol itself, but the repeated structure that handles many values at once.

Math Determines the Shape of Data

AI models do not handle raw sentences, images, sounds, and tables directly. Most of them are transformed into computable forms such as arrays, vectors, matrices, and tensors.

A sentence can be transformed into tokens, numeric IDs, and vectors. An image can become a pixel-value array and a tensor. Tabular data can become a matrix or DataFrame with rows and columns.

Here, mathematics explains what shape this data has. A vector is a list of values. A matrix is a structure that arranges values by rows and columns. A tensor can be viewed as an array with more axes.

This viewpoint is important when rereading embeddings and vector search from Part 1. The phrase "express text as a vector" does not mean a person writes semantic coordinates directly. It means transforming text into a representation inside a numerical space so that a model and search system can compute on it.

If you apply the same standard to the table above, the x column and y column are also just lists of numbers in the end. To a human, they look like the story of study time and score, but a model reads them as an input vector and output vector, or as a small table of data. Without this sense of transformation, later terms such as X, y, shape, feature, and target feel like a completely new topic.

Math Explains What Learning Changes

In AI, learning is not vaguely "the process of getting smarter." It is usually explained as the process of adjusting model parameters so that loss decreases. If you unfold this flow in order, input data enters, the model produces output, the output is compared with a reference to compute loss, and then the parameters are adjusted in the direction that reduces that loss. This is repeated again and again.

Several math concepts attach to this flow.

  • function: expresses the relationship that turns input into output
  • loss function: expresses with a number how wrong the model is
  • derivative and gradient: find the direction in which changing values reduces loss
  • optimization: repeatedly search for a better value
  • probability and statistics: handle patterns and error in uncertain data

Here, rather than computing these concepts directly, we first organize why they keep appearing in AI learning explanations.

Suppose you attach a very simple line to the study-time and score table. If the model predicts "How many points would appear after 1 hour of study?" and the difference from the real score is large, then the loss becomes large. Learning is the process of changing the slope and position of that line little by little in the direction that reduces the difference. In this one short scene, input, output, prediction, error, loss, and optimization all appear together.

Math Has to Be Checked Together with Code

When you read only mathematical notation, it feels abstract. Code turns that abstract expression into an executable procedure. In particular, array-computation tools such as NumPy let you check vector and matrix computation directly in code.

Problem situation:

  • even a familiar math concept such as the mean can feel abstract if you see only the formula

Input:

  • the numeric array x = [1, 2, 3, 4]

Expected output:

  • the mean value 2.5

Concept to check:

  • the mean calculation written in a formula can be executed in code with the same meaning
  • a small array example is the simplest starting point for connecting mathematical notation with actual computational results
 1
 2
 3
 4
 5
 6
 7
 8
 9
10
# This example stores study-hour data in a NumPy array and checks the input values used for the mean.
import numpy as np

# x is the small numeric array used to check the mean.
x = np.array([1, 2, 3, 4])

# mean is the representative average value of the values in x.
mean = x.mean()

print(mean)

Example execution result:

1
2.5

This code checks the mathematical concept of a mean using small data. The key point here is not advanced library usage, but that formula, data, and code all express the same computation in different ways. The moment the reader sees 2.5, they can see directly that the mean has returned from an abstract symbol to an actual value.

  1. A formula shows the structure of the computation in compressed form.
  2. Data provides the values that become the subject of the computation.
  3. Code executes the computation in practice.
  4. The result lets you check what the computation actually did.

Part 2 keeps connecting these four things. Mathematics is not left alone as "theory that must be understood," but is rechecked through small code and data.

The Order in Which Part 2 Reads Mathematics

Part 2 is not the order of proving mathematics deeply. It is the recovery order for reading AI computation.

  • formula notation: reread variables, functions, expressions, sigma, and limits
  • linear algebra: view scalars, vectors, matrices, and matrix multiplication from the viewpoint of data representation
  • derivatives and gradients: view rate of change, slope, and gradient as the language of learning direction
  • probability and statistics: view uncertainty, distribution, mean, variance, and sample as the language of data interpretation
  • optimization: view it as the method of repeatedly finding values that reduce loss
  • Python and NumPy: check how formulas become executable code

This order is not "finish mathematics first, then go to AI." It is the order that builds the minimum path by which mathematical notation encountered while reading AI documents can be reused again.

How to Reduce the Burden of “Not Knowing Math”

Most math learned a long time ago becomes blurred in memory. In particular, expressions such as limits, sigma, derivatives, and matrices may sound familiar in name, but their actual use may not return immediately. Here, that is not treated as failure.

Still, the following two points are distinguished.

  1. Not understanding every proof is allowed in Part 2.
  2. On the other hand, if you cannot read at all what a formula is trying to compute, then you will keep getting blocked when reading machine learning and deep learning.

So the goal is not to become a complete mathematician. The goal is to become able to read which part of data, model, loss, and learning this formula is explaining.

Case Study

Case 1. Why Do You Freeze as Soon as You See a Loss Function Formula?

Suppose a learner first sees a loss-function formula in a machine-learning book. Even if the number of symbols is not large, it can still feel overwhelming. A person easily experiences it as if it were a test problem that must be solved correctly, but in reality the formula often just writes in compressed form what is being compared and what is being reduced.

For example, an expression that squares and adds the difference between predicted values and actual values is simply a short way of writing the computational structure that gathers how wrong the model is into one number. Here, instead of following the proof immediately, first unpack what is the input, what is being compared, and what value is ultimately being reduced.

This case shows why mathematics should be read as a computational language. Instead of memorizing formulas, you need to read which part of model computation this expression explains. Only then do probability, vectors, derivatives, and optimization connect through the same map later.

In other words, mathematics feels burdensome not only because there are many difficult concepts, but because compressed notation is often read all at once. The purpose of Part 2 is to create practice in unpacking that compression again into data and code.

Here, we first fix the place that mathematics occupies in AI computation, and the detailed formula rules for sigma and limits, or the full computations of vectors and derivatives, are narrowed again in later chapters.

Checklist

  • You can explain that in AI, mathematics is used as a language for reading computational structure rather than mainly as proof.
  • You can connect formula, data, code, and output together.
  • You can explain that vectors, matrices, and tensors express the computable shape of data.
  • You can explain learning as the process of adjusting parameters to reduce loss.
  • You can explain why Part 2 revisits linear algebra, derivatives, probability and statistics, and optimization.
  • You can explain Part 2 through the flow that mathematics in AI does the three jobs of representation, comparison, and adjustment.
  • You can explain why sigma, vectors and matrices, derivatives, and probability and statistics reappear together in one part.

Sources and References