Learn

RAM: the fast memory your programs live in

RAM (random-access memory) is the fast, volatile memory a computer uses to hold the programs and data it is actively working on. It is temporary: it clears when the power goes. On a discrete-GPU machine it is separate from the GPU's own memory; on a DGX Spark the two are one shared pool.

At a glance

What it is
Fast temporary memory holding what the machine is working on now
Volatile
It clears on power-off; it is not storage like a disk
Versus GPU memory
Usually separate from a GPU's own memory on a desktop
On a DGX Spark
One pool shared by the operating system and the GPU

What is RAM, and how is it different from storage?

RAM (random-access memory) is the fast, temporary memory a computer works out of. When you open a program or load a model, it goes into RAM so the processor can reach it quickly. The catch is that RAM is volatile: switch the power off and it is empty. That is the line between memory and storage. A disk keeps your files after a reboot but is far slower; RAM is fast but forgets everything. The machine keeps the lasting copy on disk and pulls the active copy into RAM to actually use it.

How does RAM relate to running models?

On a normal desktop with a discrete graphics card, the model lives in the GPU’s own memory and the operating system lives in system RAM, so the two rarely fight over space. A DGX Spark works differently: there is one pool of memory, and both the GPU and the operating system draw from it. That is how the box fits a large model in a small chassis, but it has a consequence worth remembering. The memory your browser and background services hold is memory your model cannot. Run past what is free and you OOM (hit an out-of-memory error). The fix is usually to free something else first, not to buy more.

Check it yourself

free -h

The 'total' column is how much memory the machine has, 'used' is what programs hold right now, and 'available' is the headroom left before things start to fail.

RAM is

  • Fast, so the processor reaches it quickly while working
  • Temporary, holding only what is active right now
  • On a DGX Spark, the same pool the GPU draws from

RAM is not

  • Permanent storage; a disk keeps data after power-off, RAM does not
  • Free for the model alone; the OS and your programs want it too
  • Unlimited; run past it and you swap to disk or you OOM

Related terms

← All terms Reviewed: June 2026