You're given 21 stat points to play with at the start of the game, and every time you level up, you're given a choice between adding an extra point of S.P.E.C.I.A.L., or spending a point on a perk.
stands for Strength, Perception, Endurance, Charisma, Intelligence, Agility and Luck, and each stat empowers different attributes.