I thought he drank them all at once and then declined to allocate them for now, wanting to think it over and potentially use them in case of emergency. He should still have 12 points.
MEMORIZE - Novel Discussion Ch. 213mo
"The rest of the group, all holding crossbows, were thinking of the man with the ever-calm face." Where did all of these crossbows come from? Only the main character has one and he took it with him when he left to draw the monsters away.