Nouns ending in -er are usually masculine, but la cuiller is feminine.
Cuiller is one of the rare exceptions: learn it as it is.
Comment est-ce que je mange, sans cuiller ?
How do I eat without a spoon?
Il y a une cuiller.
There is a spoon.
J'aime les cuillers.
I like spoons.
FrenchTextbook teaches rules like this, in a full beginner course.
162 lessons, 4,000+ exercises, and 6+ hours of audio.
Try the first lesson free