The real trick that magicians perform happens long before you’re amazed. When many non-magicians picture magic tricks, they focus on sleight of hand: some fancy fingerwork alongside misdirection that allows the trickster to get away with monkey business that wouldn’t play if looked at directly.
For magicians, sleight of hand is the (relatively) easy part. Of course it plays a key role in close-up magic; without it, most tricks won’t work. But the prestidigitation distracts from where the hard work takes place, such as practicing card tricks endlessly, privately, in front of a mirror, until the moves become deeply ingrained and subconscious.