“One should touch the Tefillin so as not to get distracted.”
It seems as though it would be better for distraction if he looked at the Tefillin. However, distraction means that we should remember that the Tefillin are a Segula [remedy/power], and touching is called “an act.” Action is called “faith,” which is the opposite of reason; it is against reason.