I've assigned my left/right/down button for the look left/look right/look back controls but it allows to look in the required direction only for a fraction of second. Even when the buttons is held does not improve.
What controller device you have that mapped on? Outright without any info, i'd say it's button sending just one "impulse", regardless if you hold it down.