How are you suppose to pronounce the word "armadillo"?

It is an Anglicized Spanish word derived from the Spanish word "armado" meaning "armoured". The correct pronunciation is your second choice: arm - a - dillow, with the emphasis on the first syllable.