Mix pudding and milk until there are no lumps. Fold in cool whip. Place one sliced banana layer on the bottom of the crust. Add half of the pudding mixture. Layer next banana and rest of pudding mixture. Chill in refrigerator for 3 hours. When ready to serve top with caramel.