By default, interactive elements (like buttons) are excluded from swiping so that swipe detection doesn't interfere with the interactivity of those elements.
If you attach the follow as a .js file using the Resources section, it will update the swipe function not to exclude any elements from swipe detection:
$(function(){
$('#container').swipe({excludedElements:''});
});
Note: this may cause issues with the interactive elements.