With noise cancelling headphones, you will get an auditory illusion that there's even more bass because you've reduced the mids and highs. The bass can not be stopped or reduced by such things. If the bass is quiet enough, then there's a chance that you may be able to hide the low end frequencies (the bass) with a sound machine or a noise machine - preferably producing "white noise". The most effective type of sound you can use is very similar to an extremely loud computer fan where it has that soft pure white noise sound of only the rushing air. Or ocean waves, or a giant waterfall, or anything producing pure white noise that's in the upper frequencies.
However, you may have the right to complain. There is a local music bar here that has restrictions for this very reason. They get big name regional acts too! I used to run the spot light for this bar and the first time I noticed the difference, I complimented the sound engineer on a good mix because I finally didn't need my ear plugs! Then he explained the noise restrictions because "people finally complained".