seems like two drivers compeeting on controling the interface, it would help a wee bit if you told us what WIFI brand you're using, and the output of 'lspci', 'lspci -vv and 'lsmod'
Perhaps some information on what type of WIFI it is, ie:
- hidden SSID
- encryption method
- your neighbours encryption (on/off)
- signal strength of your AP vs. your neighbours strength
- etc.. What you can come up with that would help troubleshoot