As I explain, you can't perfectly reverse these filters because of quantizing. The more the signal is attenuated, the more information is lost when quantizing. So yes, it does matter what your kernel is.