Any attempt at improving the mod mechanism will make many of the things mods now do impossible, as many of their features rely on things which would never fly in a sandboxed environment. This is probably why, instead of the modding API, we get Mojang hiring the developers of the Minecraft Coder Pack.