Flight mode does not make you untraceable - it just makes your phone less useful.

If you're doing something illegal, or talking to someone about something illegal, leave your phone at home, and use your $15 dumbphone with an unregistered throwaway sim.