> no clear difference between statistics and machine learning
Yes, there is. When your model has thousands/millions of parameters, or when your model has many more parameters than the number of examples in your training set, it's called Machine Learning.
That's not true. Linear and logistic regression are like the first things you learn in a machine learning class. Many popular ML models do not have millions of parameters, including decision trees and shallow neural networks.
Yes, there is. When your model has thousands/millions of parameters, or when your model has many more parameters than the number of examples in your training set, it's called Machine Learning.