The apostle Paul used a fine illustration there. Food for adults can not be given to little children, but rather can be introduced little by little to them.
Milk is usually taken by adult, for children to take it has to be broken down to a simpler form.
We get nourishment from studying the bible. To be well fed from the spiritual milk, we have to give attention to spiritual things needed for Christian growth.