Machine learning for signal detection and estimation in wireless communications