Taking Learning Beyond Typical LMSs