For machine learning to create the most value, it is essential to consider ML as a marathon and not a sprint.
Today, businesses are increasingly reliant on artificial intelligence and machine learning to solve critical problems. However, dealing with immense data complexities along with the pressure of having to provide rapid results, could be crippling. Most companies find building an ML-savvy framework quite overwhelming. In an engaging session at MLDS 2021, Sayanti Bhattacharya, Senior Manager, and Ashwin Pai, Manager at Ugam, a Merkle Company, addressed how businesses can apply machine learning to drive results.
Common Misconceptions
Machine learning has become such a fashion statement that, more often than not, businesses jump the gun by implementing ML in a hurry, defying logic. Bhattacharya stressed on the importance of focusing on the right way to chart a company’s ML journey. For instance, said Bhattacharya, we often see ML applications in our daily lives in the form of maps, digital ads, object detection technology, personalised notifications, etc. But when it comes to business applications, leaders are daunted by thoughts such as; the ML is complicated; involves coding; dicey on the value it brings; and worried about its overall compatibility with their business plan, etc.
Pai has neatly laid out the ML concept in simple terms:
Taxonomy: It is essential to understand that machine learning is a subset of AI and includes supervised learning, unsupervised learning and reinforcement learning. They are further divided into tree-based models, association rules, neural networks, regression, clustering, similarity algorithms, transfer learning, deep reinforcement learning and more. “There is a whole lot of length and depth associated with machine learning,” stressed Pai.
Common beliefs: Pai has also brought up the uncalled pressure companies face in implementing ML just because it’s trendy. More often than not, companies talk about adopting ML without realising the underlying need for it. They fall for ‘bigger the better’ trap and end up integrating complex algorithms.
When Should I Use ML?
Bhattacharya said the companies need to do a reality check to assess if ML is critical to their operations. Machine learning can work well for tasks that entail sequential decision making or rule-based decision making. “Having said that, bigger is not always better,” she added.
Picking up from Bhattacharya left off, Pai said the key is to keep ML scalable but straightforward. For instance, in the earlier days, apriori algorithms were used for concepts such as product affinity, ARIMA for forecasting and logistic regression for classification, but are now replaced by more complex algorithms such as LSTM and deep neural networks, as data grew in volume over the years. While there are many options available to approach a problem, it is crucial to break down the problem and then apply ML, if necessary, said Pai.
Incremental Improvements
Bhattacharya pointed out that for machine learning to create the most value, it is essential to consider ML as a marathon and not a sprint. She said, rushing into incorporating ML into an organisation’s workflow may lead to challenges such as data fatigue, infrastructure fatigue, time fatigue and most importantly, expertise fatigue. “Dealing with data requires collecting, analysing and harmonising it — jumping into it will lead to a stressful journey,” she said. Therefore, ML requires building endurance rather than speed. For instance, she said, areas such as customer review and ratings, website search metadata, customer service enhancement etc can be done with text analysis.
To build M, laying a strong foundation is essential. Detailing a use case, she said they used elementary application of text mining for a situation where they had to understand what customers were saying about the products on a website—implementing a solution as easy as this resulted in a 20% reduction in product return and identification of unauthorised users.
