Doesn’t matter how many times I go there and look at the open sky and the amazing view, it always looks new to me. For quite some time I have been thinking about capturing the sun set – had to wait for the perfect day with clear visibility, without any fog or haze to get these shots.
I read this amazing article from Prof. Viktor Mayer-Schönberger and Thomas Ramge on Harvard Business Review. Follow the link here – https://hbr.org/2018/02/are-the-most-innovative-companies-just-the-ones-with-the-most-data
They have made an excellent case for a data driven innovation. Citing examples of how Google, Apple and Amazon are using data to further innovation and outsmarting not just their existing competitors but also the startups, they have made it very clear that the future innovation will be owned by enterprises which are able to leverage AI in generating insights from the data and not just rely purely on human ingenuity.
I am sharing here the two adjustments, they mentioned about, that enterprises need to make:
First, they need to reposition themselves in the data value chain to gain and secure data access. Second, as innovation moves from human insight to data-driven machine learning, firms need to reorganize their internal innovation culture, emphasizing machine learning opportunities and putting in place data exploitation processes.
Now, one interesting point to ponder about is – what do we mean by data really ? In all of their examples it means the data generated by users which is being used by large corporations to generate insights for improving their products or services.
What does it mean for companies whose product or services are not consumed or delivered online ? eg. Pharmaceuticals
In that case they need to look at the data that is publicly available. Thankfully, there is a lot of data that is available publicly eg. information on clinical trials, research publications, disclosures to regulatory bodies, reviews from regulatory bodies, data from different scientific congresses across the world, theses from universities, patents from major patent bodies globally, data from major global regulatory bodies etc.
In the context of the second adjustment above, enterprises need to leverage AI to automate not just the collection and curation of data but also the generation of insights, specific to key processes, from the data. Entire Drug Development process is very long and complex, with a lot of tasks / processes which are repetitive in nature or involve a lot of manual content reviews at each step. It is up to the enterprises to empower their teams to step up the value chain from doing manual analysis of data to being the domain specialists who can partner with Data Scientists to come up with good training data sets, to validate the output of these algorithms and to be the data quality supervisors.
In the end, it will only improve the overall satisfaction of employees as they will free to solve real problems instead of clerical tasks, which ultimately leads to happier and more productive workplace.
P.S. The title (Innovation eats data for breakfast) is just a pun on the famous “Culture eats strategy for breakfast”, a phrase coined by the legendary Peter Drucker.
The goal for any content driven website is to provide its users with relevant content based on Information Discovery. Most of the websites choose ‘search’ as a tool for information discovery (Netflix is a mind blowing exception to this) and in search, relevance is heavily dependent on context rather than just strings present in them. Not many websites realise this and I was surprised to see that HBR.org , known for having one of the best content repositories, giving barely useful results for my search queries.
Now, I am a happy subscriber of Harvard Business Review and have been using it often to enhance my limited knowledge by discovering interesting content around technology, business, leadership etc. and have absolutely no doubt on the high quality of its content and really great contributors. But, I am disappointed at how that content is becoming difficult to discover in the first place. Here is how its search looks like:
All looks well, it has a very familiar interface, like most of the other sites have and the first result does have the word I searched for “search”. Don’t go away yet, stay with me till the end 🙂
In my quest to learn more and follow everything about Artificial Intelligence I keep looking everywhere for anything related to AI. I thought let’s try what all is there in HBR.org repository on AI. I search first for artificial intelligence and look at the results:
First result is a “Sales and Marketing” case study about an early stage company Empathetics (an organization that teaches empathy to healthcare professionals and staff to improve the patient experience) and I wonder why is that the top result (when sorted by relevance!) for what I searched for. I open it, scratch my head really hard to figure out what exactly is related to AI there but could not find anything. I scroll down and to my despair, the other results are also out of the world for me. Here they are:
Then I thought of trying the ‘exactness’ trick – I searched for “Artificial Intelligence” and boom!
ZERO results! Apparently it does not support exact string search, which ideally it should. I knew this is simply not true as HBR.org does have articles on AI. Examples:
It gives irrelevant results in search even though the right content is very much there in repository.
Moving on, I tried taking my chances on AI – I search for ‘AI’. Here is what happens:
Do you notice it? There is an author Ai-Ling Jamila Malone whose name contains “AI” and HBR.org simply is showing me all articles from the author. This means it is giving a higher score (probably) to words found in a wrong field (author field) than the content itself and that too without any context.
Now it could have been deliberately done assuming most of the people want to search for names of authors but hey, that use case CAN be handled in a better way.
Moving further, I check for another hot topic – Deep Learning – and default (sorted by relevance) results appear to be relevant (see now it shows me results for artificial intelligence as well).
But the articles are old and I needed the latest ones – the moment I try sorting by publication date I see this:
the first result is this – https://hbr.org/2018/01/the-5-things-your-ai-unit-needs-to-do – which may seem somewhat relevant given it has AI in its title but it is not even remotely related to “Deep Learning” and the only reason it appears in search results is because there is a word “deep” in one paragraph somewhere
and there is another paragraph with the word “learning” somewhere.
The other results are same –
https://hbr.org/product/ch%C3%A2teau-margaux-launching-the-third-wine-abridged/518070-PDF-ENG — this tops the chart of weirdness for me.
they have the words “deep” and “learning” somewhere and hence it is being shown. An important point to consider – I want latest but still relevant results and HBR.org fails at it. It does not identify ‘deep learning’ as a concept made of two words and is simply looking up the words appearing somewhere in the content.
The root causes for all of it can be summarised as follows:
- The search at HBR.org is still relying on basic keyword based scoring and has no Ontology of concepts like “Artificial Intelligence” or “Deep Learning” or the relationships between the concepts.
- It does not account for synonyms and hence is unable to understand that “Artificial Intelligence” and “AI” are same concepts. An Ontology makes it much easier to maintain all synonyms of any given concept.
- It does not identify entities so is unable to differentiate between name of a person “Ai-Ling Jamila Malone” and a concept “AI”
Based on how we have designed information discovery for our Data as a Service (DaaS) platform iPlexus.ai I can say that the primary reason for all of the problems is the missing Ontology leading to missing Entity Recognition and disambiguation.
Search is important but in itself is not always the best way for information discovery. Users don’t get happy at seeing millions of search results for what they search – that only adds to information overload. What matters is, if you are telling me there are so many possible results out there, then tell me how they are distributed across different dimensions around my ‘interest’. Let me choose a direction and don’t force me to keep going through all the results in a linear fashion – nobody will live through to get to the end of the millionth result page. And not just Innoplexus but I know there are few other companies out there who are following this philosophy and making Information Discovery easier for their users. One of the examples I quoted above as well is Netflix.
Thanks to Ravi Ranjan for reviewing the article and helping with the headline 🙂
Slow clap for all of those who thought Bitcoin (or other crypto currencies) were / are not being manipulated. Techcrunch reported on 15th Jan and MIT Technology Review reported on 16th Jan about a research which gives insights into how Bitcoin was being manipulated by two bots named Markus and Willy – in 2013. They performed valid trades but did not actually own any bitcoin themselves.
Entitled “Price Manipulation in the Bitcoin Ecosystem” and appearing in the recent issue of the Journal of Monetary Economics the paper describes to what degree the Bitcoin ecosystem is controlled by bad actors. Based on rigorous analysis with extensive robustness checks, the paper demonstrates that the suspicious trading activity likely caused the unprecedented spike in the USD-BTC exchange rate in late 2013, when the rate jumped from around $150 to more than $1,000 in two months.”
Now you can imagine if this happened in 2013 then what is happening today. For all its talk about decentralisation, the fact that it is so susceptible to such manipulations, should be a warning for everybody trying to ‘try their luck’ in Bitcoin or other crypto currencies.
I came across this article on HBR today which looks at the world’s best restaurants to find out how they balance Innovation and Consistency.
Here’s the summary :
Despite being able to charge hundreds of dollars for a meal and being fully booked months in advance, top restaurants often still have a hard time turning a profit. And they face an added challenge of maintaining flawless consistency, while simultaneously being innovative and cutting-edge. This requires dedicated time and space for research and experimentation, as well as a thorough process for both iterating on and standardizing new inventions. Examples of restaurants that have made both the Michelin Guide and 50 Best Restaurants of the World list show how they encourage creativity and learning beyond the leadership or lab teams, and generate, refine, and standardize ideas.
The original article is here – https://hbr.org/2018/01/how-the-best-restaurants-in-the-world-balance-innovation-and-consistency
All the projects follow a specific development process, alternating between collective ideation or feedback and focused work by a small team. For restaurant dishes, the development team will quickly prototype and iterate through numerous versions of the dish and its components, either in the lab or if a lab is not available, in the main kitchen during slow hours. The trials can go over for months as numerous variations are tested in a race against seasonal ingredients.
This just goes on to prove that Consistency and Creativity are not mutually exclusive – restaurants need to be both at the same time. Innovation which is not a result of a set process will soon become unsustainable – one may be able to innovate even without process at times but no one can repeat the feat a number of times. That consistency is possible only with a process.
What differentiates an Entrepreneur from a Manager ? While I still do not have a definite answer to it, I do have an anecdote, shared by one of my mentors few years back.
A group of lumberjacks entered a forest with their manager to carry out a survey on how much wood log will they be able to generate from there. Few of them gave the feedback to manager that most of the trees they found till that time did not have good quality and the trunks were not all straight. The manager asked them to extend the area of survey.
They went back and carried on. Two days passed by but the results were not encouraging. Third day, manager’s boss, the owner of the small company (the entrepreneur) reached there and asked about the progress. The manager presented the report with number of trees his team had surveyed, how many trees were of good quality, how many hours did his team spend in surveying etc. along with explaining that he has now extended the survey area to find more trees with better quality. He listened intently and asked his manager if he already has an idea of the tallest tree his team has found in the surveyed area. Manager, beaming with a sense of achievement, said yes and offered to take him to the tree.
Once the boss reached there, he surprised everybody by saying he wants to climb the tree. Manager said that it is a bit risky, that he should reconsider it and maybe ask one of the team members to climb instead. He refused and started climbing. Atop, he spent about five minutes looking around in all directions, came down and asked the manager “Call everybody back, we are leaving”. The manager was dumbfounded, saying we have invested so many days already, maybe we should wait till we find better trees, that the forest is so big. Owner simply replied “Wrong forest!”.
Originally published my me on Linkedin
न यह अंत है, न यह आरंभ है
न यह नवीन है, न यह प्राचीन है
न यह स्वाधीन है, न यह पराधीन है
आकांक्षा भी यही और अनल भी
कृष्ण भी यही और कंस भी
राम भी यही और रावण भी
पुष्प भी यही है और भ्रमर भी यही है
अपरिमित, अजान, अबूझ, अनघ एक यही है
यह समय है, यह बस समय है
न यह गया है और न यह आने वाला है
आज है, अभी है, इसी क्षण है
यह बस है, यह बस है
इसी अनुभूति के साथ नव वर्ष २०१८ की शुभकामनायें |