“Every day, companies need to track and trace data movement processes through metadata discovery and data lineage,” emphasizes Amnon Drori, CEO and co-founder of Octopai. This task has not been easy and has often frustrated Drori throughout his twenty-year career. In the past, Drori’s teams have had to spend time checking and rechecking data, a cumbersome process of retrieving, understanding, and trusting data. Case in point: about four years ago…

This past fall, all aspects of the computable knowledge structure KBpedia – its upper ontology (KKO), full knowledge graph, mappings to major leading knowledge bases, and 70 logical concept groupings called typologies – became open source. Making big strides in increasing definitions and mappings has been a main focus of KBpedia v. 1.60. As it always has, KBpedia combines key aspects of Wikipedia, Wikidata, schema.org, DBpedia, GeoNames, OpenCyc, and UMBEL into an integrated whole and supplements these…

IT technologies are rapidly changing our lives. Whether it’s your daily grocery purchase, monthly bill payments, booking railway tickets, or receiving online healthcare consultation, data technologies have penetrated every business model, large, medium, or small. Recent cloud platforms, coupled with Big Data and IoT technologies, have ushered in a new era of “smart technologies” powered by Artificial Intelligence (AI) and Machine Learning (ML) to provision an additional layer of automated…

People often think the algorithms used for Machine Learning (ML) are the most important factors for developing a successful ML system. However, shrewd Artificial Intelligence (AI) and Machine Learning systems in production (managing the data at all stages, with multiple models) have much more impact on the success of the model than the specific learning algorithm. In their book AI and Analytics in Production, Ted Dunning and Ellen Friedman describe…

More big companies are investing in treating data as a core strategic asset, and they’re increasingly hiring Chief Data Officers (CDO) to help them do a better job. The percentage of corporate CDOs rose from 1 percent in 2005 to 13 percent in 2013. The dynamic and dramatic move toward a hyper-personalized society during those years made it clear to social media companies and other big tech vendors that there…

A primary concern of digital businesses today is the reliability of data. Many business users are still judging the ultimate value of data-guided analytics with a certain degree of skepticism, which can only change over time with delivery of solid benefits. The reliability of business data comes from a well-designed and well implemented Data Architecture. Very simply, the Data Architecture is the blueprint for managing data in an organization, which…