Comprehensive software reviews to make better IT decisions
Databricks and Immuta Partner to Provide End-to-End Data Governance for Machine Learning
Databricks, a data processing and analytics platform with a strong focus on artificial intelligence (AI) and machine learning (ML), has partnered with Immuta to deliver automated end-to-end data governance for AI, data science, and ML projects.
The partnership is addressing the old self-service dilemma: how does one balance speed and agility with control when a typical organization has hundreds – if not thousands – of policies that vary based on business or functional groups involved, use cases, data types, geographies, technologies, and more.
Immuta, whose mission is to ensure “the legal and ethical use of data,” approaches this from three complementary angles:
- Policy orchestration
- Policy enforcement
- Self-service data catalog
The company was founded in 2015 by a team who spent ten years working with the US intelligence community. It is a Series B startup whose investors include Citi, DFJ, Dell Technologies, Daimler, Greycroft, Drive Capital, and others.
Immuta’s automated data governance solution integrates natively with Databricks’ Unified Data Analytics Platform. Its metadata-driven policy orchestration provides users with easy-to-manage, fine-grained end-to-end data governance controls for their data lake so that they can meet the data stewardship requirements of their organization.
As organizations are embarking on – and in some cases expanding – their ML and AI projects, the same old challenge not only persists but becomes more prevalent and acute: data governance.
How do you ensure that you have the right controls in place, that the right people have access to the right data, that the data is secure, that the organization is in compliance with existing regulations, and, more importantly, that you can trust the data? Because if you can’t trust your data, you can’t trust your AI. (Or machine learning, or data analytics output.)
And these challenges are magnified as organizations acquire more data – some of it sensitive – and store it in the same place, whether a warehouse or data lake, thereby increasing the risks.
Meanwhile, governments are tightening regulations and consumers are getting more educated. In addition, privacy watchdogs are pressuring governments and businesses alike to strengthen and enforce data protection laws, implement regulations around algorithmic decision-making systems (i.e. anything that uses ML), and ensure that the business model organizations are respectful of human rights.
(For more information on why this is important, see our earlier note Amnesty International Calls Google and Facebook a Threat to Human Rights.)
As a result, many organizations are slowing down their AI/ML initiatives to reopen, resume, and rejuvenate data governance. Where do you stand with your data governance initiative?
Want to Know More?
To start with data governance or to optimize it, consult the Info-Tech blueprint Enable Shared Insights With an Effective Data Governance Engine..
To learn what else you need to govern – in addition to data – when deploying AI/ML-powered solutions, reads the CIO Note Are You Ready For AI?
To get a quick introduction to why human rights matter for your business model, watch our two-minute brief Google and Facebook Called a Threat to Human Rights or read our tech note Amnesty International Calls Google and Facebook a Threat to Human Rights.
On May 24-25, Informatica held its annual conference in Las Vegas – the first time “in-person” since the beginning of the COVID-19 pandemic.
Transparency, explainability, and trust are pressing topics in AI/ML today. While much has been written about why these are important and what organizations should do, no tools to help implement these principles have existed – until now.
By exploiting a five-year-old configuration error, a hacker was able to access Amazon’s S3 cloud storage buckets on which Twilio’s code was loaded. As a result, customers were able to unknowingly download the modified code for twenty-four hours.
Qualys VMDR and Ivanti have announced a new partnership dedicated to improving the detection and patching of vulnerabilities. Announced July 30, the Qualys and Ivanti Partnership have already gone live as an integrated component of the VMDR solution.
IBM is changing the terms of its ubiquitous Passport Advantage agreement to remove entitled discounts on over 5,000 on-premises software products, resulting in an immediate price increase for IBM Software & Support (S&S) across its vast customer landscape.
The beauty of good story telling is its applicability to the most unexpected situations. In 1871, Lewis Carroll wrote about the evil Queen trying to convince Alice to work for her, with a promise of “jam to-morrow and jam yesterday – but never jam to-day.” Little did he know that this one statement would be used by economists, politicians, playwrights, and musicians long after he wrote it – it's time to add data analysts to the list.
RiskSense announced on July 13 its new version of the cloud-delivered RiskSense risk management platform. The main draw of the program is its holistic risk calculation across CVEs and CWEs.
Cyberthreats are omnipresent for any enterprise. Monitoring ingress and egress points while still conducting business is a balance security professionals attempt to strike. Couple this with the continued security issues around remote work during the pandemic, and security teams have their hands full.
Navigating the vendor risk management space, particularly in the current environment that consists of a mix of cloud, managed services, and critical supply chain, is key to ensuring that you don’t inadvertently introduce new risks through this dynamic channel.