Proper use of metadata is crucial for any organization to truly understand the data they are processing and how it flows through their enterprise. However, with the state of today’s data, its volume, the variety of tools and technologies used to process it, and the business requirements that are unique for each company, it is impossible to come up with a universal formula and solution to fit all possible business needs and use cases.
We have designed OpenManta to address those needs and equip users with a solution that allows them to build their own metadata ingestion process for Manta Flow and take advantage of the Manta Flow platform without a formal scanner.
With OpenManta, you can fine-tune the Manta Flow repository, build tailored assets and lineage to extend it for custom use cases, and adjust it to your audience’s lineage needs and technical understanding. Here’s when, how, and why OpenManta can be leveraged.
Diversified Tech Stack
There are a million reasons why no two data systems are alike—organizational maturity, the methods and purposes of data collection, industry-specific regulatory requirements, data strategy, mergers and acquisitions, and more. To keep up with current requirements, organizations update and modernize their systems, often leaning toward open source tools and cloud technologies.
But there are also other mature, established technologies and programming languages in place that can’t just be eliminated or ignored. After all, those technologies and languages laid the foundations of the organization’s current position and the state of their data, so neglecting the assets residing there is out of the question.
The answer is to make all technologies, older and newer, coexist and to make it possible to use each of them, build any types of objects, and illustrate any kind of relationship between them, regardless of where the data assets reside.
Illustrate Any Kind of Relationship
Understanding the complete journey of data, how it flows through complex systems, how it transforms, and how it interacts with other assets is crucial for its further use and the purpose you want the data to serve at the time. However, the varying nature of technologies and programming languages in use makes it difficult to automatically harvest lineage across all these sources, and additional manual effort might be required to document lineage from unsupported technologies.
Luckily, this is not the case if you are with Manta—regardless of your systems’ complexity, you can cut down on manual effort. OpenManta makes it possible to illustrate any kind of relationship, thanks to several extensions (such as Core Models, New Models, and more) that let you:
- Create new assets for your tables, columns, schemas, databases, data movement processes, etc. (without the use of a scanner),
- Create lineage connections between existing tables, columns, and schemas,
- Create and define lineage for any type of object in your enterprise,
- And more.
Anything you can visualize with Manta when there’s a scanner available can now be achieved for any other technology where there is no available lineage solution. The sky is the limit—OpenManta allows you to build any type of objects and represent any kind of connection between them.
Leverage OpenManta’s capabilities to:
- Automatically document lineage across all data sources
- Build a bridge between mature, established technologies and cloud technologies
- Keep experimenting with various open source tools
- Avoid deploying multiple vendor solutions
- Organize your metadata how you like
- Get all the benefits of Manta for technologies we don’t have a native scanner for yet
Read more about Manta’s unique features here.
Would you like to explore OpenManta in greater detail and get more technical details on how to start customizing Manta in your environment? Get in touch with one of our representatives at firstname.lastname@example.org.