Big data - On Ingest Tagging

In this chapter

Following documents explain On Ingest Tagging:


On Ingest Parser parses the file and extracts extended metadata while it is being written onto the cluster. Extended metadata refers to the file metadata that is not interpreted by file system. It is used to associate files with some extra information. Typical usage can be storing the author of a document, the character encoding of a plain-text document, a checksum or digital signature. These metadata about files are saved in the database.

To add on ingest parser to the cluster, navigate to Data > Manage Datasources > Manage Data Tagging view.

Add On Ingest Parser

Use following guidelines to add an On Ingest parser

You can use Query Manager to query the metadata extracted using these parsers.

To see how to write your own parser, refer to the developer documentation

Copyright 2018 QueryIO Corporation. All Rights Reserved.

QueryIO, "Big Data Intelligence" and the QueryIO Logo are trademarks of QueryIO Corporation. Apache, Hadoop and HDFS are trademarks of The Apache Software Foundation.