How automatically read ingestion yaml from folder by openmetadata?

[nikita-sheremet-java-developer]

I am looking at https://github.com/open-metadata/openmetadata-demo and see that all yaml files like lineage.yaml are ingestion with cli command like metadata ingest -c lineage.yaml.

Does openmetadata support to read all ingestions yaml file from just folder? For exmaple I deploy openmetadata and put all configs into folder that added to openmetadata pod. In this case I will always have versionized deployment and can use IaC.

May be there are some workarounds?

[Prajwal214]

OpenMetadata does not natively support reading all ingestion YAML files from a folder in a single command. You can achieve this by using a script to iterate over the YAML files in a directory and execute the metadata ingest -c command for each file. This approach allows you to maintain versioned deployments and use Infrastructure as Code (IaC) practices.

#!/bin/bash

# Directory containing YAML files
CONFIG_DIR="/path/to/your/configs"

# Iterate over each YAML file in the directory
for yaml_file in "$CONFIG_DIR"/*.yaml; do
  echo "Processing $yaml_file"
  metadata ingest -c "$yaml_file"
done

This script will loop through all YAML files in the specified directory and run the ingestion command for each one. You can integrate this script into your deployment process to automate the ingestion of multiple configurations.