Provide a Mapping from Logstash Configuration files to Data Prepper configurations

[dlvenable]

Is your feature request related to a problem? Please describe.

Beyond just parsing a Logstash configuration grammar, we must also be able map Logstash plugins and settings into Data Prepper plugins and settings.

Describe the solution you'd like

Provide a mapping file which can define how a Logstash plugin should map into Data Prepper.

[dlvenable]

I'd like to propose the following approach.

When a Logstash plugin is found, Data Prepper will look for a file at the classpath location:

com/amazon/dataprepper/logstash/mapping/{pluginName}.mapping.yaml

So for example, the elasticsearch plugin would load: com/amazon/dataprepper/logstash/mapping/elasticsearch.mapping.yaml

This file might look like:

name: opensearch

Or in the case of supporting the amazon_es plugin

name: opensearch
settingValues:
  sigv4: true

Where settingValues sets a specific value.

We also might have something like attributeNames which can convert names of attributes.

For example,

attributeNames:
  logstashAttributeA: dataPrepperAttributeB