This repository contains several examples of writing custom data loaders in Glue.
The basic process for writing custom data loaders is described in the Glue documentation. The basic strategy is as follows:
- Write a function that takes a path as an input, and returns one or more Glue data objects as output
- Wrap this function in the
@data_factory
decorator, which adds the function to the Glue UI - Put this code in a
config.py
file, which Glue runs on startup.