Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

vdk-ipython: add support for %%vdkingest #2866

Merged
merged 3 commits into from
Nov 15, 2023
Merged

Conversation

antoniivanov
Copy link
Collaborator

The commit introduces a new IPython magic function, vdkingest, which
enables data ingestion through TOML configuration within a Jupyter
notebook. This enhancement aims to simplify and streamline the data
ingestion process by allowing users to declare their data flows in a
structured format (TOML), thereby making it more accessible and
maintainable.

This is an optional feature of the plugin. If vdk-data-sources is not
installed, an ImportError is raised with an informative message.

(the commits will be merged as separate commits with rebase)

Copy link
Collaborator

@duyguHsnHsn duyguHsnHsn left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Love it, please include an example cell to the description of the PR, maybe you can even show how it replaces the job_input.ingest... methods

@murphp15
Copy link
Collaborator

Yeah I need a screenshot example to understand it properly.

@antoniivanov
Copy link
Collaborator Author

Yeah I need a screenshot example to understand it properly.

What kind of screenshot:

Here is one:

image

This commit introduces a new IPython magic function, `vdkingest`, which
enables data ingestion through TOML configuration within a Jupyter
notebook. This enhancement aims to simplify and streamline the data
ingestion process by allowing users to declare their data flows in a
structured format (TOML), thereby making it more accessible and
maintainable.

This is an optional feature of the plugin. If `vdk-data-sources` is not
installed, an ImportError is raised with an informative message.
@murphp15
Copy link
Collaborator

thats pretty cool

@antoniivanov antoniivanov enabled auto-merge (squash) November 15, 2023 10:46
@antoniivanov antoniivanov merged commit 45f2268 into main Nov 15, 2023
@antoniivanov antoniivanov deleted the person/aivanov/ipython branch November 15, 2023 10:56
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants