Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix gdrive_to_snowflake task in example_load_dag #2072

Merged
merged 6 commits into from
Dec 22, 2023

Conversation

vatsrahul1001
Copy link
Collaborator

The gdrive_to_snowflake task was failing because we hadn't set the GOOGLE_APPLICATION_CREDENTIALS in deployment. This pull request addresses the issue by creating a credential file using the Google Cloud Platform Service Account credentials from secrets, which is essential for the task.

Copy link
Contributor

@pankajastro pankajastro left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@@ -23,7 +23,7 @@ function echo_help() {
echo "ASTRO_ORGANIZATION_ID Astro cloud organization Id"
echo "ASTRO_DEPLOYMENT_ID Astro cloud Deployment id"
echo "TOKEN Astro workspace token"
echo "bash deploy.sh <ASTRO_DOCKER_REGISTRY> <ASTRO_ORGANIZATION_ID> <ASTRO_DEPLOYMENT_ID> <TOKEN>"
echo "bash deploy.sh <ASTRO_DOCKER_REGISTRY> <ASTRO_ORGANIZATION_ID> <ASTRO_DEPLOYMENT_ID> <TOKEN> "
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
echo "bash deploy.sh <ASTRO_DOCKER_REGISTRY> <ASTRO_ORGANIZATION_ID> <ASTRO_DEPLOYMENT_ID> <TOKEN> "
echo "bash deploy.sh <ASTRO_DOCKER_REGISTRY> <ASTRO_ORGANIZATION_ID> <ASTRO_DEPLOYMENT_ID> <TOKEN>"

?

Copy link

codecov bot commented Dec 22, 2023

Codecov Report

Attention: 2 lines in your changes are missing coverage. Please review.

Comparison is base (d4fe295) 89.54% compared to head (60339cd) 90.12%.
Report is 5 commits behind head on main.

Files Patch % Lines
...on-sdk/src/astro/databases/databricks/api_utils.py 0.00% 1 Missing and 1 partial ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##             main    #2072      +/-   ##
==========================================
+ Coverage   89.54%   90.12%   +0.57%     
==========================================
  Files          75       75              
  Lines        4323     4323              
  Branches      537      538       +1     
==========================================
+ Hits         3871     3896      +25     
+ Misses        355      327      -28     
- Partials       97      100       +3     
Flag Coverage Δ
PythonSDK 90.12% <50.00%> (+0.57%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@vatsrahul1001 vatsrahul1001 merged commit 73d398a into main Dec 22, 2023
39 of 40 checks passed
@vatsrahul1001 vatsrahul1001 deleted the fix-gdrive_to_snowflake-task branch December 22, 2023 08:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants