Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: Support object store in *_scan functions. #1306

Merged
merged 2 commits into from
Jul 13, 2023

Conversation

vrongmeal
Copy link
Contributor

2 Arguments:

SELECT * FROM csv_scan('gs://bucket/path/to/object.csv', 'gcp_creds');

3 Arguments:

SELECT * FROM parquet_scan(
  's3://bucket/path/to/object.csv',
  'aws_creds',
  'us-east-1' -- Region
);

Fixes #1249

2 Arguments:

```sql
SELECT * FROM csv_scan('gs://bucket/path/to/object.csv', 'gcp_creds');
```

3 Arguments:

```sql
SELECT * FROM parquet_scan(
  's3://bucket/path/to/object.csv',
  'aws_creds',
  'us-east-1' -- Region
);
```

Fixes #1249

Signed-off-by: Vaibhav <[email protected]>
@vrongmeal
Copy link
Contributor Author

vrongmeal commented Jul 13, 2023

Created #1308 for named arguments. Will continue working and push another PR as a solution to the mentioned issue.

Copy link
Member

@scsmithr scsmithr left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚀

@@ -476,164 +478,213 @@ impl TableFunc for ReadSnowflake {
}
}

#[derive(Debug, Clone, Copy)]
pub struct ParquetScan;
pub const PARQUET_SCAN: ObjScanTableFunc = ObjScanTableFunc(FileType::Parquet, "parquet_scan");
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍

@vrongmeal vrongmeal enabled auto-merge (squash) July 13, 2023 17:47
@vrongmeal vrongmeal merged commit bd831cf into main Jul 13, 2023
@vrongmeal vrongmeal deleted the vrongmeal/scan-obj-store branch July 13, 2023 18:04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Support object storage for *_scan functions
2 participants