Skip to content

Conversation

arikfr
Copy link
Member

@arikfr arikfr commented May 15, 2019

What type of PR is this? (check all applicable)

  • New Query Runner (Data Source)

Description

JSON data source, which allows loading data from (almost) any JSON URL (Documentation).

TODO:

- [ ] Rename it to HTTP (?).
- [ ] Migration to update the type of existing URL data sources to use this one.
- [ ] Migration to update existing queries to support the new format.
- [ ] Remove URL data source.

I figured there is no point in waiting to deprecate the URL data source and delaying the release of this one. We will do it in a separate task.

Related Tickets & Documents

https://discuss.redash.io/t/missing-json-data-source/3448/22

@arikfr arikfr added the Backend label May 15, 2019
@AlanHodgkinson1
Copy link

Hello.

When is this likely to be available in the preview docker containers?

Thanks.

@morsedl
Copy link

morsedl commented May 18, 2019

Fantastic, and thanks for your efforts on this! We're just now switching over to a more heavily REST-oriented approach, so this will be most helpful. Please keep us apprised, and if I can help with some testing or the like, I'd be happy to do so (at least as best I can; we're swamped laying down an entirely new software infrastructure).

@rwatts3
Copy link

rwatts3 commented May 30, 2019

I understand you all are busy building, would it be possible to provide instructions for how to build this PR into a docker image so that it can be tested?

I attempted to deploy a version of redash from the docs with docker, however I ran into a few issues getting things to run nicely. I.E webpack, etc.

@rwatts3
Copy link

rwatts3 commented Jun 18, 2019

Just stopping by to see if there is an update on the docker preview build.
I see the new previews are starting to tag 8.0 beta, however, I'm still noticing there is no JSON data source.

@flolivaud
Copy link

Hi everyone,

Tried to build docker image locally, but i can't view/use the current json datasources.
Tried to test it locally without docker too, still the same problem.

Is there something i miss about it, or maybe it's not functionnal now ?

Thanks.

if 'url' not in query:
raise QueryParseError("Query must include 'url' option.")

if is_private_address(query['url']):

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why should we avoid querying private url/ip ?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Because in some environments being able to query private addresses might allow you to poke around things you shouldn't (like AWS metadata of the instance hosting Redash). We can make this optional if needed.

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think it's a good idea to have an option to disable it

@arikfr arikfr changed the title WIP: JSON Data Source JSON Data Source Jul 11, 2019
@arikfr arikfr marked this pull request as ready for review July 11, 2019 10:54
@arikfr arikfr merged commit 15a8eec into master Jul 11, 2019
@arikfr arikfr deleted the json-ds branch July 11, 2019 11:23
The-Alchemist pushed a commit to The-Alchemist/redash that referenced this pull request Jul 15, 2019
* WIP: JSON Data Source

* Add JSON data source to default list
harveyrendell pushed a commit to pushpay/redash that referenced this pull request Nov 14, 2019
* WIP: JSON Data Source

* Add JSON data source to default list
@susodapop susodapop mentioned this pull request Jul 26, 2021
1 task
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants