sql-explorer

Very cool! I wrote Django SQL Explorer[0], and this looks very similar in spirit, but an emphasis on visualization that Explorer does not have (to the extent it has a focus, it's more on providing a reasonable way to write complex queries and re-use them). These types of tools are extremely handy. [0] https://github.com/groveco/django-sql-explorer

At Grove, we are: Airflow -> S3 -> DBT with Spark/EMR or Redshift/Spectrum -> Redshift data marts -> Looker At least, that’s the way we like our pipelines to work. In practice we have a couple of extractions that land directly in Redshift (we extract Zendesk data, for instance, with Stitch Data). We use Snowplow for click stream analytics. And we’ll likely move from Redshift to Snowflake (or mayybbbeee Bigtable) in Q2 of 2020. We used to do all of our transforms via DBT within Redshift but have been offloading the heavier-duty pieces (like Snowplow event processing) to Spark jobs because they were too taxing on Redshift. We’ve gone through 3 “generations” of Looker reporting — gen 1 was just wrapping LookML around our schema and forcing Looker to do the joins and generate SQL for everything we wanted to know. Second generation involved a

I've tried Superset but halted because there is a bug with PostgreSQL ( https://github.com/airbnb/superset/issues/1900 ). I'll be trying Redash to see what's going on. In the mean time, there is a Django project where I've integrated the sql-explorer ( https://github.com/groveco/django-sql-explorer ) and it was well appreciated. Especially the API endpoint.

I maintain an open source project for writing SQL queries[0] that currently uses codemirror. I find it a little sluggish to load. This looks like it could be a good option -- the one thing that would make it a codemirror killer for me is the ability to resize the editor window; something text areas obviously natively support, but codemirror does not. Any idea if Monaco does? [0] https://github.com/groveco/django-sql-explorer

Looks like a nice tool. I wrote https://github.com/epantry/django-sql-explorer, which is sort-of similar in terms of the problem it solves, except embraces SQL front-and-center. Excited to check this out in more depth. Personally, I think it's really exciting is that this is all written in Clojure! We need more Clojure web apps out there to learn from! An initial glance at the source makes it seem very readable as well. A great learning resources for us amateur Clojurists. Also makes it clear that the ecosystem is pretty immature; there is a lot of frameworky boilerplate to support a straightforward REST API.

This looks pretty awesome! It is also worth mentioning Django SQL Explorer (https://github.com/epantry/django-sql-explorer), which has all of the presented features, as well as handy schema definition by the side. It also allows for parameters in the queries, which is very useful (e.g. leaving the timeframe customisable before running a query). With Django 1.8 now being easier to install/deploy to wherever, this is a great plugin to allow more people data access!

Django SQL Explorer https://github.com/epantry/django-sql-explorer Engineers or analysts write SQL queries, and share them with anyone in the business who needs the data to make decisions. Through over a year of heavy, daily real-world use, I've added dozens of little usability features that make it (for me at least) really pleasant to use. It's still a pretty under-the-radar Django app, but I literally can't imagine life without at, at any business I've ever worked at. Explorer can also expose select queries as read-only pages to specific users and we use this feature to keep investors and partners up to date on key metrics and financials which saves a lot of time and ad-hoc reporting. Just go to a URL and BAM! Real time data, downloadable as CSV. I've also documented the version and license of every dependency to make it as easy as poss

There's the excellent https://github.com/epantry/django-sql-explorer if you're running a Django app.