mara-example-project-2

You could check out https://github.com/mara/mara-example-project The project is just a demonstrator for the Mara framework but it gives a good overview and you could take it as a starter for something you want to build.

For example the PyPI download stats pipeline is here: https://github.com/mara/mara-example-project/tree/master/app... The __init__.py contains the pipeline, and the rest is the SQL files that do the transformations

(author here) The mara example project [1] does exactly that. It combines PuPI download stats with Github repo activity data. [1] https://github.com/mara/mara-example-project

(author here) Connection information is configured in code through [1], see [2] for an example. It's very easy to run other workloads. Either by directly invoking Python functions from tasks or by writing own commands (operators)[3]. There is a command line. It's the interface for running from external schedulers (jenkins, cron)[4] & [5] [1] https://github.com/mara/mara-db [2] https://github.com/mara/mara-example-project/blob/master/app... [3] https://github.com/mara/data-integration/blob/master/data_in... [4] https://github.com/mara/data-integration/raw/master/docs/exa... [5] https://github.com/mara/data-integration/raw/master/docs/exa...

the docs animations inline add to casual-browsing fun https://github.com/mara/mara-example-project