sparkmagic

I maintain several open source projects, most notably: Sparkmagic (https://github.com/jupyter-incubator/sparkmagic) Sparkmagic provides jupyter magics and kernels for working with remote Spark clusters. It's used by thousands of developers and companies like Pinterest, Amazon, more! I've been maintaining for the past few years and would love help! KSOPS (https://github.com/viaduct-ai/kustomize-sops) KSOPS, or kustomize-SOPS, is a kustomize KRM exec plugin for SOPS encrypted resources. KSOPS can be used to decrypt any Kubernetes resource, but is most commonly used to decrypt encrypted Kubernetes Secrets and ConfigMaps. As a kustomize plugin, KSOPS allows you to manage, build, and apply encrypted manifests the same way you manage the rest of your Kubernetes manifests. KSOPS is the most popular kustomize plugin and I'd love help maintaining

Jupyter would be even better if it supported the seamless combination of Python and SQL code cells. My notebook code typically involves a data prep stage with querying a SQL database, then downloading into Python for more complex analysis, ML modelling, integration with external data sources, etc. So the notebook has a Python kernel with SQL usually as embedded """-quoted strings. Does anyone have a solution to treating selected code cells as SQL - with SQL highlighting and tooltips - exposed as string variables to the Python code? Sparkmagic [1] does part of this for Python/SQL/Spark interoperability, but as far as I recall, doesn't support SQL syntax highlighting. [1] https://github.com/jupyter-incubator/sparkmagic

Viaduct | ML Engineer, Data Engineer, Site-Reliability Engineer, Software Engineer, UX-Designer | SF | Fulltime At Viaduct, we are developing an end-to-end machine learning platform to empower automakers to build safer, smarter, and personalized vehicles. Our platform increases the accessibility and actionability of connected vehicle data for automakers and their end-customers. We are a small, diverse team motivated to solve the hardest problems in the automotive industry and are looking for thoughtful and driven engineers to join us! To get a sense of our engineering culture, check out the open-source projects we've created or maintain: - https://github.com/viaduct-ai/kustomize-sops - https://github.com/viaduct-ai/hybridcontents - https://github.com/jupyter-incubator/sparkmagic - https://github.com/shreyashankar/gpt3-sandbox - https://gi

Viaduct | ML Engineer, Data Engineer, Site-Reliability Engineer, Full Stack Engineer, Software Engineer | SF | Fulltime' At Viaduct, we are developing an end-to-end machine learning platform to empower automakers to build safer, smarter, and personalized vehicles. Our platform increases the accessibility and actionability of connected vehicle data for automakers and their end-customers. We are a small, diverse team motivated to solve the hardest problems in the automotive industry and are looking for thoughtful and driven engineers to join us! To get a sense of our engineering culture, check out the open-source projects we've created or maintain: - https://github.com/viaduct-ai/kustomize-sops - https://github.com/viaduct-ai/hybridcontents - https://github.com/jupyter-incubator/sparkmagic - https://github.com/shreyashankar/gpt3-sandbox - h

Viaduct | ML Engineer, Data Engineer, Software Engineer | SF | Fulltime At Viaduct, we are developing an end-to-end machine learning platform to empower automakers to build safer, smarter, and personalized vehicles. Our platform increases the accessibility and actionability of connected vehicle data for automakers and their end-customers. We are a small, diverse team motivated to solve the hardest problems in the automotive industry and are looking for thoughtful and driven engineers to join us! To get a sense of our engineering culture, check out the open-source projects we've created or maintain: - https://github.com/viaduct-ai/kustomize-sops - https://github.com/viaduct-ai/hybridcontents - https://github.com/jupyter-incubator/sparkmagic - https://github.com/shreyashankar/gpt3-sandbox - https://github.com/viaduct-ai/pipelines Reach out

Viaduct | ML Engineer, Data Engineer, Software Engineer | SF | Fulltime At Viaduct, we are developing an end-to-end machine learning platform to empower automakers to build safer, more intelligent, and personalized vehicles. Our platform increases the accessibility and actionability of connected vehicle data for automakers and their end-customers. We are a small, diverse team motivated to solve the hardest problems in the automotive industry and are looking for thoughtful and driven engineers to join us! To get a sense of our engineering culture, check out the open-source projects, we've created or maintain: - https://github.com/viaduct-ai/kustomize-sops - https://github.com/viaduct-ai/hybridcontents - https://github.com/jupyter-incubator/sparkmagic - https://github.com/viaduct-ai/pipelines Reach out at recruiting@viaduct.ai https://www.v

Viaduct | ML Engineer, Data Engineer, Software Engineer | SF | Fulltime At Viaduct, we are developing an end-to-end machine learning platform to empower automakers to build safer, more intelligent, and personalized vehicles. Our platform increases the accessibility and actionability of connected vehicle data for automakers and their end-customers. We are a small, diverse team motivated to solve the hardest problems in the automotive industry and are looking for thoughtful and driven engineers to join us! To get a sense of our engineering culture, check out the open-source projects, we've created or maintain: - https://github.com/viaduct-ai/kustomize-sops - https://github.com/viaduct-ai/hybridcontents - https://github.com/jupyter-incubator/sparkmagic - https://github.com/viaduct-ai/pipelines Reach out at recruiting@viaduct.ai https://www.v

Viaduct | ML Engineer, Data Engineer, Software Engineer | SF | Fulltime At Viaduct, we are developing an end-to-end machine learning platform to empower automakers to build safer, more intelligent, and personalized vehicles. Our platform increases the accessibility and actionability of connected vehicle data for automakers and their end-customers. We are a small, diverse team motivated to solve the hardest problems in the automotive industry and are looking for thoughtful and driven engineers to join us! To get a sense of our engineering culture, check out the open-source projects, we've created or maintain: - https://github.com/viaduct-ai/kustomize-sops - https://github.com/viaduct-ai/hybridcontents - https://github.com/jupyter-incubator/sparkmagic Reach out at recruiting@viaduct.ai https://www.viaduct.ai/careers

Viaduct | ML Engineer, Data Engineer, Software Engineer | SF | Fulltime At Viaduct, we are developing an end-to-end machine learning platform to empower automakers to build safer, more intelligent, and personalized vehicles. Our platform increases the accessibility and actionability of connected vehicle data for automakers and their end-customers. We are a small, diverse team motivated to solve the hardest problems in the automotive industry and are looking for thoughtful and driven engineers to join us! To get a sense of our engineering culture, check out the open-source projects, we've created or maintain: - https://github.com/viaduct-ai/kustomize-sops - https://github.com/viaduct-ai/hybridcontents - https://github.com/jupyter-incubator/sparkmagic Reach out at recruiting@viaduct.ai https://www.viaduct.ai/careers