Tag: Pipeline

In science and life, humans (and maybe other creatures) always find a way to simplify certain activities in their lives. We often do this to reduce repetitive tasks and the risk of monotonous and boring work. Pipelines have a similar function. A bioinformatics pipeline is a collection of commands...

In America, an estimated 50% of the prison population is dyslexic. It’s an illiteracy incarceration crisis that has been going on for generations, as we turn dyslexic children into juvenile delinquents, and then into inmates. A prison pipeline for the learning disabled; a criminalization of il...

How many homes is San Francisco actually building right now? This question is more important than ever; the city is deep in a housing crisis. Even with a few years of pandemic-related rent deflation, SF maintains one of the highest costs of living in the U.S., with housing as public enemy number ...

Making a decision on which CI/CD tool to use will depend on your needs & project requirements as there are a number of CI/CD tools such as Gitlab, GitHub, Travis, TeamCity, Jenkins, and a lot more. If you want to take advantage of the integrations across services in the AWS ecosystem, don't ...

Welcome! In this guide, will walk you through the process of deploying an application using a Jenkins pipeline in an independent setup. Whether you’re new to Jenkins or looking to set up a fresh deployment pipeline, we’ve got you covered. Let’s dive in!” Introduction ...

In the world of machine learning, automated training pipelines streamline the journey from data to insight. They automate various parts of the machine learning life cycle such as data ingestion, preprocessing, model training, evaluation and deployment. Amazon Web Services (“AWS”) provide...

This is a multi-part article series where I dive into the ideal stack you’d use for a data engineering pipeline given constraints around what software providers to use. I aim to provide some indications of cost, ease of use, and functional limitations / cool features. Original article:&nbsp...

Tools and Technologies: Jenkins: Jenkins serves as the CI/CD orchestration tool, automating the build and deployment processes. It integrates with various security tools to enforce security checks at every stage of the pipeline. SonarQube: SonarQube is used for code quality and security scan...