20240036858. Dataflow Pipeline Deployment System and Method simplified abstract (Constant Contact, Inc.)
Contents
Dataflow Pipeline Deployment System and Method
Organization Name
Inventor(s)
Srinivasa Subramanyam Pulugurtha of Nashua NH (US)
Pritish Prashant Pai of Natick MA (US)
Misha Smirnov of Andover MA (US)
Dataflow Pipeline Deployment System and Method - A simplified explanation of the abstract
This abstract first appeared for US patent application 20240036858 titled 'Dataflow Pipeline Deployment System and Method
Simplified Explanation
The abstract describes a computer-based method for managing a dataflow pipeline across multiple environments. The method involves receiving a check-in for a first environment, which includes source code, a task definition, a configuration, and a flow definition. It also involves receiving an application secret and credential, which are stored in a dataflow pipeline deployer data store. The method further includes creating a data flow pipeline package by merging the source code, configuration, and secrets, and defining a pipeline graph in the first environment pipeline flow registry.
- The method manages a dataflow pipeline across multiple environments.
- It receives source code, task definition, configuration, and flow definition for a first environment.
- It receives an application secret and credential.
- The secret and credential are stored in a dataflow pipeline deployer data store.
- It creates a data flow pipeline package by merging the source code, configuration, and secrets.
- It defines a pipeline graph in the first environment pipeline flow registry.
Potential applications of this technology:
- Data processing and analysis pipelines in various industries such as finance, healthcare, and e-commerce.
- Streamlining and automating dataflow management in software development and deployment processes.
Problems solved by this technology:
- Simplifies the management of dataflow pipelines across multiple environments.
- Ensures secure storage of application secrets and credentials.
- Facilitates the creation and deployment of data flow pipeline packages.
Benefits of this technology:
- Improved efficiency and reliability in managing dataflow pipelines.
- Enhanced security by securely storing application secrets and credentials.
- Streamlined development and deployment processes for dataflow pipelines.
Original Abstract Submitted
a computer-based method for managing a dataflow pipeline across a plurality of environments, includes the steps of: receiving, for a first environment, a check-in comprising source code, a task definition, a configuration, and a flow definition; receiving a definition of an application secret and an associated credential; storing the application secret and credential in a dataflow pipeline deployer data store; creating a data flow pipeline package, further comprising the steps of: merging the source code, the configuration, and the secrets; and defining a pipeline graph in the first environment pipeline flow registry.
