close
The Wayback Machine - https://web.archive.org/web/20210718090331/https://github.com/topics/data-lineage
Skip to content
#

data-lineage

Here are 22 public repositories matching this topic...

document-processing-pipeline-for-regulated-industries
kun-scheduler
jentle
jentle commented Aug 28, 2020

Is your feature request related to a problem? Please describe.
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]
目前, kun 只可以的部署和调度执行只能限制在单台机器上(或者是单个容器中), 并且任务的调度执行并没有相对应的资源管理和限制。 很难适应大规模任务调度的场景, 也不利于扩展。

可以利用成熟的资源调度和管理框架, 根据需求实现分布式的任务分发和执行,比如 yarn, kubernetes,mesos。 yarn 是hadoop 平台上比较成功的资源调度器, 我们可以通过实现yarn app 的方式,来向yarn 请求资源并且执行任务。以下提出一种基于yarn 的任

Improve this page

Add a description, image, and links to the data-lineage topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the data-lineage topic, visit your repo's landing page and select "manage topics."

Learn more