THE SKILL DIRECTORY

Directory

Start with what you want to do, or browse by profession. Technologies, tools and products remain searchable tags.

Technology & product tags (optional)
23 skills found · ETLClear filters ×
deepskillFree

PySpark data transformation aid

Plans PySpark transformation steps from input data, target schema and processing rules. Validate types, partitioning and output quality before running it.

ai-labPySpark数据转换ETL数据管道Spark流处理
↓ 0👍 0
◇ Redistribution not verified↗
deepskillFree

airflow-dag-generator

This Skillπ entry summarizes airflow-dag-generator. The public SKILL.md description states: “Generate airflow dag generator operations. Auto-activating skill for” It is intended f

ai-labAirflowDAG数据管道ETL工作流配置生成代码生成调度
↓ 0👍 0
◇ Redistribution not verified↗
deepskillFree

Spark job planning aid

Organizes a Spark job outline around data sources, transformation goals and runtime constraints for batch or pipeline work. Review resource settings and data impact before submitti

ai-labSpark数据管道ETL作业配置工作流编排流处理代码生成
↓ 0👍 0
◇ Redistribution not verified↗
deepskillFree

dbt-model-generator

This Skillπ entry summarizes dbt-model-generator. The public SKILL.md description states: “Generate dbt model generator operations. Auto-activating skill for Data” It is intended

ai-labdbt数据建模ETL数据管道SQL配置生成数据转换
↓ 0👍 0
◇ Redistribution not verified↗
deepskillFree

data-partitioner

This Skillπ entry summarizes data-partitioner. The public SKILL.md description states: “Process data partitioner operations. Auto-activating skill for Data” It is intended for com

ai-lab数据分区ETL数据管道SparkAirflow数据工程流处理
↓ 0👍 0
◇ Redistribution not verified↗
deepskillFree

Data schema validation guidance

Guidance for schema-validation tasks in data pipelines. Establish the target schema and version before checking real data for structural mismatches. This independent editorial over

ai-lab数据管道模式验证ETL数据工程配置生成校验规则工作流
↓ 0👍 0
◇ Redistribution not verified↗
deepskillFree

incremental-load-setup

This Skillπ entry summarizes incremental-load-setup. The public SKILL.md description states: “Configure incremental load setup operations. Auto-activating skill for” It is intende

ai-lab数据管道增量加载ETL配置数据工程工作流
↓ 0👍 0
◇ Redistribution not verified↗
deepskillFree

dagster-pipeline-creator

This Skillπ entry summarizes dagster-pipeline-creator. The public SKILL.md description states: “Create dagster pipeline creator operations. Auto-activating skill for” It is intend

ai-labDagster数据管道ETL工作流编排配置生成代码生成数据工程
↓ 0👍 0
◇ Redistribution not verified↗
deepskillFree

flink-job-creator

This Skillπ entry summarizes flink-job-creator. The public SKILL.md description states: “Create flink job creator operations. Auto-activating skill for Data” It is intended for de

ai-labFlink数据管道ETL流处理作业配置代码生成工作流编排
↓ 0👍 0
◇ Redistribution not verified↗
deepskillFree

prefect-flow-builder

This Skillπ entry summarizes prefect-flow-builder. The public SKILL.md description states: “Build prefect flow builder operations. Auto-activating skill for Data” It is intended f

ai-labPrefect数据管道工作流编排ETL配置生成最佳实践代码生成
↓ 0👍 0
◇ Redistribution not verified↗
deepskillFree

spark-sql-optimizer

This Skillπ entry summarizes spark-sql-optimizer. The public SKILL.md description states: “Optimize spark sql optimizer operations. Auto-activating skill for Data” It is intended

ai-labSparkSQL优化数据管道ETL配置生成性能调优代码生成
↓ 0👍 0
◇ Redistribution not verified↗
deepskillFree

Kafka stream processing aid

Maps event inputs, stream transformations and output targets into a Kafka processing plan. Validate configuration against the actual cluster, throughput and fault-tolerance needs b

ai-labKafka流处理数据管道ETL实时计算配置生成
↓ 0👍 0
◇ Redistribution not verified↗