necatiarslan
GitHub profile for necatiarslan20 skills
necatiarslan / annotating-task-lineage
Enables Airflow tasks to be annotated with data lineage, enhancing tracking and metadata management for ETL processes.
necatiarslan / creating-openlineage-extractors
Guides users in creating custom OpenLineage extractors for Airflow operators to capture detailed lineage data.
necatiarslan / migrating-airflow-2-to-3
Facilitates the migration of Apache Airflow 2.x projects to 3.x, addressing compatibility issues and modernizing codebases.
necatiarslan / authoring-dags
Guides users in creating and validating Apache Airflow DAGs using best practices and VS Code extension tools.
necatiarslan / tracing-upstream-lineage
Enables tracing of upstream data lineage to identify data sources, dependencies, and origins for better data understanding and quality.
necatiarslan / debugging-dags
Facilitates comprehensive diagnosis and root cause analysis for failed Airflow DAGs, providing actionable remediation steps.
necatiarslan / managing-astro-local-env
Manages local Airflow environments using Astro CLI for starting, stopping, and troubleshooting containers effectively.
necatiarslan / tracing-downstream-lineage
Enables tracing of downstream data lineage and impact analysis to assess risks before modifying data structures.
necatiarslan / awsclaw-sts
Facilitates AWS STS operations in VS Code, enabling identity verification, role assumption, and temporary credential management.
necatiarslan / airflow-hitl
Facilitates human-in-the-loop workflows in Airflow, enabling approval processes and user input in data pipelines.
necatiarslan / airflow
Facilitates Apache Airflow operations in VS Code, enabling users to manage DAGs, view logs, and check server status efficiently.
necatiarslan / setting-up-astro-project
Facilitates the initialization and configuration of Astro/Airflow projects, streamlining project setup and dependency management.
necatiarslan / testing-dags
Facilitates complex DAG testing workflows with debugging and fixing cycles, enhancing data pipeline reliability and efficiency.
necatiarslan / awsclaw-dynamodb
Manages Amazon DynamoDB tables and items using awsclaw, enabling CRUD operations, queries, and data management.
necatiarslan / awsclaw-general
Enables efficient AWS management in VS Code with natural language prompts and session management features.
necatiarslan / awsclaw-glue
Manages AWS Glue ETL jobs and resources, enabling users to create, update, and inspect data workflows efficiently.
necatiarslan / awsclaw-lambda
Manages AWS Lambda functions, allowing users to create, update, invoke, and delete functions with various configurations.
necatiarslan / awsclaw-s3
Manages Amazon S3 buckets and objects using awsclaw, enabling users to create, configure, and manipulate S3 resources efficiently.
necatiarslan / awsclaw-sns
Manages Amazon SNS resources for notifications, subscriptions, and messaging using awsclaw, enhancing communication strategies.
necatiarslan / awsclaw-sqs
Manages Amazon SQS queues and messages, enabling users to create, configure, and manipulate queues and messages efficiently.