Sr. Data Engineer Consultant
Cleartelligence is seeking a Sr. Data Engineer Consultant that will be responsible for defining, articulating, implementing and realizing our data architecture strategy to meet the strategic Data Analytics goals. This role will involve a broad spectrum of application, information, technical, data and business architectures with an Enterprise focus across a global group of stakeholders.
Responsibilities:
-
Provide architecture and infrastructure guidance of Snowflake capabilities to accommodate business/technical use cases.
-
Design, develop, automate, monitor, maintain and performance tune ELT/ETL to manage high volume data transfer to and from internal and external systems.
-
Migrate data from on premise to cloud technologies primarily into Snowflake and AWS eco-system.
-
Interact with cross-functional teams, project managers and agile teams to estimate development efforts and ensure complete delivery of solutions and fulfilling requirement.
-
Automate and manage provisioning needs, such as Snowflake storage and compute, Role Based Access Control model and permissions.
-
Configure and manage monitoring/alerting around replication latency, performance (cluster & query).
-
Deploy CI/CD enabled pipelines and adapt best practices using tools such as GitHub.
-
Provide release management support for databases and related applications in addition to maintaining schemas and objects.
-
Implement solutions to orchestrate pipelines and build workflows.
-
Provide technical expertise and troubleshooting.
-
Ensure security and maintenance of databases, managing and monitoring user access to databases.
-
Provide proactive administration of Snowflake, leveraging your technical expertise in all aspects of the Snowflake platform.
-
Monitor health and growth of cloud snowflake instance tuning Snowflake for performance and utilization optimization.
Qualifications:
-
5+ years of hands-on experience working extensively with relational databases.
-
Deep understanding of SQL; ability to write multi-layer statements that handle complex transformation needs.
-
Demonstrated ability to understand/discover business needs and craft data merges, transformations and aggregations, transformations to deliver data that can be used in reports, analytic repositories and applications.
-
Hands on experience on Snowflake Architecture - Warehouse sizing, data structures, Role-based access control, SnowSQL.
-
Experience with ELT/ETL tools like Fivetran and DBT a plus.
-
Working knowledge of Python, other languages (Java, Javascript, C#) a plus.
-
Hands on experience developing data pipelines in a cloud environment a plus.