Sr. Data Engineer Consultant

Cleartelligence is seeking a Sr. Data Engineer Consultant that will be responsible for defining, articulating, implementing and realizing our data architecture strategy to meet the strategic Data Analytics goals. This role will involve a broad spectrum of application, information, technical, data and business architectures with an Enterprise focus across a global group of stakeholders.

Responsibilities:

  • Provide architecture and infrastructure guidance of Snowflake capabilities to accommodate business/technical use cases.

  • Design, develop, automate, monitor, maintain and performance tune ELT/ETL to manage high volume data transfer to and from internal and external systems.

  • Migrate data from on premise to cloud technologies primarily into Snowflake and AWS eco-system.

  • Interact with cross-functional teams, project managers and agile teams to estimate development efforts and ensure complete delivery of solutions and fulfilling requirement.

  • Automate and manage provisioning needs, such as Snowflake storage and compute, Role Based Access Control model and permissions.

  • Configure and manage monitoring/alerting around replication latency, performance (cluster & query).

  • Deploy CI/CD enabled pipelines and adapt best practices using tools such as GitHub.

  • Provide release management support for databases and related applications in addition to maintaining schemas and objects.

  • Implement solutions to orchestrate pipelines and build workflows.

  • Provide technical expertise and troubleshooting.

  • Ensure security and maintenance of databases, managing and monitoring user access to databases.

  • Provide proactive administration of Snowflake, leveraging your technical expertise in all aspects of the Snowflake platform.

  • Monitor health and growth of cloud snowflake instance tuning Snowflake for performance and utilization optimization.

 

Qualifications:

  • 5+ years of hands-on experience working extensively with relational databases.

  • Deep understanding of SQL; ability to write multi-layer statements that handle complex transformation needs.

  • Demonstrated ability to understand/discover business needs and craft data merges, transformations and aggregations, transformations to deliver data that can be used in reports, analytic repositories and applications.

  • Hands on experience on Snowflake Architecture - Warehouse sizing, data structures, Role-based access control, SnowSQL.

  • Experience with ELT/ETL tools like Fivetran and DBT a plus.

  • Working knowledge of Python, other languages (Java, Javascript, C#) a plus.

  • Hands on experience developing data pipelines in a cloud environment a plus.