Job Description:
We are seeking a skilled Data Engineer to support our project by designing, building, and optimizing data entities and transformation logic within the Snowflake data platform.
This role will translate business requirements into scalable data models, implement robust data pipelines, and develop calculations and transformations that enable analytics and reporting.
Key Responsibilities
* Data Modeling & Entity Creation
o Design and build Snowflake data entities (e.g., tables, views, schemas) aligned with business and architectural requirements.
o Develop and optimize dimensional models, relational models, and data structures for analytical use cases.
o Ensure data models follow best practices for performance, maintainability, and scalability.
* Data Transformation & Logic Development
o Implement complex SQL transformations, business logic, and calculations in Snowflake.
o Develop reusable and maintainable stored procedures, UDFs, tasks, and pipelines as needed.
o Translate functional requirements into technical specifications for data calculations and KPIs.
* Data Ingestion & Orchestration
o Build and operate batch and near real-time pipelines into Snowflake using External Stages (S3/ADLS/GCS), COPY INTO, Snowpipe/Snowpipe Streaming, and API ingestion (REST/JSON).
o Orchestrate jobs with dbt Cloud Jobs/Databricks
o Handle semi-structured data (JSON/CSV/Parquet) with schema evolution management.
* Data Pipeline Development
o Build, maintain, and optimize ELT/ETL data pipelines feeding Snowflake from internal and external sources.
o Collaborate with data integration teams to ensure data quality, completeness, and reliability.
* Manual Input
o Design and maintain controlled manual input / overrides (reference tables, mapping tables, allow/deny lists, exception registers).
o Provide secure, auditable mechanisms for data entry (validated spreadsheet templates, Snowflake Worksheets, or lightweight apps such as Streamlit/Power Apps) that write to stewardship tables with approval workflow, versioning, and rollback.
* Performance, Quality & Governance
o Monitor and tune Snowflake performance, including query optimization, warehouse sizing, and resource usage.
o Implement data quality checks, validation rules, and audit processes.
o Ensure adherence to data governance, security, and compliance standards.
o Maintain data lineage and documentation (dbt docs) and publish a data dictionary/glossary.
o Set up alerting for pipeline failures, data drifts, and SLA breaches.
* Collaboration
o Work closely with business analysts, data modelers, architects, and project managers to deliver end-to-end solutions.
o Participate in design discussions, requirements refinement, and sprint planning.
Required Technical Skills:
* Snowflake (advanced): SQL, tasks/streams, stages, Snowpipe/Snowpipe Streaming, file formats, performance tuning, RBAC, masking policies
* ETL/ELT & Orchestration: Incremental loads, CDC; dbt Cloud
* SQL for complex transformations and performance optimization.
* Experience with version control (Git) and CI/CD practices
Required Soft Skills:
* Strong sense of ownership and a “can do” attitude
* Analytical and problem solving skills
* Ability to work independently and collaboratively in cross functional teams
* Excellent communication skills (English)
* Teamwork and stakeholder collaboration
Preferred Skills:
* Databricks
* dbt
* Power BI
* Python for ingestion/automation (APIs, utilities, data validation).
* Knowledge of the trading domain
