As a Middle Data Engineer, migrate SQL Server data warehouses to Snowflake, refactor ETL processes, build data pipelines, and ensure reliable data movement.
Position Overview:
As a Middle Data Engineer, you will support the migration of legacy on-premises SQL Server data warehouse to a cloud-based Snowflake environment. The project involves integrating various data sources, refactoring ETL processes, and ensuring efficient, reliable data movement for analytics and reporting.
Responsibilities:
- Build and modify data pipelines to migrate data from SQL Server and other databases (Azure SQL, Oracle, Aurora) to AWS S3 and Snowflake.
- Refactor legacy ETL jobs (SSIS, Transact-SQL) for use in cloud environments.
- Implement data transformations and staging using dbt and/or similar tools.
- Optimize the performance and costs of cloud data processing and storage.
- Work collaboratively with client’s and N-iX engineers, ensuring smooth handoff and documentation.
- Participate in QA, testing, deployment, and post-migration validation.
Must-Have Technologies:
- Experience with cloud data warehouse technologies, including Snowflake and AWS S3.
- Solid SQL skills; experience migrating legacy environments to cloud platforms.
- Familiarity with ETL frameworks and tools (preferably SSIS, dbt).
- Proficiency in Python for data pipeline development and automation.
- Strong documentation and communication skills; able to work in cross-functional teams.
Nice to have:
- Prior experience in large-scale data migration projects.
- Background working with varied database platforms (SQL Server, Oracle, PostgreSQL, MySQL).
- Knowledge of reporting platforms such as Looker is a plus.
We offer*:
- Flexible working format - remote, office-based or flexible
- A competitive salary and good compensation package
- Personalized career growth
- Professional development tools (mentorship program, tech talks and trainings, centers of excellence, and more)
- Active tech communities with regular knowledge sharing
- Education reimbursement
- Memorable anniversary presents
- Corporate events and team buildings
- Other location-specific benefits
*not applicable for freelancers
Top Skills
Aws S3
Dbt
ETL
MySQL
Oracle
Postgres
Python
Snowflake
SQL
Ssis
Similar Jobs
Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
This internship focuses on statistical data sciences, ensuring quality data analysis and documentation while supporting leads on various projects.
Top Skills:
PythonRSAS
Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
The Manager, Integration Engineer will implement data capabilities, optimize data pipelines, support teams, troubleshoot data issues, and document technical specifications.
Top Skills:
AirflowAWSCypherDockerETLKafkaKubernetesNeo4JPostgresPythonSnowflake
Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
Manage procurement solutions by executing projects involving SAP, Agile methodologies, and transforming business needs into functional specifications while coordinating with cross-functional teams.
Top Skills:
CSSHTMLHTML5JavaScriptJqueryO365RestSAPSoap
What you need to know about the Edinburgh Tech Scene
From traditional pubs and centuries-old universities to sleek shopping malls and glass-paneled office buildings, Edinburgh's architecture reflects its unique blend of history and modernity. But the fusion of past and future isn't just visible in its buildings; it's also shaping the city's economy. Named the United Kingdom's leading technology ecosystem outside of London, Edinburgh plays host to major global companies like Apple and Adobe, as well as a growing number of innovative startups in fields like cybersecurity, finance and healthcare.
