Job Description :
About The Role
We are looking for a Senior Data Engineer
with experience in excellent analytical
abilities in GCP BigQuery, ETL/BI, Python,
Composer/Airflow, SQL, GCP Services -
with the ability to operate in an agile
environment and keen to detail while
understanding the larger data warehouse.
Skills & Competencies
➔ A minimum of 4.5+ years of
working experience as a hands-on
data engineering is a must
➔ Advanced Degree in the field of
Computer Science, Data
Engineering, Data Analytics or
equivalent discipline
➔ Strong programming experience
with Python, SQL, ETL and
efficiently querying big datasets
using SQL
➔ Prior experience with CircleCI
CI/CD, Terraform and Github
version control is a must
➔ Solid understanding of Data
Collection, Data Ingestion, Data
Integration, and Data Operations
& Maintenance
➔ Implement data governance
practices, including data quality,
security, and compliance, in line
with organizational standards.
➔ Domain knowledge on News,
Media & Communications is an
added advantage
R E S P O N S I B I L I T I E S
➔ Design, build, and maintain scalable
ETL/ELT pipelines in Google Cloud, using
tools like Cloud Composer (Airflow), and
BigQuery.
➔ Collaborate with cross-functional teams to
define data architecture and data
warehouse requirements
➔ Automate data pipelines, ETL/ELT
processes, and data integration workflows
using infrastructure-as-code (IaC) and
configuration management tools
➔ Deep understanding of BigQuery,
including SQL, optimization techniques,
partitioning, clustering, and performance
tuning.
➔ Deliver production quality, modular,
reproducible code in Python, SQL
➔ Implement continuous integration and
continuous deployment (CI/CD) pipelines
for data pipelines and data-related
applications
➔ Keep abreast of the latest developments
in the field through continuous learning
and proactively champion promising new
methods relevant to the problems at hand.
Our Tech Stack
- Google Cloud Platform is IaaS
- BigQuery, GCS, Python, SQL
- Composer / Airflow - orchestration
tools
- Terraform, CircleCI, CI/CD, GIthub,
Jira, Confluence
Equal Opportunity Employer
All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, age, national origin, protected veteran status, disability status or any other protected characteristic.
Reasonable Accommodation
We are committed to providing reasonable accommodation for qualified individuals with disabilities in our job application and/or interview process. If you need assistance or accommodation in completing your application or participating in an interview due to a disability, email us at
[email protected]. Please put "Reasonable Accommodation" in the subject line and provide a brief description of the type of assistance you need. This inbox will not be monitored for application status updates.
Please refer to the privacy notice at the bottom of this page for submitting any data access, deletion, or other data subject rights requests, where permitted under your local laws and regulations.
This job is posted with NTS Technology Services Pvt. Ltd.
