JOB INFORMATION
JOB TITLE: Senior – Data Engineer
Job Purpose
The Senior - Data Engineer serves as a team member to design, build, implement and support ITG Care Management enterprise application
initiatives. This position collaborates with all team members to ensure quality applications are delivered on time following business owner
specifications and HCA ITG development standards. This candidate will play a significant role in designing, building, and supporting enterprise-
level data engineering solutions, primarily leveraging Databricks, Azure, and GCP tools. With a focus on high-quality delivery and innovation,
this role involves implementing robust data pipelines, driving architecture decisions, and integrating diverse technologies. The ideal candidate
will thrive in a fast-paced Agile environment, collaborating across mixed teams of consultants and employees to deliver impactful solutions
that meet dynamic business needs. Additionally, Data Engineer will provide second-level support for legacy and modern systems. The Senior
Data Engineer must be a highly motivated self-starter, an enthusiastic learner, and committed to delivering high quality solutions within
scheduled timelines.
JOB SPECIFICATIONS
QUALIFICATION Bachelor’s degree in information technology, computer science or related fields
YEARS OF
Experience
&
ROLES &
RESPONSIBILITIES 5- 8 Years of experience in Data Engineering field. Development Leadership:
- Assist in the design and implementation of scalable, fit-for-purpose data engineering solutions using Databricks and other modern platforms aligned to strategic plans and technology roadmaps
- Collaborate with team members to successfully execute development initiatives following Agile practices and principles
- Shares knowledge and experience to contribute to growth of overall team
- Provide guidance to more junior colleagues in efforts of design, development, deployment, and supporting software systems
- Integrates new/existing software with existing systems
- Practice continuous integration and continuous delivery automation pipeline and deployment processes Collaboration and Communication:
- Collaborates with business analysts, project lead, management and customers on requirements, translating them into technical solutions
- Focus on customer satisfaction in an environment with rapidly changing business requirements and priorities
- Actively participate in Agile ceremonies, demonstrating value-based decision-making to prioritize stakeholders’ requests
- Document designs, processes, and troubleshooting techniques with a focus on knowledge sharing and team growth.
TECHNICAL SKILLS
- Must have 5+ years' experience as ETL data engineer
- Build and maintain robust data processing systems using Python, SQL, Spark SQL, and related tools
- Leverage GCP-native tools such as BigQuery, Dataflow, and Dataproc to architect data lake and data warehouse solutions
- Work with streaming data and tools like Kafka to design real-time data processing pipelines.
- Gain a deep understanding of existing legacy systems and provide ongoing technical support and improvement recommendations
- Ability to write and execute unit/integration testing
- Develop software applications using cloud technologies and on-prem tools such as GCP, BI, Teradata, Azure, SSIS, and DMX.
- Use GCP Dataflow, BigQuery SQL, Python, SQL, Stored procedures to create jobs for extracting, cleaning, transforming, and loading data into Data Warehouses, GCP BigQuery or Azure SQL Server.
MUST TO HAVE
SKILLS
- Build scalable Python/SQL/Spark pipelines in GCP (BigQuery, Dataflow, Dataproc) to extract/transform/load complex, multi-source data into centralized warehouses.
- Architect/optimize high-availability, high-performance SQL Server databases and develop SSIS packages to automate data movement.
- Manage RabbitMQ to enable asynchronous, decoupled microservice communication.
GOOD TO HAVE
SKILLS
- Design low-latency Kafka solutions for real-time ingestion, high-throughput event processing, and analytics/insights.
- Use Python for data analysis, automation, and custom tooling in the data engineering ecosystem.
- Implement FHIR standards for secure, standardized exchange of electronic health records.
PEOPLE
MANAGEMENT SKILLS
- Ability to develop and strengthen collaborative relationships with both internal and external stakeholders to advance the care of our patients and the growth of HCA Healthcare
- Ability to build trust and act with authenticity to cultivate a culture of integrity, inclusion, and mutual respect.
- Ability to identify opportunities for improvement and innovation, remove barriers and resistance, and enable desired behaviors.
- Ability to deliver information in a clear, concise, and compelling manner to effectively engage others and achieve desired results.
OTHER SKILLS
- Conduct root cause analysis and automate data analytical tasks for better performance and system health. Implement new monitoring methods and ensure SLA is met.
- Leads and closely collaborates with team members to successfully execute development initiatives using Agile practices and principles
- Use GCP tools, Azure, Stored procedures to create jobs for extracting, cleaning, transforming, and loading data into Data Warehouses, Cloud SQL, and Power apps flow to automate jobs
- Serve as technical and data advisor to oversee and evaluate development initiatives across various platforms within the department. Manage development and performance of unit test plans for application testing. Collaborate with the appropriate process teams for QA and user acceptance testing of application changes. Utilize change management processes for implementation and support of supported applications.
- Must possess a strong understanding of current agile development methodologies
- Performs other duties as assigned
- Process oriented with excellent documentation skills
- Prototypes and delivers just-in-time solutions
- Implements monitoring and alerting mechanisms for data processing systems
- Practices and adheres to the “Code of Conduct” philosophy and “Mission and Value Statement.”
REPORTING STRUCTURE
Does this position formally supervise employees?
(Y / N) No
